-
-
Notifications
You must be signed in to change notification settings - Fork 69.6k
Tracking: Custom Provider Base URLs #3731
Copy link
Copy link
Closed as not planned
Description
Custom Provider Base URLs Tracking Issue
This issue tracks requests for custom API endpoint support across different model providers.
Related Issues
By Provider
- [Feature Request] Support for Custom Anthropic-Compatible API Endpoints #3162 - Custom Anthropic-compatible API endpoints (crashes with mapOptionsForApi error)
- Feature Request: Custom baseUrl for model providers (OpenAI-compatible proxies) #2305 - Custom baseUrl for OpenAI provider (LiteLLM proxy support)
- [Feature]: Need an easy way to change the llm endpoint. #2610 - General request for easier LLM endpoint configuration in UI
Related TTS Issue
- Custom TTS endpoint configuration is difficult - silent validation failures and undocumented workaround #2619 - Custom TTS endpoint configuration (ElevenLabs baseUrl)
Use Cases
- Internal LLM gateways — Cost tracking, security, compliance, audit logging
- Local proxies — LiteLLM for smart routing (Ollama → Gemini → Claude fallback)
- Self-hosted models — Route to local inference servers
- Rate limit management — Distribute load across multiple endpoints
Current State
| Provider | baseUrl Support | Status |
|---|---|---|
| OpenAI | Partial | OPENAI_BASE_URL env var works for some features |
| Anthropic | No | Crashes with "Unhandled API in mapOptionsForApi" |
| Ollama | Yes | Works but other bugs (#3597, #3153) |
| Custom | Partial | Works for tools, not always for model providers |
Proposed Solution
- All providers should support
baseUrlin config - API type detection should not assume official endpoints
- Validation should be relaxed when custom baseUrl is configured
- Document which features work with custom endpoints
Acceptance Criteria
-
models.providers.<provider>.baseUrlworks for all built-in providers - No crashes when using custom endpoints
- Clear documentation for proxy/gateway setups
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
Type
Fields
Give feedbackNo fields configured for issues without a type.