Skip to content

feat: add LiteLLM provider - #9404

Closed
misbahsy wants to merge 1 commit into
anomalyco:devfrom
misbahsy:feat/litellm-provider
Closed

misbahsy wants to merge 1 commit into
anomalyco:devfrom
misbahsy:feat/litellm-provider

Conversation

@misbahsy

Copy link
Copy Markdown

Summary

This PR adds LiteLLM Proxy as a provider. LiteLLM is an open source gateway that you host yourself. It gives one OpenAI-compatible endpoint for many model providers.

With this entry, tools that read this catalog can list LiteLLM by name, with the default local URL.

Changes

  • providers/litellm/provider.toml: name, LITELLM_API_KEY, @ai-sdk/openai-compatible, http://localhost:4000/v1 and the docs link.
  • providers/litellm/logo.svg: the LiteLLM logo with currentColor and a square viewBox.
  • providers/litellm/models/gpt-6-luna.toml: one example alias with base_model = "openai/gpt-6-luna". The reasoning effort values match the OpenAI entry, because LiteLLM forwards reasoning_effort to the backend.

Verification

  • bun validate passes. The litellm entry has GPT-6 Luna with the limits from the lab entry.
  • bun run test in packages/sdk passes (25 tests).
  • bun run build in packages/web passes and copies litellm.svg to dist/logos.

Notes

  • The catalog needs at least one model. LiteLLM model names are aliases that each proxy sets in its own config. The example alias works only if the proxy defines it.
  • I omit cost because the price depends on the backend.
  • bun test in packages/core has 10 failures. They also fail on dev without this change.

@github-actions

Copy link
Copy Markdown
Contributor

No actionable findings.

@github-actions github-actions Bot added the reviewer: ready Automated review found no actionable items label Oct 11, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Closing this pull request as stale because it has not been updated in 30 days. Feel free to reopen it or submit a new pull request if the work is resumed.

@github-actions github-actions Bot closed this Nov 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

reviewer: ready Automated review found no actionable items

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant