{"info":{"author":"BerriAI","author_email":null,"bugtrack_url":null,"classifiers":[],"description":"<h1 align=\"center\">\n        \ud83d\ude85 LiteLLM\n    <\/h1>\n    <p align=\"center\">\n        <p align=\"center\">LiteLLM AI Gateway\n        <\/p>\n        <p align=\"center\">Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.<\/p>\n        <p align=\"center\">\n        <a href=\"https:\/\/render.com\/deploy?repo=https:\/\/github.com\/BerriAI\/litellm\" target=\"_blank\" rel=\"nofollow\"><img src=\"https:\/\/render.com\/images\/deploy-to-render-button.svg\" alt=\"Deploy to Render\" height=\"40\"><\/a>\n        <a href=\"https:\/\/railway.com\/deploy\/RhvhdC?referralCode=7mRv9K&utm_medium=integration&utm_source=template&utm_campaign=generic\"><img src=\"https:\/\/railway.com\/button.svg\" alt=\"Deploy on Railway\" height=\"40\"><\/a>\n        <a href=\"https:\/\/console.aws.amazon.com\/cloudshell\/home\" target=\"_blank\" rel=\"nofollow\"><img src=\".\/.github\/deploy-on-aws.png\" alt=\"Deploy on AWS\" height=\"40\"><\/a>\n        <a href=\"https:\/\/ssh.cloud.google.com\/cloudshell\/editor?cloudshell_git_repo=https%3A%2F%2Fgithub.com%2FBerriAI%2Flitellm&cloudshell_workspace=terraform%2Flitellm%2Fgcp%2Fexamples%2Fdefault&cloudshell_tutorial=TUTORIAL.md&cloudshell_image=gcr.io\/ds-artifacts-cloudshell\/deploystack_custom_image&shellonly=true\" target=\"_blank\" rel=\"nofollow\"><img src=\".\/.github\/deploy-on-gcp.png\" alt=\"Deploy on GCP\" height=\"40\"><\/a>\n        <\/p>\n    <\/p>\n<h4 align=\"center\"><a href=\"https:\/\/docs.litellm.ai\/docs\/simple_proxy\" target=\"_blank\">LiteLLM Proxy Server (AI Gateway)<\/a> | <a href=\"https:\/\/docs.litellm.ai\/docs\/enterprise#hosted-litellm-proxy\" target=\"_blank\"> Hosted Proxy<\/a> | <a href=\"https:\/\/litellm.ai\/enterprise\"target=\"_blank\">Enterprise Tier<\/a> | <a href=\"https:\/\/www.litellm.ai\/ai-gateway\" target=\"_blank\">Website<\/a><\/h4>\n<h4 align=\"center\">\n    <a href=\"https:\/\/pypi.org\/project\/litellm\/\" target=\"_blank\">\n        <img src=\"https:\/\/img.shields.io\/pypi\/v\/litellm.svg\" alt=\"PyPI Version\">\n    <\/a>\n    <a href=\"https:\/\/github.com\/BerriAI\/litellm\" target=\"_blank\">\n        <img src=\"https:\/\/img.shields.io\/github\/stars\/BerriAI\/litellm.svg?style=social\" alt=\"GitHub Stars\">\n    <\/a>\n    <a href=\"https:\/\/www.ycombinator.com\/companies\/berriai\">\n        <img src=\"https:\/\/img.shields.io\/badge\/Y%20Combinator-W23-orange?style=flat-square\" alt=\"Y Combinator W23\">\n    <\/a>\n    <a href=\"https:\/\/wa.link\/huol9n\">\n        <img src=\"https:\/\/img.shields.io\/static\/v1?label=Chat%20on&message=WhatsApp&color=success&logo=WhatsApp&style=flat-square\" alt=\"Whatsapp\">\n    <\/a>\n    <a href=\"https:\/\/discord.gg\/wuPM9dRgDw\">\n        <img src=\"https:\/\/img.shields.io\/static\/v1?label=Chat%20on&message=Discord&color=blue&logo=Discord&style=flat-square\" alt=\"Discord\">\n    <\/a>\n    <a href=\"https:\/\/www.litellm.ai\/support\">\n        <img src=\"https:\/\/img.shields.io\/static\/v1?label=Chat%20on&message=Slack&color=black&logo=Slack&style=flat-square\" alt=\"Slack\">\n    <\/a>\n    <a href=\"https:\/\/codspeed.io\/BerriAI\/litellm?utm_source=badge\">\n        <img src=\"https:\/\/img.shields.io\/endpoint?url=https:\/\/codspeed.io\/badge.json\" alt=\"CodSpeed\"\/>\n    <\/a>\n<\/h4>\n\n<img alt=\"LiteLLM AI Gateway\" src=\"https:\/\/github.com\/user-attachments\/assets\/c5ee0412-6fb5-4fb6-ab5b-bafae4209ca6\" \/>\n\n---\n\n## What is LiteLLM\n\nLiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers \u2014 OpenAI, Anthropic, Gemini, Bedrock, Azure, and more \u2014 using the OpenAI format.\n\nUse it as a **Python SDK** for direct library integration, or deploy the **AI Gateway (Proxy Server)** as a centralized service for your team or organization.\n\n[**Jump to LiteLLM Proxy (LLM Gateway) Docs**](https:\/\/docs.litellm.ai\/docs\/simple_proxy) <br>\n[**Jump to Supported LLM Providers**](https:\/\/docs.litellm.ai\/docs\/providers)\n\n---\n\n## Why LiteLLM\n\nManaging LLM calls across providers gets complicated fast \u2014 different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction:\n\n- **Unified API** \u2014 one interface for 100+ LLMs, no provider-specific SDK juggling\n- **Drop-in OpenAI compatibility** \u2014 swap providers without rewriting your code\n- **Production-ready gateway** \u2014 virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard out of the box\n- **8ms P95 latency** at 1k RPS ([benchmarks](https:\/\/docs.litellm.ai\/docs\/benchmarks))\n\n### OSS Adopters\n\n<table>\n  <tr>\n    <td><img height=\"60\" alt=\"Stripe\" src=\"https:\/\/github.com\/user-attachments\/assets\/f7296d4f-9fbd-460d-9d05-e4df31697c4b\" \/><\/td>\n    <td><img height=\"60\" alt=\"image\" src=\"https:\/\/github.com\/user-attachments\/assets\/436fca71-988b-40bb-b5fe-8450c80fdbd0\" \/><\/td>\n    <td><img height=\"60\" alt=\"Google ADK\" src=\"https:\/\/github.com\/user-attachments\/assets\/caf270a2-5aee-45c4-8222-41a2070c4f19\" \/><\/td>\n    <td><img height=\"60\" alt=\"Greptile\" src=\"https:\/\/github.com\/user-attachments\/assets\/3db0ae72-0843-4005-a56d-bba1dde2193d\" \/><\/td>\n    <td><img height=\"60\" alt=\"OpenHands\" src=\"https:\/\/github.com\/user-attachments\/assets\/a6150c4c-149e-4cae-888b-8b92be6e003f\" \/><\/td>\n    <td><h2>Netflix<\/h2><\/td>\n    <td><img height=\"60\" alt=\"OpenAI Agents SDK\" src=\"https:\/\/github.com\/user-attachments\/assets\/c02f7be0-8c2e-4d27-aea7-7c024bfaebc0\" \/><\/td>\n  <\/tr>\n<\/table>\n\n---\n\n## Features\n\n<details open>\n<summary><b>LLMs<\/b> - Call 100+ LLMs (Python SDK + AI Gateway)<\/summary>\n\n[**All Supported Endpoints**](https:\/\/docs.litellm.ai\/docs\/supported_endpoints) - `\/chat\/completions`, `\/responses`, `\/embeddings`, `\/images`, `\/audio`, `\/batches`, `\/rerank`, `\/a2a`, `\/messages` and more.\n\n### Python SDK\n\n```shell\nuv add litellm\n```\n\n```python\nfrom litellm import completion\nimport os\n\nos.environ[\"OPENAI_API_KEY\"] = \"your-openai-key\"\nos.environ[\"ANTHROPIC_API_KEY\"] = \"your-anthropic-key\"\n\n# OpenAI\nresponse = completion(model=\"openai\/gpt-4o\", messages=[{\"role\": \"user\", \"content\": \"Hello!\"}])\n\n# Anthropic  \nresponse = completion(model=\"anthropic\/claude-sonnet-4-20250514\", messages=[{\"role\": \"user\", \"content\": \"Hello!\"}])\n```\n\n### AI Gateway (Proxy Server)\n\n[**Getting Started - E2E Tutorial**](https:\/\/docs.litellm.ai\/docs\/proxy\/docker_quick_start) - Setup virtual keys, make your first request\n\n```shell\nuv tool install 'litellm[proxy]'\nlitellm --model gpt-4o\n```\n\n```python\nimport openai\n\nclient = openai.OpenAI(api_key=\"anything\", base_url=\"http:\/\/0.0.0.0:4000\")\nresponse = client.chat.completions.create(\n    model=\"gpt-4o\",\n    messages=[{\"role\": \"user\", \"content\": \"Hello!\"}]\n)\n```\n\n[**Docs: LLM Providers**](https:\/\/docs.litellm.ai\/docs\/providers)\n\n<\/details>\n\n<details>\n<summary><b>Agents<\/b> - Invoke A2A Agents (Python SDK + AI Gateway)<\/summary>\n\n[**Supported Providers**](https:\/\/docs.litellm.ai\/docs\/a2a#add-a2a-agents) - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI\n\n### Python SDK - A2A Protocol\n\n```python\nfrom litellm.a2a_protocol import A2AClient\nfrom a2a.types import SendMessageRequest, MessageSendParams\nfrom uuid import uuid4\n\nclient = A2AClient(base_url=\"http:\/\/localhost:10001\")\n\nrequest = SendMessageRequest(\n    id=str(uuid4()),\n    params=MessageSendParams(\n        message={\n            \"role\": \"user\",\n            \"parts\": [{\"kind\": \"text\", \"text\": \"Hello!\"}],\n            \"messageId\": uuid4().hex,\n        }\n    )\n)\nresponse = await client.send_message(request)\n```\n\n### AI Gateway (Proxy Server)\n\n**Step 1.** [Add your Agent to the AI Gateway](https:\/\/docs.litellm.ai\/docs\/a2a#adding-your-agent) \u2014 set `protocolVersion` to `1.0` or `0.3` per agent\n\n**Step 2.** Call Agent via A2A SDK (requires `a2a-sdk>=1.1.0`)\n\n```python\nimport httpx\nfrom a2a.client import A2ACardResolver, ClientConfig, ClientFactory\nfrom a2a.types import Message, Part, Role, SendMessageRequest\nfrom a2a.utils.constants import TransportProtocol\nfrom uuid import uuid4\n\nbase_url = \"http:\/\/localhost:4000\/a2a\/my-agent\"  # LiteLLM proxy + agent name\nheaders = {\"Authorization\": \"Bearer sk-1234\"}    # LiteLLM Virtual Key\n\nasync with httpx.AsyncClient(headers=headers, timeout=60.0) as http_client:\n    resolver = A2ACardResolver(httpx_client=http_client, base_url=base_url)\n    agent_card = await resolver.get_agent_card()\n    config = ClientConfig(\n        httpx_client=http_client,\n        streaming=False,\n        supported_protocol_bindings=[TransportProtocol.JSONRPC, TransportProtocol.HTTP_JSON],\n    )\n    client = ClientFactory(config).create(agent_card)\n\n    request = SendMessageRequest(\n        message=Message(\n            message_id=uuid4().hex,\n            role=Role.ROLE_USER,\n            parts=[Part(text=\"Hello!\")],\n        )\n    )\n    async for event in client.send_message(request):\n        populated = event.ListFields()\n        if populated and populated[0][0].name in (\"message\", \"msg\"):\n            print(\"\".join(getattr(p, \"text\", \"\") or \"\" for p in populated[0][1].parts))\n```\n\n[**Docs: A2A Agent Gateway**](https:\/\/docs.litellm.ai\/docs\/a2a)\n\n<\/details>\n\n<details>\n<summary><b>MCP Tools<\/b> - Connect MCP servers to any LLM (Python SDK + AI Gateway)<\/summary>\n\n### Python SDK - MCP Bridge\n\n```python\nfrom mcp import ClientSession, StdioServerParameters\nfrom mcp.client.stdio import stdio_client\nfrom litellm import experimental_mcp_client\nimport litellm\n\nserver_params = StdioServerParameters(command=\"python\", args=[\"mcp_server.py\"])\n\nasync with stdio_client(server_params) as (read, write):\n    async with ClientSession(read, write) as session:\n        await session.initialize()\n\n        # Load MCP tools in OpenAI format\n        tools = await experimental_mcp_client.load_mcp_tools(session=session, format=\"openai\")\n\n        # Use with any LiteLLM model\n        response = await litellm.acompletion(\n            model=\"gpt-4o\",\n            messages=[{\"role\": \"user\", \"content\": \"What's 3 + 5?\"}],\n            tools=tools\n        )\n```\n\n### AI Gateway - MCP Gateway\n\n**Step 1.** [Add your MCP Server to the AI Gateway](https:\/\/docs.litellm.ai\/docs\/mcp#adding-your-mcp)\n\n**Step 2.** Call MCP tools via `\/chat\/completions`\n\n```bash\ncurl -X POST 'http:\/\/0.0.0.0:4000\/v1\/chat\/completions' \\\n  -H 'Authorization: Bearer sk-1234' \\\n  -H 'Content-Type: application\/json' \\\n  -d '{\n    \"model\": \"gpt-4o\",\n    \"messages\": [{\"role\": \"user\", \"content\": \"Summarize the latest open PR\"}],\n    \"tools\": [{\n      \"type\": \"mcp\",\n      \"server_url\": \"litellm_proxy\/mcp\/github\",\n      \"server_label\": \"github_mcp\",\n      \"require_approval\": \"never\"\n    }]\n  }'\n```\n\n### Use with Cursor IDE\n\n```json\n{\n  \"mcpServers\": {\n    \"LiteLLM\": {\n      \"url\": \"http:\/\/localhost:4000\/mcp\/\",\n      \"headers\": {\n        \"x-litellm-api-key\": \"Bearer sk-1234\"\n      }\n    }\n  }\n}\n```\n\n[**Docs: MCP Gateway**](https:\/\/docs.litellm.ai\/docs\/mcp)\n\n<\/details>\n\n### Supported Providers ([Website Supported Models](https:\/\/models.litellm.ai\/) | [Docs](https:\/\/docs.litellm.ai\/docs\/providers))\n\n| Provider                                                                            | `\/chat\/completions` | `\/messages` | `\/responses` | `\/embeddings` | `\/image\/generations` | `\/audio\/transcriptions` | `\/audio\/speech` | `\/moderations` | `\/batches` | `\/rerank` |\n|-------------------------------------------------------------------------------------|---------------------|-------------|--------------|---------------|----------------------|-------------------------|-----------------|----------------|-----------|-----------|\n| [Abliteration (`abliteration`)](https:\/\/docs.litellm.ai\/docs\/providers\/abliteration) | \u2705 |  |  |  |  |  |  |  |  |  |\n| [AI\/ML API (`aiml`)](https:\/\/docs.litellm.ai\/docs\/providers\/aiml) | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |\n| [AI21 (`ai21`)](https:\/\/docs.litellm.ai\/docs\/providers\/ai21) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [AI21 Chat (`ai21_chat`)](https:\/\/docs.litellm.ai\/docs\/providers\/ai21) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Aleph Alpha](https:\/\/docs.litellm.ai\/docs\/providers\/aleph_alpha) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Amazon Nova](https:\/\/docs.litellm.ai\/docs\/providers\/amazon_nova) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Anthropic (`anthropic`)](https:\/\/docs.litellm.ai\/docs\/providers\/anthropic) | \u2705 | \u2705 | \u2705 |  |  |  |  |  | \u2705 |  |\n| [Anthropic Text (`anthropic_text`)](https:\/\/docs.litellm.ai\/docs\/providers\/anthropic) | \u2705 | \u2705 | \u2705 |  |  |  |  |  | \u2705 |  |\n| [Anyscale](https:\/\/docs.litellm.ai\/docs\/providers\/anyscale) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [AssemblyAI (`assemblyai`)](https:\/\/docs.litellm.ai\/docs\/pass_through\/assembly_ai) | \u2705 | \u2705 | \u2705 |  |  | \u2705 |  |  |  |  |\n| [Auto Router (`auto_router`)](https:\/\/docs.litellm.ai\/docs\/proxy\/auto_routing) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [AWS - Bedrock (`bedrock`)](https:\/\/docs.litellm.ai\/docs\/providers\/bedrock) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  | \u2705 |\n| [AWS - Sagemaker (`sagemaker`)](https:\/\/docs.litellm.ai\/docs\/providers\/aws_sagemaker) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |\n| [Azure (`azure`)](https:\/\/docs.litellm.ai\/docs\/providers\/azure) | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 |  |\n| [Azure AI (`azure_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/azure_ai) | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 |  |\n| [Azure Text (`azure_text`)](https:\/\/docs.litellm.ai\/docs\/providers\/azure) | \u2705 | \u2705 | \u2705 |  |  | \u2705 | \u2705 | \u2705 | \u2705 |  |\n| [Baseten (`baseten`)](https:\/\/docs.litellm.ai\/docs\/providers\/baseten) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Bytez (`bytez`)](https:\/\/docs.litellm.ai\/docs\/providers\/bytez) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Cerebras (`cerebras`)](https:\/\/docs.litellm.ai\/docs\/providers\/cerebras) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Clarifai (`clarifai`)](https:\/\/docs.litellm.ai\/docs\/providers\/clarifai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Cloudflare AI Workers (`cloudflare`)](https:\/\/docs.litellm.ai\/docs\/providers\/cloudflare_workers) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Codestral (`codestral`)](https:\/\/docs.litellm.ai\/docs\/providers\/codestral) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Cohere (`cohere`)](https:\/\/docs.litellm.ai\/docs\/providers\/cohere) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  | \u2705 |\n| [Cohere Chat (`cohere_chat`)](https:\/\/docs.litellm.ai\/docs\/providers\/cohere) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [CometAPI (`cometapi`)](https:\/\/docs.litellm.ai\/docs\/providers\/cometapi) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |\n| [CompactifAI (`compactifai`)](https:\/\/docs.litellm.ai\/docs\/providers\/compactifai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Custom (`custom`)](https:\/\/docs.litellm.ai\/docs\/providers\/custom_llm_server) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Custom OpenAI (`custom_openai`)](https:\/\/docs.litellm.ai\/docs\/providers\/openai_compatible) | \u2705 | \u2705 | \u2705 |  |  | \u2705 | \u2705 | \u2705 | \u2705 |  |\n| [Dashscope (`dashscope`)](https:\/\/docs.litellm.ai\/docs\/providers\/dashscope) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  | \u2705 |\n| [Databricks (`databricks`)](https:\/\/docs.litellm.ai\/docs\/providers\/databricks) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [DataRobot (`datarobot`)](https:\/\/docs.litellm.ai\/docs\/providers\/datarobot) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Deepgram (`deepgram`)](https:\/\/docs.litellm.ai\/docs\/providers\/deepgram) | \u2705 | \u2705 | \u2705 |  |  | \u2705 |  |  |  |  |\n| [DeepInfra (`deepinfra`)](https:\/\/docs.litellm.ai\/docs\/providers\/deepinfra) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Deepseek (`deepseek`)](https:\/\/docs.litellm.ai\/docs\/providers\/deepseek) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [ElevenLabs (`elevenlabs`)](https:\/\/docs.litellm.ai\/docs\/providers\/elevenlabs) | \u2705 | \u2705 | \u2705 |  |  | \u2705 | \u2705 |  |  |  |\n| [Empower (`empower`)](https:\/\/docs.litellm.ai\/docs\/providers\/empower) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Fal AI (`fal_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/fal_ai) | \u2705 | \u2705 | \u2705 |  | \u2705 |  |  |  |  |  |\n| [Featherless AI (`featherless_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/featherless_ai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Fireworks AI (`fireworks_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/fireworks_ai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [FriendliAI (`friendliai`)](https:\/\/docs.litellm.ai\/docs\/providers\/friendliai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Galadriel (`galadriel`)](https:\/\/docs.litellm.ai\/docs\/providers\/galadriel) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [GitHub Copilot (`github_copilot`)](https:\/\/docs.litellm.ai\/docs\/providers\/github_copilot) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |\n| [GitHub Models (`github`)](https:\/\/docs.litellm.ai\/docs\/providers\/github) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Google - PaLM](https:\/\/docs.litellm.ai\/docs\/providers\/palm) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Google - Vertex AI (`vertex_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/vertex) | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |\n| [Google AI Studio - Gemini (`gemini`)](https:\/\/docs.litellm.ai\/docs\/providers\/gemini) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [GradientAI (`gradient_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/gradient_ai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Groq AI (`groq`)](https:\/\/docs.litellm.ai\/docs\/providers\/groq) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Heroku (`heroku`)](https:\/\/docs.litellm.ai\/docs\/providers\/heroku) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Hosted VLLM (`hosted_vllm`)](https:\/\/docs.litellm.ai\/docs\/providers\/vllm) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Huggingface (`huggingface`)](https:\/\/docs.litellm.ai\/docs\/providers\/huggingface) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  | \u2705 |\n| [Hyperbolic (`hyperbolic`)](https:\/\/docs.litellm.ai\/docs\/providers\/hyperbolic) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [IBM - Watsonx.ai (`watsonx`)](https:\/\/docs.litellm.ai\/docs\/providers\/watsonx) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |\n| [Infinity (`infinity`)](https:\/\/docs.litellm.ai\/docs\/providers\/infinity) |  |  |  | \u2705 |  |  |  |  |  |  |\n| [Jina AI (`jina_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/jina_ai) |  |  |  | \u2705 |  |  |  |  |  |  |\n| [Lambda AI (`lambda_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/lambda_ai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Lemonade (`lemonade`)](https:\/\/docs.litellm.ai\/docs\/providers\/lemonade) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [LiteLLM Proxy (`litellm_proxy`)](https:\/\/docs.litellm.ai\/docs\/providers\/litellm_proxy) | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |\n| [Llamafile (`llamafile`)](https:\/\/docs.litellm.ai\/docs\/providers\/llamafile) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [LM Studio (`lm_studio`)](https:\/\/docs.litellm.ai\/docs\/providers\/lm_studio) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Maritalk (`maritalk`)](https:\/\/docs.litellm.ai\/docs\/providers\/maritalk) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Meta - Llama API (`meta_llama`)](https:\/\/docs.litellm.ai\/docs\/providers\/meta_llama) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Mistral AI API (`mistral`)](https:\/\/docs.litellm.ai\/docs\/providers\/mistral) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |\n| [ModelScope (`modelscope`)](https:\/\/docs.litellm.ai\/docs\/providers\/modelscope) | \u2705 | \u2705 | \u2705 |  | \u2705 |  |  |  |  |  |\n| [Moonshot (`moonshot`)](https:\/\/docs.litellm.ai\/docs\/providers\/moonshot) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Morph (`morph`)](https:\/\/docs.litellm.ai\/docs\/providers\/morph) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Nebius AI Studio (`nebius`)](https:\/\/docs.litellm.ai\/docs\/providers\/nebius) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |\n| [NLP Cloud (`nlp_cloud`)](https:\/\/docs.litellm.ai\/docs\/providers\/nlp_cloud) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Novita AI (`novita`)](https:\/\/novita.ai\/models\/llm?utm_source=github_litellm&utm_medium=github_readme&utm_campaign=github_link) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Nscale (`nscale`)](https:\/\/docs.litellm.ai\/docs\/providers\/nscale) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Nvidia NIM (`nvidia_nim`)](https:\/\/docs.litellm.ai\/docs\/providers\/nvidia_nim) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [OCI (`oci`)](https:\/\/docs.litellm.ai\/docs\/providers\/oci) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Ollama (`ollama`)](https:\/\/docs.litellm.ai\/docs\/providers\/ollama) | \u2705 | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |\n| [Ollama Chat (`ollama_chat`)](https:\/\/docs.litellm.ai\/docs\/providers\/ollama) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Oobabooga (`oobabooga`)](https:\/\/docs.litellm.ai\/docs\/providers\/openai_compatible) | \u2705 | \u2705 | \u2705 |  |  | \u2705 | \u2705 | \u2705 | \u2705 |  |\n| [OpenAI (`openai`)](https:\/\/docs.litellm.ai\/docs\/providers\/openai) | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 | \u2705 |  |\n| [OpenAI-like (`openai_like`)](https:\/\/docs.litellm.ai\/docs\/providers\/openai_compatible) |  |  |  | \u2705 |  |  |  |  |  |  |\n| [OpenRouter (`openrouter`)](https:\/\/docs.litellm.ai\/docs\/providers\/openrouter) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [OVHCloud AI Endpoints (`ovhcloud`)](https:\/\/docs.litellm.ai\/docs\/providers\/ovhcloud) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Perplexity AI (`perplexity`)](https:\/\/docs.litellm.ai\/docs\/providers\/perplexity) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Petals (`petals`)](https:\/\/docs.litellm.ai\/docs\/providers\/petals) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Pinstripes (`pinstripes`)](https:\/\/docs.litellm.ai\/docs\/providers\/pinstripes) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Predibase (`predibase`)](https:\/\/docs.litellm.ai\/docs\/providers\/predibase) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Recraft (`recraft`)](https:\/\/docs.litellm.ai\/docs\/providers\/recraft) |  |  |  |  | \u2705 |  |  |  |  |  |\n| [Replicate (`replicate`)](https:\/\/docs.litellm.ai\/docs\/providers\/replicate) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Sagemaker Chat (`sagemaker_chat`)](https:\/\/docs.litellm.ai\/docs\/providers\/aws_sagemaker) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Sambanova (`sambanova`)](https:\/\/docs.litellm.ai\/docs\/providers\/sambanova) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Snowflake (`snowflake`)](https:\/\/docs.litellm.ai\/docs\/providers\/snowflake) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Text Completion Codestral (`text-completion-codestral`)](https:\/\/docs.litellm.ai\/docs\/providers\/codestral) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Text Completion OpenAI (`text-completion-openai`)](https:\/\/docs.litellm.ai\/docs\/providers\/text_completion_openai) | \u2705 | \u2705 | \u2705 |  |  | \u2705 | \u2705 | \u2705 | \u2705 |  |\n| [Together AI (`together_ai`)](https:\/\/docs.litellm.ai\/docs\/providers\/togetherai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Topaz (`topaz`)](https:\/\/docs.litellm.ai\/docs\/providers\/topaz) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Triton (`triton`)](https:\/\/docs.litellm.ai\/docs\/providers\/triton-inference-server) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [V0 (`v0`)](https:\/\/docs.litellm.ai\/docs\/providers\/v0) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Vercel AI Gateway (`vercel_ai_gateway`)](https:\/\/docs.litellm.ai\/docs\/providers\/vercel_ai_gateway) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [VLLM (`vllm`)](https:\/\/docs.litellm.ai\/docs\/providers\/vllm) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Volcengine (`volcengine`)](https:\/\/docs.litellm.ai\/docs\/providers\/volcano) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Voyage AI (`voyage`)](https:\/\/docs.litellm.ai\/docs\/providers\/voyage) |  |  |  | \u2705 |  |  |  |  |  |  |\n| [WandB Inference (`wandb`)](https:\/\/docs.litellm.ai\/docs\/providers\/wandb_inference) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Watsonx Text (`watsonx_text`)](https:\/\/docs.litellm.ai\/docs\/providers\/watsonx) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [xAI (`xai`)](https:\/\/docs.litellm.ai\/docs\/providers\/xai) | \u2705 | \u2705 | \u2705 |  |  |  |  |  |  |  |\n| [Xinference (`xinference`)](https:\/\/docs.litellm.ai\/docs\/providers\/xinference) |  |  |  | \u2705 |  |  |  |  |  |  |\n\n[**Read the Docs**](https:\/\/docs.litellm.ai\/docs\/)\n\n---\n\n## Get Started\n\nYou can use LiteLLM through either the Proxy Server or Python SDK. Both give you a unified interface to access multiple LLMs (100+ LLMs). Choose the option that best fits your needs:\n\n<table style={{width: '100%', tableLayout: 'fixed'}}>\n<thead>\n<tr>\n<th style={{width: '14%'}}><\/th>\n<th style={{width: '43%'}}><strong><a href=\"https:\/\/docs.litellm.ai\/docs\/simple_proxy\">LiteLLM AI Gateway<\/a><\/strong><\/th>\n<th style={{width: '43%'}}><strong><a href=\"https:\/\/docs.litellm.ai\/docs\/\">LiteLLM Python SDK<\/a><\/strong><\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td style={{width: '14%'}}><strong>Use Case<\/strong><\/td>\n<td style={{width: '43%'}}>Central service (LLM Gateway) to access multiple LLMs<\/td>\n<td style={{width: '43%'}}>Use LiteLLM directly in your Python code<\/td>\n<\/tr>\n<tr>\n<td style={{width: '14%'}}><strong>Who Uses It?<\/strong><\/td>\n<td style={{width: '43%'}}>Gen AI Enablement \/ ML Platform Teams<\/td>\n<td style={{width: '43%'}}>Developers building LLM projects<\/td>\n<\/tr>\n<tr>\n<td style={{width: '14%'}}><strong>Key Features<\/strong><\/td>\n<td style={{width: '43%'}}>Centralized API gateway with authentication and authorization, multi-tenant cost tracking and spend management per project\/user, per-project customization (logging, guardrails, caching), virtual keys for secure access control, admin dashboard UI for monitoring and management<\/td>\n<td style={{width: '43%'}}>Direct Python library integration in your codebase, Router with retry\/fallback logic across multiple deployments (e.g. Azure\/OpenAI) - <a href=\"https:\/\/docs.litellm.ai\/docs\/routing\">Router<\/a>, application-level load balancing and cost tracking, exception handling with OpenAI-compatible errors, observability callbacks (Lunary, MLflow, Langfuse, etc.)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n\n**Stable Release:** Use docker images with the `-stable` tag. These have undergone 12 hour load tests, before being published. [More information about the release cycle here](https:\/\/docs.litellm.ai\/docs\/proxy\/release_cycle)\n\nSupport for more providers. Missing a provider or LLM Platform, raise a [feature request](https:\/\/github.com\/BerriAI\/litellm\/issues\/new?assignees=&labels=enhancement&projects=&template=feature_request.yml&title=%5BFeature%5D%3A+).\n\n### Deploy on AWS or GCP with Terraform\n\nRun the LiteLLM proxy as a production-ready componentized stack (gateway, backend, UI on separate services; managed Postgres + Redis + object store) using the published Terraform modules. Both modules are on the [public Terraform Registry](https:\/\/registry.terraform.io\/namespaces\/BerriAI) \u2014 no auth needed.\n\n#### AWS \u2014 ECS Fargate + Aurora + ElastiCache + ALB\n\n[![Launch in AWS CloudShell](https:\/\/img.shields.io\/badge\/Launch-AWS_CloudShell-FF9900?logo=amazon-aws&logoColor=white)](https:\/\/console.aws.amazon.com\/cloudshell\/home) \u2014 opens an in-browser shell, already authenticated to your AWS account. Once inside, run:\n\n```bash\ngit clone https:\/\/github.com\/BerriAI\/litellm.git\ncd litellm\/terraform\/litellm\/aws\/examples\/default\ncp terraform.tfvars.example terraform.tfvars   # edit region\/tenant\/env\nterraform init && terraform apply\n```\n\n[Module page \u2192](https:\/\/registry.terraform.io\/modules\/BerriAI\/litellm\/aws\/latest)\n\nOr call the module from your own root config:\n\n```hcl\n# main.tf\nterraform {\n  required_version = \">= 1.6.0\"\n  required_providers {\n    aws = { source = \"hashicorp\/aws\", version = \"~> 5.60\" }\n  }\n}\n\nprovider \"aws\" {\n  region = \"us-west-2\"\n}\n\nmodule \"litellm\" {\n  source  = \"BerriAI\/litellm\/aws\"\n  version = \"~> 1.89\"\n\n  region = \"us-west-2\"\n  azs    = [\"us-west-2a\", \"us-west-2b\"]\n  tenant = \"acme\"\n  env    = \"prod\"\n\n  # Production: provide an ACM cert. Without one, set allow_plaintext_alb = true\n  # (dev\/trial only).\n  # acm_certificate_arn = \"arn:aws:acm:us-west-2:111122223333:certificate\/...\"\n  allow_plaintext_alb = true\n}\n\noutput \"litellm_url\" {\n  value = module.litellm.alb_dns_name\n}\n```\n\n```bash\nterraform init\nterraform apply\n```\n\nProvider API keys live in AWS Secrets Manager; reference ARNs via `gateway_extra_secrets`. Full input list and architecture diagram on the [registry page](https:\/\/registry.terraform.io\/modules\/BerriAI\/litellm\/aws\/latest?tab=inputs).\n\n#### GCP \u2014 Cloud Run + Cloud SQL + Memorystore + HTTPS LB\n\n[![Open in Cloud Shell](https:\/\/gstatic.com\/cloudssh\/images\/open-btn.png)](https:\/\/ssh.cloud.google.com\/cloudshell\/editor?cloudshell_git_repo=https%3A%2F%2Fgithub.com%2FBerriAI%2Flitellm&cloudshell_workspace=terraform%2Flitellm%2Fgcp%2Fexamples%2Fdefault&cloudshell_tutorial=TUTORIAL.md&cloudshell_image=gcr.io\/ds-artifacts-cloudshell\/deploystack_custom_image&shellonly=true)\n\nReal 1-click. Opens Cloud Shell, clones this repo, and walks you through `terraform apply` via a built-in [DeployStack tutorial](.\/terraform\/litellm\/gcp\/examples\/default\/TUTORIAL.md) \u2014 pick the project, the tutorial sets up the Artifact Registry remote repo, writes `terraform.tfvars` from your answers, and runs apply.\n\n[Module page \u2192](https:\/\/registry.terraform.io\/modules\/BerriAI\/litellm\/google\/latest)\n\nTo call the module from your own config instead, Cloud Run can't pull from `ghcr.io` directly, so first set up a one-time Artifact Registry remote repo backed by GHCR:\n\n```bash\ngcloud artifacts repositories create litellm \\\n  --location=us-central1 \\\n  --repository-format=docker \\\n  --mode=remote-repository \\\n  --remote-docker-repo=https:\/\/ghcr.io \\\n  --project=my-gcp-project\n```\n\nThen:\n\n```hcl\n# main.tf\nterraform {\n  required_version = \">= 1.6.0\"\n  required_providers {\n    google      = { source = \"hashicorp\/google\",      version = \"~> 6.10\" }\n    google-beta = { source = \"hashicorp\/google-beta\", version = \"~> 6.10\" }\n  }\n}\n\nprovider \"google\"      { project = \"my-gcp-project\"; region = \"us-central1\" }\nprovider \"google-beta\" { project = \"my-gcp-project\"; region = \"us-central1\" }\n\nmodule \"litellm\" {\n  source  = \"BerriAI\/litellm\/google\"\n  version = \"~> 1.89\"\n\n  project_id = \"my-gcp-project\"\n  region     = \"us-central1\"\n  tenant     = \"acme\"\n  env        = \"prod\"\n\n  # Replace my-gcp-project with your GCP project ID (same value as project_id above).\n  image_registry = \"us-central1-docker.pkg.dev\/my-gcp-project\/litellm\/berriai\"\n\n  # Production: provide DNS already pointing at the LB IP for Google-managed certs.\n  # Without one, set allow_plaintext_lb = true (dev\/trial only).\n  # lb_domains         = [\"proxy.example.com\"]\n  allow_plaintext_lb = true\n}\n\noutput \"litellm_url\" {\n  value = module.litellm.load_balancer_url\n}\n```\n\n```bash\nterraform init\nterraform apply\n```\n\nProvider API keys live in Secret Manager; reference resource IDs (e.g. `projects\/my-gcp-project\/secrets\/openai-api-key`) via `gateway_extra_secrets`. Full input list and architecture diagram on the [registry page](https:\/\/registry.terraform.io\/modules\/BerriAI\/litellm\/google\/latest?tab=inputs).\n\n#### Both stacks include\n\n- The full componentized split (gateway \/ backend \/ UI as independent services)\n- Managed Postgres (writer + reader) and Redis\n- Versioned object store for proxy state + file uploads\n- An auto-generated `LITELLM_MASTER_KEY` in your cloud's secret manager\n- A one-off migration job that runs `prisma migrate deploy` before the proxy starts\n- The same `proxy_config` surface as the [Helm chart](.\/helm\/litellm\/) \u2014 pass YAML as a typed map\n\nThe Terraform modules live at [`terraform\/litellm\/aws\/`](.\/terraform\/litellm\/aws\/) and [`terraform\/litellm\/gcp\/`](.\/terraform\/litellm\/gcp\/) in this repo; the registry entries are read-only mirrors updated on each release.\n\n### Run in Developer Mode\n#### Services\n1. Setup .env file in root\n2. Run dependent services `docker-compose up db prometheus`\n\n#### Backend\n1. (In root) create virtual environment `python -m venv .venv`\n2. Activate virtual environment `source .venv\/bin\/activate`\n3. Install dependencies `uv sync --all-extras --group proxy-dev`\n4. `uv run prisma generate`\n5. `prisma generate`\n6. Start proxy backend `python litellm\/proxy\/proxy_cli.py`\n\n#### Frontend\n1. Navigate to `ui\/litellm-dashboard`\n2. Install dependencies `npm install`\n3. Run `npm run dev` to start the dashboard\n\n### Verify Docker Image Signatures\n\nAll LiteLLM Docker images published to GHCR are signed with [cosign](https:\/\/docs.sigstore.dev\/cosign\/overview\/). Every release is signed with the same key introduced in [commit `0112e53`](https:\/\/github.com\/BerriAI\/litellm\/commit\/0112e53046018d726492c814b3644b7d376029d0).\n\n**Verify using the pinned commit hash (recommended):**\n\nA commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:\n\n```bash\ncosign verify \\\n  --key https:\/\/raw.githubusercontent.com\/BerriAI\/litellm\/0112e53046018d726492c814b3644b7d376029d0\/cosign.pub \\\n  ghcr.io\/berriai\/litellm:<release-tag>\n```\n\n**Verify using a release tag (convenience):**\n\nTags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:\n\n```bash\ncosign verify \\\n  --key https:\/\/raw.githubusercontent.com\/BerriAI\/litellm\/<release-tag>\/cosign.pub \\\n  ghcr.io\/berriai\/litellm:<release-tag>\n```\n\nReplace `<release-tag>` with the version you are deploying (e.g. `v1.83.0-stable`).\n\n---\n\n# Enterprise\nFor companies that need better security, user management and professional support\n\n[Get an Enterprise License](https:\/\/litellm.ai\/enterprise)\n[Talk to founders](https:\/\/enterprise.litellm.ai\/demo)\n\nThis covers:\n- \u2705 **Features under the [LiteLLM Commercial License](https:\/\/docs.litellm.ai\/docs\/proxy\/enterprise):**\n- \u2705 **Feature Prioritization**\n- \u2705 **Custom Integrations**\n- \u2705 **Professional Support - Dedicated discord + slack**\n- \u2705 **Custom SLAs**\n- \u2705 **Secure access with Single Sign-On**\n\n# Contributing\n\nWe welcome contributions to LiteLLM! Whether you're fixing bugs, adding features, or improving documentation, we appreciate your help.\n\n## Quick Start for Contributors\n\nThis requires uv to be installed.\n\n```bash\ngit clone https:\/\/github.com\/BerriAI\/litellm.git\ncd litellm\nmake install-dev    # Install development dependencies\nmake format         # Format your code\nmake lint           # Run all linting checks\nmake test-unit      # Run unit tests\nmake format-check   # Check formatting only\n```\n\nFor detailed contributing guidelines, see [CONTRIBUTING.md](CONTRIBUTING.md).\n\n> **\ud83d\udcd6 Contributing to documentation?** The LiteLLM docs have moved to a separate repository: [BerriAI\/litellm-docs](https:\/\/github.com\/BerriAI\/litellm-docs). Please open doc PRs there. Docs are served at [docs.litellm.ai](https:\/\/docs.litellm.ai).\n\n## Code Quality \/ Linting\n\nLiteLLM follows the [Google Python Style Guide](https:\/\/google.github.io\/styleguide\/pyguide.html).\n\nOur automated checks include:\n- **Black** for code formatting\n- **Ruff** for linting and code quality\n- **MyPy** for type checking\n- **Circular import detection**\n- **Import safety checks**\n\n\nAll these checks must pass before your PR can be merged.\n\n\n# Support \/ talk with founders\n\n- [Schedule Demo \ud83d\udc4b](https:\/\/calendly.com\/d\/4mp-gd3-k5k\/berriai-1-1-onboarding-litellm-hosted-version)\n- [Community Discord \ud83d\udcad](https:\/\/discord.gg\/wuPM9dRgDw)\n- [Community Slack \ud83d\udcad](https:\/\/www.litellm.ai\/support)\n- Our emails \u2709\ufe0f ishaan@berri.ai \/ krrish@berri.ai\n\n# Contributors\n\n<!-- ALL-CONTRIBUTORS-LIST:START - Do not remove or modify this section -->\n<!-- prettier-ignore-start -->\n<!-- markdownlint-disable -->\n\n<!-- markdownlint-restore -->\n<!-- prettier-ignore-end -->\n\n<!-- ALL-CONTRIBUTORS-LIST:END -->\n\n<a href=\"https:\/\/github.com\/BerriAI\/litellm\/graphs\/contributors\">\n  <img src=\"https:\/\/contrib.rocks\/image?repo=BerriAI\/litellm\" \/>\n<\/a>\n\n","description_content_type":"text\/markdown; charset=UTF-8; variant=GFM","docs_url":null,"download_url":null,"downloads":{"last_day":-1,"last_month":-1,"last_week":-1},"dynamic":null,"home_page":null,"keywords":null,"license":null,"license_expression":"MIT","license_files":["LICENSE"],"maintainer":null,"maintainer_email":null,"name":"litellm","package_url":"https:\/\/pypi.org\/project\/litellm\/","platform":null,"project_url":"https:\/\/pypi.org\/project\/litellm\/","project_urls":{"Documentation":"https:\/\/docs.litellm.ai","Homepage":"https:\/\/litellm.ai","Repository":"https:\/\/github.com\/BerriAI\/litellm"},"provides_extra":["proxy","cli","extra-proxy","utils","caching","semantic-router","mlflow","grpc","stt-nvidia-riva","google","proxy-runtime"],"release_url":"https:\/\/pypi.org\/project\/litellm\/1.93.2\/","requires_dist":["fastuuid<1.0,>=0.14.0","httpx<1.0,>=0.28.0","openai<3.0.0,>=2.20.0","python-dotenv<2.0,>=1.0.0","tiktoken<1.0,>=0.8.0","importlib-metadata<9.0,>=8.0.0","tokenizers<1.0,>=0.21.0","click<9.0,>=8.0.0","jinja2<4.0,>=3.1.6","aiohttp<4.0,>=3.14.2","pydantic<3.0.0,>=2.10.0","jsonschema<5.0,>=4.0.0","gunicorn<24.0,>=23.0.0; extra == \"proxy\"","uvicorn<1.0,>=0.33.0; extra == \"proxy\"","granian<3.0,>=2.7.4; extra == \"proxy\"","uvloop<1.0,>=0.21.0; sys_platform != \"win32\" and extra == \"proxy\"","fastapi<1.0,>=0.136.3; extra == \"proxy\"","starlette<2.0,>=1.0.1; extra == \"proxy\"","backoff<3.0,>=2.2.1; extra == \"proxy\"","pyyaml<7.0,>=6.0.3; extra == \"proxy\"","rq<3.0,>=2.7.0; extra == \"proxy\"","orjson<4.0,>=3.11.6; extra == \"proxy\"","apscheduler<4.0,>=3.11.2; extra == \"proxy\"","fastapi-sso<1.0,>=0.19.0; extra == \"proxy\"","pyjwt<3.0,>=2.13.0; extra == \"proxy\"","python-multipart<1.0,>=0.0.27; extra == \"proxy\"","cryptography<51.0,>=49.0.0; extra == \"proxy\"","pynacl<2.0,>=1.6.2; extra == \"proxy\"","websockets<16.0,>=15.0.1; extra == \"proxy\"","boto3<2.0,>=1.43.1; extra == \"proxy\"","azure-identity<2.0,>=1.25.2; extra == \"proxy\"","azure-storage-blob<13.0,>=12.28.0; extra == \"proxy\"","mcp<2.0,>=1.28.1; extra == \"proxy\"","litellm-proxy-extras==0.4.76; extra == \"proxy\"","litellm-enterprise==0.1.49; extra == \"proxy\"","restrictedpython<9.0,>=8.1; extra == \"proxy\"","rich<14.0,>=13.9.4; extra == \"proxy\"","polars<2.0,>=1.38.1; extra == \"proxy\"","soundfile<1.0,>=0.12.1; extra == \"proxy\"","pyroscope-io<1.0,>=0.8.16; sys_platform != \"win32\" and extra == \"proxy\"","pydantic-settings<3.0,>=2.14.1; extra == \"proxy\"","expression<6.0,>=5.6.0; extra == \"proxy\"","rich<14.0,>=13.9.4; extra == \"cli\"","pyyaml<7.0,>=6.0.3; extra == \"cli\"","requests<3.0,>=2.32.0; extra == \"cli\"","prisma<1.0,>=0.11.0; extra == \"extra-proxy\"","azure-identity<2.0,>=1.25.2; extra == \"extra-proxy\"","azure-keyvault-secrets<5.0,>=4.10.0; extra == \"extra-proxy\"","google-cloud-kms<3.0,>=2.24.2; extra == \"extra-proxy\"","google-cloud-iam<3.0,>=2.19.1; extra == \"extra-proxy\"","resend<3.0,>=2.23.0; extra == \"extra-proxy\"","redisvl<1.0,>=0.4.1; extra == \"extra-proxy\"","a2a-sdk<2.0,>=1.1.0; extra == \"extra-proxy\"","numpydoc<2.0,>=1.8.0; extra == \"utils\"","diskcache<6.0,>=5.6.3; extra == \"caching\"","semantic-router<1.0,>=0.1.15; python_full_version < \"3.14\" and extra == \"semantic-router\"","aurelio-sdk<1.0,>=0.0.19; python_full_version < \"3.14\" and extra == \"semantic-router\"","mlflow<4.0,>=3.11.1; extra == \"mlflow\"","grpcio==1.78.0; extra == \"grpc\"","nvidia-riva-client>=2.15.0; extra == \"stt-nvidia-riva\"","soundfile>=0.12.1; extra == \"stt-nvidia-riva\"","audioread>=3.0.1; extra == \"stt-nvidia-riva\"","numpy>=1.26.0; extra == \"stt-nvidia-riva\"","google-cloud-aiplatform<2.0,>=1.133.0; extra == \"google\"","google-cloud-aiplatform<2.0,>=1.133.0; extra == \"proxy-runtime\"","google-genai<2.0,>=1.37.0; extra == \"proxy-runtime\"","anthropic[vertex]<1.0,>=0.84.0; extra == \"proxy-runtime\"","grpcio==1.78.0; extra == \"proxy-runtime\"","prometheus-client<1.0,>=0.20.0; extra == \"proxy-runtime\"","langfuse<3.0,>=2.59.7; extra == \"proxy-runtime\"","opentelemetry-api==1.28.0; extra == \"proxy-runtime\"","opentelemetry-sdk==1.28.0; extra == \"proxy-runtime\"","opentelemetry-exporter-otlp==1.28.0; extra == \"proxy-runtime\"","opentelemetry-instrumentation-fastapi==0.49b0; extra == \"proxy-runtime\"","ddtrace<5.0,>=4.8.2; extra == \"proxy-runtime\"","sentry-sdk<3.0,>=2.21.0; extra == \"proxy-runtime\"","mangum<1.0,>=0.17.0; extra == \"proxy-runtime\"","azure-ai-contentsafety<2.0,>=1.0.0; extra == \"proxy-runtime\"","azure-storage-file-datalake<13.0,>=12.20.0; extra == \"proxy-runtime\"","pypdf<7.0,>=6.12.0; extra == \"proxy-runtime\"","llm-sandbox<1.0,>=0.3.39; extra == \"proxy-runtime\"","detect-secrets<2.0,>=1.5.0; extra == \"proxy-runtime\""],"requires_python":"<3.15,>=3.10","summary":"Library to easily interface with LLM API providers","version":"1.93.2","yanked":false,"yanked_reason":null},"last_serial":43866990,"ownership":{"organization":"LiteLLM","roles":[]},"urls":[{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"88089506771ea0a3433e683b6ad6f874cd91ede91485044f1d258e66c9266ff8","md5":"7bbfba8f640d6901ca2c54a44bd7dcf6","sha256":"f34309706eb90960d67b05872a3b8314563b81b193b909eaab9d133b82a203fb"},"downloads":-1,"filename":"litellm-1.93.2-cp310-cp310-macosx_10_12_x86_64.whl","has_sig":false,"md5_digest":"7bbfba8f640d6901ca2c54a44bd7dcf6","packagetype":"bdist_wheel","python_version":"cp310","requires_python":"<3.15,>=3.10","size":19937087,"upload_time":"2026-08-09T02:16:21","upload_time_iso_8601":"2026-08-09T02:16:21.033158Z","url":"https:\/\/files.pythonhosted.org\/packages\/88\/08\/9506771ea0a3433e683b6ad6f874cd91ede91485044f1d258e66c9266ff8\/litellm-1.93.2-cp310-cp310-macosx_10_12_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"1aadc981a75ec07140221c6645c47414598456b65f3c650f1a77b4a796524161","md5":"601ff0e443e7fd87f67fffa5b999470d","sha256":"d230bbb7818ebad79da838f1b343c36666cb800e0aa80ca95c9ef4c8494278e4"},"downloads":-1,"filename":"litellm-1.93.2-cp310-cp310-macosx_11_0_arm64.whl","has_sig":false,"md5_digest":"601ff0e443e7fd87f67fffa5b999470d","packagetype":"bdist_wheel","python_version":"cp310","requires_python":"<3.15,>=3.10","size":19862987,"upload_time":"2026-08-09T02:16:23","upload_time_iso_8601":"2026-08-09T02:16:23.758173Z","url":"https:\/\/files.pythonhosted.org\/packages\/1a\/ad\/c981a75ec07140221c6645c47414598456b65f3c650f1a77b4a796524161\/litellm-1.93.2-cp310-cp310-macosx_11_0_arm64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"42a796488b36428f2aa166ee571927c1608f7df591c198f46021db568da59f8e","md5":"d1a6a7b8308f097b866318da3953a1e3","sha256":"f8740072e67ca25d4cb2c59e2d1fc49f1d064952c05db175c84eb1e496e9cb85"},"downloads":-1,"filename":"litellm-1.93.2-cp310-cp310-manylinux_2_28_aarch64.whl","has_sig":false,"md5_digest":"d1a6a7b8308f097b866318da3953a1e3","packagetype":"bdist_wheel","python_version":"cp310","requires_python":"<3.15,>=3.10","size":20169541,"upload_time":"2026-08-09T02:16:26","upload_time_iso_8601":"2026-08-09T02:16:26.250129Z","url":"https:\/\/files.pythonhosted.org\/packages\/42\/a7\/96488b36428f2aa166ee571927c1608f7df591c198f46021db568da59f8e\/litellm-1.93.2-cp310-cp310-manylinux_2_28_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"c53691126e7e529ee369288d886116fb3d0b6685b64d26a3948629b8f18de059","md5":"e13e3153150d80603a0b744f7564e0da","sha256":"78fc2df99e32d9762eee6755a11ad98d405a9f8154994afd841b256d2a7086e4"},"downloads":-1,"filename":"litellm-1.93.2-cp310-cp310-manylinux_2_28_x86_64.whl","has_sig":false,"md5_digest":"e13e3153150d80603a0b744f7564e0da","packagetype":"bdist_wheel","python_version":"cp310","requires_python":"<3.15,>=3.10","size":20162865,"upload_time":"2026-08-09T02:16:28","upload_time_iso_8601":"2026-08-09T02:16:28.661719Z","url":"https:\/\/files.pythonhosted.org\/packages\/c5\/36\/91126e7e529ee369288d886116fb3d0b6685b64d26a3948629b8f18de059\/litellm-1.93.2-cp310-cp310-manylinux_2_28_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"b8082ba7298d9d61abf5585c679c9f69a237ac4a7ba69965d86982d2023aab68","md5":"21ce79293dad9203cae0d1ea7e85c3a9","sha256":"248ac86bbb03be2a94690e8f31c3de4adf2367f351d1fd1ae43903237cfa365d"},"downloads":-1,"filename":"litellm-1.93.2-cp310-cp310-musllinux_1_2_aarch64.whl","has_sig":false,"md5_digest":"21ce79293dad9203cae0d1ea7e85c3a9","packagetype":"bdist_wheel","python_version":"cp310","requires_python":"<3.15,>=3.10","size":20234315,"upload_time":"2026-08-09T02:16:31","upload_time_iso_8601":"2026-08-09T02:16:31.044825Z","url":"https:\/\/files.pythonhosted.org\/packages\/b8\/08\/2ba7298d9d61abf5585c679c9f69a237ac4a7ba69965d86982d2023aab68\/litellm-1.93.2-cp310-cp310-musllinux_1_2_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"6de91c7045cbd4d04eaa53fb07e4b7b8b903d77f49a518a2aebbaf18433b9543","md5":"482e525ec8b0551901ab76205c988127","sha256":"67e152a87185b47698f4c240290352cbdd18fdcd4285dc8f76f2f79d8186ca9c"},"downloads":-1,"filename":"litellm-1.93.2-cp310-cp310-musllinux_1_2_x86_64.whl","has_sig":false,"md5_digest":"482e525ec8b0551901ab76205c988127","packagetype":"bdist_wheel","python_version":"cp310","requires_python":"<3.15,>=3.10","size":20291455,"upload_time":"2026-08-09T02:16:33","upload_time_iso_8601":"2026-08-09T02:16:33.337958Z","url":"https:\/\/files.pythonhosted.org\/packages\/6d\/e9\/1c7045cbd4d04eaa53fb07e4b7b8b903d77f49a518a2aebbaf18433b9543\/litellm-1.93.2-cp310-cp310-musllinux_1_2_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"5a9a18bc5f2ebbe265d32046c4571c0fb173df595dee9379607866a3b90f7ddc"},"digests":{"blake2b_256":"a0c3f6297826575f2d8dce2b55e6865b015f227c2540e3b1dd94c688e08d57a1","md5":"7d8d198edd343ea387c2ae497e5fb9bf","sha256":"f556aa24817052689989e254863bfc50b48e5500999005fce92e6c2d16548f87"},"downloads":-1,"filename":"litellm-1.93.2-cp310-cp310-win_amd64.whl","has_sig":false,"md5_digest":"7d8d198edd343ea387c2ae497e5fb9bf","packagetype":"bdist_wheel","python_version":"cp310","requires_python":"<3.15,>=3.10","size":19775603,"upload_time":"2026-08-09T02:16:35","upload_time_iso_8601":"2026-08-09T02:16:35.606567Z","url":"https:\/\/files.pythonhosted.org\/packages\/a0\/c3\/f6297826575f2d8dce2b55e6865b015f227c2540e3b1dd94c688e08d57a1\/litellm-1.93.2-cp310-cp310-win_amd64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"64c7cb3f49dc60d57dda7fe368310fd5da2a94ec9b6a746bcf343a61e10bdeda","md5":"fbf322c094916062088cf9597b4f0ad9","sha256":"1bd0690efc94357e559de97927fd98437555cd5b5dd832544cfcca87297ccb80"},"downloads":-1,"filename":"litellm-1.93.2-cp311-cp311-macosx_10_12_x86_64.whl","has_sig":false,"md5_digest":"fbf322c094916062088cf9597b4f0ad9","packagetype":"bdist_wheel","python_version":"cp311","requires_python":"<3.15,>=3.10","size":19938326,"upload_time":"2026-08-09T02:16:38","upload_time_iso_8601":"2026-08-09T02:16:38.041381Z","url":"https:\/\/files.pythonhosted.org\/packages\/64\/c7\/cb3f49dc60d57dda7fe368310fd5da2a94ec9b6a746bcf343a61e10bdeda\/litellm-1.93.2-cp311-cp311-macosx_10_12_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"0cbdd77184fdaaf57d67d65da91dcfc61c7f656703e7ce4f950e07523e7de4e3","md5":"e89d0765c4694932fbe712701640d758","sha256":"845ececc628737909b1422d1af18bd19ae453727a66244aa9da3ca37a3773111"},"downloads":-1,"filename":"litellm-1.93.2-cp311-cp311-macosx_11_0_arm64.whl","has_sig":false,"md5_digest":"e89d0765c4694932fbe712701640d758","packagetype":"bdist_wheel","python_version":"cp311","requires_python":"<3.15,>=3.10","size":19862606,"upload_time":"2026-08-09T02:16:40","upload_time_iso_8601":"2026-08-09T02:16:40.653599Z","url":"https:\/\/files.pythonhosted.org\/packages\/0c\/bd\/d77184fdaaf57d67d65da91dcfc61c7f656703e7ce4f950e07523e7de4e3\/litellm-1.93.2-cp311-cp311-macosx_11_0_arm64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"5399d8dd58b6840754a13cc2e1111b283aa28cbfc0ccc653a8725050916bb08e","md5":"aa91821144a606ac59fe31dc21045a0f","sha256":"498f9878ea773305e0638b6159d7e1ef27bb0b9a4292538d6634312d18a4e781"},"downloads":-1,"filename":"litellm-1.93.2-cp311-cp311-manylinux_2_28_aarch64.whl","has_sig":false,"md5_digest":"aa91821144a606ac59fe31dc21045a0f","packagetype":"bdist_wheel","python_version":"cp311","requires_python":"<3.15,>=3.10","size":20168532,"upload_time":"2026-08-09T02:16:42","upload_time_iso_8601":"2026-08-09T02:16:42.997300Z","url":"https:\/\/files.pythonhosted.org\/packages\/53\/99\/d8dd58b6840754a13cc2e1111b283aa28cbfc0ccc653a8725050916bb08e\/litellm-1.93.2-cp311-cp311-manylinux_2_28_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"d7ca559ca0f5e0b99b9f641086ae924c782f8d521d09384fbe9abbe0bddb6e61","md5":"c02cf179aec2bfb2aa0dddd4296fddc0","sha256":"1e5618ef495b2e02299b376ca84ffb2647837aafee478cf3a1be17d47a8f0f73"},"downloads":-1,"filename":"litellm-1.93.2-cp311-cp311-manylinux_2_28_x86_64.whl","has_sig":false,"md5_digest":"c02cf179aec2bfb2aa0dddd4296fddc0","packagetype":"bdist_wheel","python_version":"cp311","requires_python":"<3.15,>=3.10","size":20162696,"upload_time":"2026-08-09T02:16:45","upload_time_iso_8601":"2026-08-09T02:16:45.283099Z","url":"https:\/\/files.pythonhosted.org\/packages\/d7\/ca\/559ca0f5e0b99b9f641086ae924c782f8d521d09384fbe9abbe0bddb6e61\/litellm-1.93.2-cp311-cp311-manylinux_2_28_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"923e18c31b27c7d1271b43bdc8ffbef01bfba68d90248bbe60bb2130dd17e43c","md5":"db88482db2bf980b56faaf0409d700c4","sha256":"c2da463d70c9fffbea9532fd000e035328f5266b399a2fb4c6c76b3470478337"},"downloads":-1,"filename":"litellm-1.93.2-cp311-cp311-musllinux_1_2_aarch64.whl","has_sig":false,"md5_digest":"db88482db2bf980b56faaf0409d700c4","packagetype":"bdist_wheel","python_version":"cp311","requires_python":"<3.15,>=3.10","size":20233518,"upload_time":"2026-08-09T02:16:47","upload_time_iso_8601":"2026-08-09T02:16:47.870158Z","url":"https:\/\/files.pythonhosted.org\/packages\/92\/3e\/18c31b27c7d1271b43bdc8ffbef01bfba68d90248bbe60bb2130dd17e43c\/litellm-1.93.2-cp311-cp311-musllinux_1_2_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"d998a6bae7c52f09cd03487a040f98eeedb899b3cf3fc541b87c6d051ee92e0d","md5":"2db906c5178ab320f514f0b1b47154c8","sha256":"2cf122399f84f8f04621ed6ef8f276dd6d61f4fab108932ce0e30368de34dd42"},"downloads":-1,"filename":"litellm-1.93.2-cp311-cp311-musllinux_1_2_x86_64.whl","has_sig":false,"md5_digest":"2db906c5178ab320f514f0b1b47154c8","packagetype":"bdist_wheel","python_version":"cp311","requires_python":"<3.15,>=3.10","size":20291180,"upload_time":"2026-08-09T02:16:50","upload_time_iso_8601":"2026-08-09T02:16:50.549538Z","url":"https:\/\/files.pythonhosted.org\/packages\/d9\/98\/a6bae7c52f09cd03487a040f98eeedb899b3cf3fc541b87c6d051ee92e0d\/litellm-1.93.2-cp311-cp311-musllinux_1_2_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"5a9a18bc5f2ebbe265d32046c4571c0fb173df595dee9379607866a3b90f7ddc"},"digests":{"blake2b_256":"772d81d974f2533cf039afda7e3e0f769dc73dc692c75ec867cf29ec6f41c06f","md5":"6fe2354ea14abf53fed3dfb95931eb70","sha256":"8eaaf780fab9a19234735ef94225172179d15bc28b67ddbec125194249a504b7"},"downloads":-1,"filename":"litellm-1.93.2-cp311-cp311-win_amd64.whl","has_sig":false,"md5_digest":"6fe2354ea14abf53fed3dfb95931eb70","packagetype":"bdist_wheel","python_version":"cp311","requires_python":"<3.15,>=3.10","size":19775654,"upload_time":"2026-08-09T02:16:53","upload_time_iso_8601":"2026-08-09T02:16:53.162571Z","url":"https:\/\/files.pythonhosted.org\/packages\/77\/2d\/81d974f2533cf039afda7e3e0f769dc73dc692c75ec867cf29ec6f41c06f\/litellm-1.93.2-cp311-cp311-win_amd64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"d00572fd8051f0f2f3c84b90986e6f4551db7c8b190ba3300f111461b7701689","md5":"9b46bd3680c96af679af4d154ff309ef","sha256":"3bf532c164ad7cb1b76f2c62afefdcc656b9b296374d075a4150e2ce10bb74c3"},"downloads":-1,"filename":"litellm-1.93.2-cp312-cp312-macosx_10_12_x86_64.whl","has_sig":false,"md5_digest":"9b46bd3680c96af679af4d154ff309ef","packagetype":"bdist_wheel","python_version":"cp312","requires_python":"<3.15,>=3.10","size":19937403,"upload_time":"2026-08-09T02:16:55","upload_time_iso_8601":"2026-08-09T02:16:55.545389Z","url":"https:\/\/files.pythonhosted.org\/packages\/d0\/05\/72fd8051f0f2f3c84b90986e6f4551db7c8b190ba3300f111461b7701689\/litellm-1.93.2-cp312-cp312-macosx_10_12_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"9e4d5081b39bdb73cab04f8a86294a4534a029cf0434ac6932c7ae8049d55723","md5":"e2a62420d3ed3a8f7d53fe04b60f6dfe","sha256":"526b7afc037f79dfdd5c607f5085ac597c7fd301a6dedabea40baae899b27f19"},"downloads":-1,"filename":"litellm-1.93.2-cp312-cp312-macosx_11_0_arm64.whl","has_sig":false,"md5_digest":"e2a62420d3ed3a8f7d53fe04b60f6dfe","packagetype":"bdist_wheel","python_version":"cp312","requires_python":"<3.15,>=3.10","size":19853652,"upload_time":"2026-08-09T02:16:57","upload_time_iso_8601":"2026-08-09T02:16:57.977231Z","url":"https:\/\/files.pythonhosted.org\/packages\/9e\/4d\/5081b39bdb73cab04f8a86294a4534a029cf0434ac6932c7ae8049d55723\/litellm-1.93.2-cp312-cp312-macosx_11_0_arm64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"703ffb70691266a7fd08c202406abea0153e82fa17f134cd9d58e4029cc741db","md5":"82b20bbdcc0d12d85720faebefee70e2","sha256":"294ad19f356f821ce97a5428d09439be5f38d22b218c73008d8a49e3e42eb145"},"downloads":-1,"filename":"litellm-1.93.2-cp312-cp312-manylinux_2_28_aarch64.whl","has_sig":false,"md5_digest":"82b20bbdcc0d12d85720faebefee70e2","packagetype":"bdist_wheel","python_version":"cp312","requires_python":"<3.15,>=3.10","size":20165680,"upload_time":"2026-08-09T02:17:00","upload_time_iso_8601":"2026-08-09T02:17:00.650119Z","url":"https:\/\/files.pythonhosted.org\/packages\/70\/3f\/fb70691266a7fd08c202406abea0153e82fa17f134cd9d58e4029cc741db\/litellm-1.93.2-cp312-cp312-manylinux_2_28_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"819184424ce2a25595463e5d24e9cf8949877cd4ce93c0fcbf6486ecd685094f","md5":"241477c2810386a4020cc69045f3c87a","sha256":"6f6a5e3907f0a1c9d8ff8d71a6cbac8a592e47a40da3f97167074947b5ba7d11"},"downloads":-1,"filename":"litellm-1.93.2-cp312-cp312-manylinux_2_28_x86_64.whl","has_sig":false,"md5_digest":"241477c2810386a4020cc69045f3c87a","packagetype":"bdist_wheel","python_version":"cp312","requires_python":"<3.15,>=3.10","size":20157772,"upload_time":"2026-08-09T02:17:03","upload_time_iso_8601":"2026-08-09T02:17:03.027327Z","url":"https:\/\/files.pythonhosted.org\/packages\/81\/91\/84424ce2a25595463e5d24e9cf8949877cd4ce93c0fcbf6486ecd685094f\/litellm-1.93.2-cp312-cp312-manylinux_2_28_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"8f8db0eac7ee6d174564f820565c8c9a726ae83dbb8c4d3522daf175b95da002","md5":"9ebdf1ede5a92f3698d16c8bd5608409","sha256":"8541f1b7fd5c437ad249ad68d0a11f68e5e2866b0649da5fa7d63b595e9b8b22"},"downloads":-1,"filename":"litellm-1.93.2-cp312-cp312-musllinux_1_2_aarch64.whl","has_sig":false,"md5_digest":"9ebdf1ede5a92f3698d16c8bd5608409","packagetype":"bdist_wheel","python_version":"cp312","requires_python":"<3.15,>=3.10","size":20229256,"upload_time":"2026-08-09T02:17:05","upload_time_iso_8601":"2026-08-09T02:17:05.271213Z","url":"https:\/\/files.pythonhosted.org\/packages\/8f\/8d\/b0eac7ee6d174564f820565c8c9a726ae83dbb8c4d3522daf175b95da002\/litellm-1.93.2-cp312-cp312-musllinux_1_2_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"ee6d03e931c1cb2d1e1b7a968de21aa9e4db853928200da856c35c940ee6faa9","md5":"48e1f799e2cd425ac44fd35172f0c036","sha256":"712c9387419d7b06a10df59973f5e530592d61b2314102b0fa3142f3743f9a9e"},"downloads":-1,"filename":"litellm-1.93.2-cp312-cp312-musllinux_1_2_x86_64.whl","has_sig":false,"md5_digest":"48e1f799e2cd425ac44fd35172f0c036","packagetype":"bdist_wheel","python_version":"cp312","requires_python":"<3.15,>=3.10","size":20287257,"upload_time":"2026-08-09T02:17:08","upload_time_iso_8601":"2026-08-09T02:17:08.175098Z","url":"https:\/\/files.pythonhosted.org\/packages\/ee\/6d\/03e931c1cb2d1e1b7a968de21aa9e4db853928200da856c35c940ee6faa9\/litellm-1.93.2-cp312-cp312-musllinux_1_2_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"5a9a18bc5f2ebbe265d32046c4571c0fb173df595dee9379607866a3b90f7ddc"},"digests":{"blake2b_256":"16056c0fe2fcf31c260474c55fabe4ecb0e9e1343c9b9132e28589391b2ad33e","md5":"d1bd69b4e0259fe6edde546b0a9db13c","sha256":"cc0d58ccabd22ef7ef44a9e6f7247deb54ae42f5e126e6f00360c2b28b41bc2b"},"downloads":-1,"filename":"litellm-1.93.2-cp312-cp312-win_amd64.whl","has_sig":false,"md5_digest":"d1bd69b4e0259fe6edde546b0a9db13c","packagetype":"bdist_wheel","python_version":"cp312","requires_python":"<3.15,>=3.10","size":19772580,"upload_time":"2026-08-09T02:17:11","upload_time_iso_8601":"2026-08-09T02:17:11.254552Z","url":"https:\/\/files.pythonhosted.org\/packages\/16\/05\/6c0fe2fcf31c260474c55fabe4ecb0e9e1343c9b9132e28589391b2ad33e\/litellm-1.93.2-cp312-cp312-win_amd64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"7074e9046cffa69b32b710452480598e418b26a29896ece680c80ec23997fd16","md5":"30e7247897010e9d7317015ccaf3266e","sha256":"f4071bef03e4c2942cd2ddc752727345b85447d6a7fee1ff5a4f8b92187966b0"},"downloads":-1,"filename":"litellm-1.93.2-cp313-cp313-macosx_10_12_x86_64.whl","has_sig":false,"md5_digest":"30e7247897010e9d7317015ccaf3266e","packagetype":"bdist_wheel","python_version":"cp313","requires_python":"<3.15,>=3.10","size":19938095,"upload_time":"2026-08-09T02:17:13","upload_time_iso_8601":"2026-08-09T02:17:13.929404Z","url":"https:\/\/files.pythonhosted.org\/packages\/70\/74\/e9046cffa69b32b710452480598e418b26a29896ece680c80ec23997fd16\/litellm-1.93.2-cp313-cp313-macosx_10_12_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"fadb6ef38a7a2f73d5cc507423954fa535a8546ead375c4c71265c093bdb4e9e","md5":"4ff01add5f461b0d17c1a5f6fe9de10a","sha256":"8a99ac7c0c1b78acd6bfd1959e9f203dca71fdbceb5f0c8691c2ad8eee450d7d"},"downloads":-1,"filename":"litellm-1.93.2-cp313-cp313-macosx_11_0_arm64.whl","has_sig":false,"md5_digest":"4ff01add5f461b0d17c1a5f6fe9de10a","packagetype":"bdist_wheel","python_version":"cp313","requires_python":"<3.15,>=3.10","size":19854187,"upload_time":"2026-08-09T02:17:16","upload_time_iso_8601":"2026-08-09T02:17:16.588601Z","url":"https:\/\/files.pythonhosted.org\/packages\/fa\/db\/6ef38a7a2f73d5cc507423954fa535a8546ead375c4c71265c093bdb4e9e\/litellm-1.93.2-cp313-cp313-macosx_11_0_arm64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"cbb380ee0143b88e2921f8c8f24c7331478258a8bf25a3d4d4450bd96043403e","md5":"3cdfdedaa3d0b0683ebc867c175ebd23","sha256":"a81ceff44c58ef504ab8bd787d03b82618765b9cfd530942386ae6d23c58be94"},"downloads":-1,"filename":"litellm-1.93.2-cp313-cp313-manylinux_2_28_aarch64.whl","has_sig":false,"md5_digest":"3cdfdedaa3d0b0683ebc867c175ebd23","packagetype":"bdist_wheel","python_version":"cp313","requires_python":"<3.15,>=3.10","size":20166307,"upload_time":"2026-08-09T02:17:19","upload_time_iso_8601":"2026-08-09T02:17:19.078424Z","url":"https:\/\/files.pythonhosted.org\/packages\/cb\/b3\/80ee0143b88e2921f8c8f24c7331478258a8bf25a3d4d4450bd96043403e\/litellm-1.93.2-cp313-cp313-manylinux_2_28_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"9860cb326e1094f7042f28f9e21543d9f367a8aa25af6915bf4253b77da5c2a2","md5":"c0205525e306d7f6172f0fb5ef0b6899","sha256":"dee1b02b7f52a5a408bf7c8d499f0834e49194651743758a511dcdd926c0b692"},"downloads":-1,"filename":"litellm-1.93.2-cp313-cp313-manylinux_2_28_x86_64.whl","has_sig":false,"md5_digest":"c0205525e306d7f6172f0fb5ef0b6899","packagetype":"bdist_wheel","python_version":"cp313","requires_python":"<3.15,>=3.10","size":20158336,"upload_time":"2026-08-09T02:17:21","upload_time_iso_8601":"2026-08-09T02:17:21.507108Z","url":"https:\/\/files.pythonhosted.org\/packages\/98\/60\/cb326e1094f7042f28f9e21543d9f367a8aa25af6915bf4253b77da5c2a2\/litellm-1.93.2-cp313-cp313-manylinux_2_28_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"b187bad75146863531172c9dbae189486c7f4425b56a6641b55ab20745316048","md5":"b808a8fb310e75d75fb10279072cc0f4","sha256":"d2edfa14b99bce706b35981703692e3ee631f9b87bf6dc28fb53b574f6480b20"},"downloads":-1,"filename":"litellm-1.93.2-cp313-cp313-musllinux_1_2_aarch64.whl","has_sig":false,"md5_digest":"b808a8fb310e75d75fb10279072cc0f4","packagetype":"bdist_wheel","python_version":"cp313","requires_python":"<3.15,>=3.10","size":20229711,"upload_time":"2026-08-09T02:17:24","upload_time_iso_8601":"2026-08-09T02:17:24.073434Z","url":"https:\/\/files.pythonhosted.org\/packages\/b1\/87\/bad75146863531172c9dbae189486c7f4425b56a6641b55ab20745316048\/litellm-1.93.2-cp313-cp313-musllinux_1_2_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"df28040b1853021ed8fd57be19eb2affb024d168951fe7e7abdbad91da3f6f3f","md5":"b559a2f8b5ddfae68b4172fbc89f6cf6","sha256":"ae75a61c9abc827aa3131b7e640c952367a450830bb7c531b426b4ec2bb45f85"},"downloads":-1,"filename":"litellm-1.93.2-cp313-cp313-musllinux_1_2_x86_64.whl","has_sig":false,"md5_digest":"b559a2f8b5ddfae68b4172fbc89f6cf6","packagetype":"bdist_wheel","python_version":"cp313","requires_python":"<3.15,>=3.10","size":20287584,"upload_time":"2026-08-09T02:17:26","upload_time_iso_8601":"2026-08-09T02:17:26.542579Z","url":"https:\/\/files.pythonhosted.org\/packages\/df\/28\/040b1853021ed8fd57be19eb2affb024d168951fe7e7abdbad91da3f6f3f\/litellm-1.93.2-cp313-cp313-musllinux_1_2_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"5a9a18bc5f2ebbe265d32046c4571c0fb173df595dee9379607866a3b90f7ddc"},"digests":{"blake2b_256":"d90b4208815b0d666636cbf7afbd571eec3004d3a15d3150a23a9009fc2ce930","md5":"40ff86bc4909c19b714d7ae93982eac3","sha256":"c54a09ab20f94120a9d60a30d9970439dcefa00d2565d190505ff006a80c7a69"},"downloads":-1,"filename":"litellm-1.93.2-cp313-cp313-win_amd64.whl","has_sig":false,"md5_digest":"40ff86bc4909c19b714d7ae93982eac3","packagetype":"bdist_wheel","python_version":"cp313","requires_python":"<3.15,>=3.10","size":19772641,"upload_time":"2026-08-09T02:17:29","upload_time_iso_8601":"2026-08-09T02:17:29.308221Z","url":"https:\/\/files.pythonhosted.org\/packages\/d9\/0b\/4208815b0d666636cbf7afbd571eec3004d3a15d3150a23a9009fc2ce930\/litellm-1.93.2-cp313-cp313-win_amd64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"094aff7a9c000519d2bab362318bf744a24c2500228e5fceaa6ac23acab96fa0","md5":"bad2ea50daab785dd9f4d38db822e62f","sha256":"204cb0763fff9285bc87eb2dc0fc59b591999e5d94863d0964f806424d3c0cd6"},"downloads":-1,"filename":"litellm-1.93.2-cp314-cp314-macosx_10_12_x86_64.whl","has_sig":false,"md5_digest":"bad2ea50daab785dd9f4d38db822e62f","packagetype":"bdist_wheel","python_version":"cp314","requires_python":"<3.15,>=3.10","size":19943639,"upload_time":"2026-08-09T02:17:31","upload_time_iso_8601":"2026-08-09T02:17:31.811830Z","url":"https:\/\/files.pythonhosted.org\/packages\/09\/4a\/ff7a9c000519d2bab362318bf744a24c2500228e5fceaa6ac23acab96fa0\/litellm-1.93.2-cp314-cp314-macosx_10_12_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"c42629e9276ce4aa8ed133d9fd5ecc07375017d2228215547c6bbb17ccbc59b4","md5":"c5ce54297fc24dec4bf9a31102ba6acb","sha256":"3126c84361606b9fb07fde7d57eccd8a1747304d64c4143e2e5e40ae6e7693fb"},"downloads":-1,"filename":"litellm-1.93.2-cp314-cp314-macosx_11_0_arm64.whl","has_sig":false,"md5_digest":"c5ce54297fc24dec4bf9a31102ba6acb","packagetype":"bdist_wheel","python_version":"cp314","requires_python":"<3.15,>=3.10","size":19855435,"upload_time":"2026-08-09T02:17:34","upload_time_iso_8601":"2026-08-09T02:17:34.376822Z","url":"https:\/\/files.pythonhosted.org\/packages\/c4\/26\/29e9276ce4aa8ed133d9fd5ecc07375017d2228215547c6bbb17ccbc59b4\/litellm-1.93.2-cp314-cp314-macosx_11_0_arm64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"f8202c9c818248ae019b2d496ca41900a9a5651ab05e2400794cd8dc8b89b6d2","md5":"cbe75779074daaff1d34e8614d2650b0","sha256":"1c84f7c4acb4e926a79b93145ab23231b300fc687bde7172ef884fc52d6011e0"},"downloads":-1,"filename":"litellm-1.93.2-cp314-cp314-manylinux_2_28_aarch64.whl","has_sig":false,"md5_digest":"cbe75779074daaff1d34e8614d2650b0","packagetype":"bdist_wheel","python_version":"cp314","requires_python":"<3.15,>=3.10","size":20166947,"upload_time":"2026-08-09T02:17:36","upload_time_iso_8601":"2026-08-09T02:17:36.828901Z","url":"https:\/\/files.pythonhosted.org\/packages\/f8\/20\/2c9c818248ae019b2d496ca41900a9a5651ab05e2400794cd8dc8b89b6d2\/litellm-1.93.2-cp314-cp314-manylinux_2_28_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"50af4016682be48350407837941ad1a1ae8185cca65b102e04e89eee2a2abccb","md5":"87d9f4fcd16278a8c73d0f8ae96bac9e","sha256":"cacf35cf703b12c54516fc6464a3e08c6dbb1dcfb97239e1f629294fe36a1cba"},"downloads":-1,"filename":"litellm-1.93.2-cp314-cp314-manylinux_2_28_x86_64.whl","has_sig":false,"md5_digest":"87d9f4fcd16278a8c73d0f8ae96bac9e","packagetype":"bdist_wheel","python_version":"cp314","requires_python":"<3.15,>=3.10","size":20160055,"upload_time":"2026-08-09T02:17:39","upload_time_iso_8601":"2026-08-09T02:17:39.674550Z","url":"https:\/\/files.pythonhosted.org\/packages\/50\/af\/4016682be48350407837941ad1a1ae8185cca65b102e04e89eee2a2abccb\/litellm-1.93.2-cp314-cp314-manylinux_2_28_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"5bb5c25d7fbe08490d8211bd6b69af23f3a922b68ad8c87c776480b0de64a505","md5":"8f5686293bc87c01cd65fd3b2ae58327","sha256":"0a7f3e5138e307e429bd8fa29cc0c48bb1e2b827792e8f7799ca4c8cff736103"},"downloads":-1,"filename":"litellm-1.93.2-cp314-cp314-musllinux_1_2_aarch64.whl","has_sig":false,"md5_digest":"8f5686293bc87c01cd65fd3b2ae58327","packagetype":"bdist_wheel","python_version":"cp314","requires_python":"<3.15,>=3.10","size":20230910,"upload_time":"2026-08-09T02:17:42","upload_time_iso_8601":"2026-08-09T02:17:42.159618Z","url":"https:\/\/files.pythonhosted.org\/packages\/5b\/b5\/c25d7fbe08490d8211bd6b69af23f3a922b68ad8c87c776480b0de64a505\/litellm-1.93.2-cp314-cp314-musllinux_1_2_aarch64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"9e599b203a5d35f5b159dd4db2733e27a126503532e14f70fe216b2818f483a8"},"digests":{"blake2b_256":"2127341b18a40d4d98a2ac09025c248a3a7edddaf15ce4096ac4a783ff2f70db","md5":"1d7f4c3f3a6c6207940cc5a7dda3cd8f","sha256":"d8684629be3f7b5f8e2b6e5fe5ea27ff957c63a8d525d81c1460d8436e2e1857"},"downloads":-1,"filename":"litellm-1.93.2-cp314-cp314-musllinux_1_2_x86_64.whl","has_sig":false,"md5_digest":"1d7f4c3f3a6c6207940cc5a7dda3cd8f","packagetype":"bdist_wheel","python_version":"cp314","requires_python":"<3.15,>=3.10","size":20288903,"upload_time":"2026-08-09T02:17:44","upload_time_iso_8601":"2026-08-09T02:17:44.433410Z","url":"https:\/\/files.pythonhosted.org\/packages\/21\/27\/341b18a40d4d98a2ac09025c248a3a7edddaf15ce4096ac4a783ff2f70db\/litellm-1.93.2-cp314-cp314-musllinux_1_2_x86_64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":{"sha256":"5a9a18bc5f2ebbe265d32046c4571c0fb173df595dee9379607866a3b90f7ddc"},"digests":{"blake2b_256":"8d45dd9ef72075a83854f852b1bf9a97ec7029a2be9fb4e338fc6623eb09fc90","md5":"a53399e79bab655d5d2b3f7ec55c6e6f","sha256":"a783b8b18ed68cb6a3b79d2b00273ec21aef92442e9b2712a50036cb84bfe583"},"downloads":-1,"filename":"litellm-1.93.2-cp314-cp314-win_amd64.whl","has_sig":false,"md5_digest":"a53399e79bab655d5d2b3f7ec55c6e6f","packagetype":"bdist_wheel","python_version":"cp314","requires_python":"<3.15,>=3.10","size":19772974,"upload_time":"2026-08-09T02:17:46","upload_time_iso_8601":"2026-08-09T02:17:46.972756Z","url":"https:\/\/files.pythonhosted.org\/packages\/8d\/45\/dd9ef72075a83854f852b1bf9a97ec7029a2be9fb4e338fc6623eb09fc90\/litellm-1.93.2-cp314-cp314-win_amd64.whl","yanked":false,"yanked_reason":null},{"comment_text":null,"core-metadata":false,"digests":{"blake2b_256":"97dd28024c0e4cf2dc6ab1bad59b8357af7f460e952c69526eae28f12ac4ee5e","md5":"29ff6f54a965caa92362cd6d62e9ef95","sha256":"c5d5223ef07f36e0886397fb45cc9db4150f86a0c6f6835cee1d5524cab69dfd"},"downloads":-1,"filename":"litellm-1.93.2.tar.gz","has_sig":false,"md5_digest":"29ff6f54a965caa92362cd6d62e9ef95","packagetype":"sdist","python_version":"source","requires_python":"<3.15,>=3.10","size":15955441,"upload_time":"2026-08-09T02:17:49","upload_time_iso_8601":"2026-08-09T02:17:49.646197Z","url":"https:\/\/files.pythonhosted.org\/packages\/97\/dd\/28024c0e4cf2dc6ab1bad59b8357af7f460e952c69526eae28f12ac4ee5e\/litellm-1.93.2.tar.gz","yanked":false,"yanked_reason":null}],"vulnerabilities":[{"aliases":["CVE-2026-114612"],"details":"### Summary\n\nAn authenticated user with `internal_user` privileges can escalate to `proxy_admin` and achieve remote code execution. The proxy uses one encryption key for two purposes: sealing secrets at rest and minting session tokens. An attacker exploits this by requesting a new API key with a crafted metadata field containing a forged admin credential as the \"secret\" value. The proxy encrypts and returns this payload. When this value is then presented as a bearer token, the proxy decrypts it, trusts the forged admin identity, and grants full administrative access, including the ability to execute arbitrary commands via the MCP stdio endpoint.\n\n### Affected versions\n\nVersions later than 1.91.0 are exploitable in the default configuration. Versions 1.87.0 through 1.90.x are exploitable only if `EXPERIMENTAL_UI_LOGIN=true` was explicitly set.\n\n### Mitigation\n\nUpgrade to a patched version as soon as possible.\n\nIf you cannot upgrade immediately, set `EXPERIMENTAL_UI_LOGIN=false`. This disables the vulnerable authentication path but also breaks CLI SSO and Claude Code gateway login.\n\n### Impact\n\nAn internal user can escalate to proxy admin and execute arbitrary commands on the host.\n\n**Discovery Credit:** Hoa X. Nguyen (OPSWAT Unit 515)","fixed_in":["1.100.4","1.101.3","1.102.2","1.103.1","1.104.0rc2"],"id":"GHSA-7hp6-4w63-5g45","link":"https:\/\/osv.dev\/vulnerability\/GHSA-7hp6-4w63-5g45","source":"osv","summary":null,"withdrawn":null},{"aliases":[],"details":"## Summary\n\nAn authenticated LiteLLM proxy user could read arbitrary local files from the proxy runtime by sending a crafted `vertex_ai_credentials` value to `\/utils\/transform_request`. The request-body safety blocklist rejected `vertex_credentials` but missed its alias `vertex_ai_credentials`, which let the value reach the Vertex AI credential loader and trigger a file read that is sent to an attacker-controlled URL.\n\n## Impact\n\nA low-privilege authenticated user (only `internal_user_viewer`, obtainable through SSO login on many deployments) could read any file readable by the LiteLLM process. Reading files such as `\/proc\/self\/environ` can disclose `LITELLM_MASTER_KEY` and provider API keys, so the impact can escalate to full proxy-admin control.\n\n## Remediation\n\nUpgrade to `1.95.0` or later. The fix adds the missing alias to the request-body blocklist, so no configuration change is needed once you upgrade. There is no reliable configuration workaround on affected versions.","fixed_in":["1.95.0"],"id":"GHSA-g5ff-637f-6q2m","link":"https:\/\/osv.dev\/vulnerability\/GHSA-g5ff-637f-6q2m","source":"osv","summary":null,"withdrawn":null}]}