Skip to content

Releases: BerriAI/litellm

v1.83.0-nightly

31 Mar 21:49
f0518c1

Choose a tag to compare

Verifying the Docker Image

cosign verify --insecure-ignore-tlog=true --key https://raw.githubusercontent.com/BerriAI/litellm/main/cosign.pub \
  ghcr.io/berriai/litellm:v1.83.0-nightly

Output:

Verification for ghcr.io/berriai/litellm:v1.83.0-nightly --
The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

New Contributors

Full Changelog: v1.82.6.dev2...v1.83.0-nightly

v1.82.6.rc.2

24 Mar 03:39

Choose a tag to compare

v1.82.6.dev2

24 Mar 04:25
14fffc2

Choose a tag to compare

What's Changed

  • fix(proxy): post-call guardrail response not captured for logging by @michelligabriele in #23910
  • feat(prometheus): include spend_logs_metadata in custom labels by @krrishdholakia in #24434
  • feat(proxy): add project_alias tracking in callbacks by @krrishdholakia in #24432

Full Changelog: v1.82.5.dev.1...v1.82.6.dev2

v1.82.3-stable.patch.2

24 Mar 06:10

Choose a tag to compare

What's Changed

  • fix: don't close HTTP/SDK clients on LLMClientCache eviction by @ishaan-jaff in #22926
  • [Feature] UI - Keys: Add Organization Dropdown to Create/Edit Key by @yuneng-jiang in #23595
  • [Test] UI - Add Unit Tests for 5 Untested Components by @yuneng-jiang in #23607
  • [Feature] UI - Internal Users: Add/Remove Team Membership by @yuneng-jiang in #23638
  • [Feature] UI - Default Team Settings: Modernize page and fix defaults application by @yuneng-jiang in #23614
  • [Fix] Tag list endpoint 500 from invalid Prisma group_by kwargs by @yuneng-jiang in #23606
  • [Feature] UI - Usage: Auto-paginate daily spend data by @yuneng-jiang in #23622
  • [Infra] Merge internal dev 3/13 with main by @yuneng-jiang in #23658
  • feat: add sagemaker_nova provider for Amazon Nova models on SageMaker by @ryanh-ai in #21542
  • [Fix] Team Admin 403 on /user/filter/ui With Org Scope Flag by @yuneng-jiang in #23671
  • fix: redact secrets from proxy log output by @ryan-crabbe in #23668
  • fix: prisma migrate deploy failures on pre-existing instances by @krrishdholakia in #23655
  • [Fix] Hanging CI Tests in custom_httpx test_http_handler by @yuneng-jiang in #23674
  • Add CodSpeed continuous performance benchmarks by @codspeed-hq[bot] in #23676
  • [Infra] Merge internal dev with main by @yuneng-jiang in #23654
  • Litellm fix redaction filter logging v2 by @ryan-crabbe in #23667
  • [Fix] Bump PyJWT to ^2.12.0 for Security by @yuneng-jiang in #23678
  • Root cause fix - migrate all logging update to use 1 function - for centralized kwarg updates by @krrishdholakia in #23659
  • fix: make db migration failure exit opt-in via --enforce_prisma_migration_check by @krrishdholakia in #23675
  • [Infra] Optimize CI Pipeline by @yuneng-jiang in #23721

New Contributors

  • @codspeed-hq[bot] made their first contribution in #23676

Full Changelog: v1.82.0.patch5...v1.82.3-stable.patch.2

v1.82.3-stable.patch.1

24 Mar 03:33

Choose a tag to compare

What's Changed

  • fix: don't close HTTP/SDK clients on LLMClientCache eviction by @ishaan-jaff in #22926
  • [Feature] UI - Keys: Add Organization Dropdown to Create/Edit Key by @yuneng-jiang in #23595
  • [Test] UI - Add Unit Tests for 5 Untested Components by @yuneng-jiang in #23607
  • [Feature] UI - Internal Users: Add/Remove Team Membership by @yuneng-jiang in #23638
  • [Feature] UI - Default Team Settings: Modernize page and fix defaults application by @yuneng-jiang in #23614
  • [Fix] Tag list endpoint 500 from invalid Prisma group_by kwargs by @yuneng-jiang in #23606
  • [Feature] UI - Usage: Auto-paginate daily spend data by @yuneng-jiang in #23622
  • [Infra] Merge internal dev 3/13 with main by @yuneng-jiang in #23658
  • feat: add sagemaker_nova provider for Amazon Nova models on SageMaker by @ryanh-ai in #21542
  • [Fix] Team Admin 403 on /user/filter/ui With Org Scope Flag by @yuneng-jiang in #23671
  • fix: redact secrets from proxy log output by @ryan-crabbe in #23668
  • fix: prisma migrate deploy failures on pre-existing instances by @krrishdholakia in #23655
  • [Fix] Hanging CI Tests in custom_httpx test_http_handler by @yuneng-jiang in #23674
  • Add CodSpeed continuous performance benchmarks by @codspeed-hq[bot] in #23676
  • [Infra] Merge internal dev with main by @yuneng-jiang in #23654
  • Litellm fix redaction filter logging v2 by @ryan-crabbe in #23667
  • [Fix] Bump PyJWT to ^2.12.0 for Security by @yuneng-jiang in #23678
  • Root cause fix - migrate all logging update to use 1 function - for centralized kwarg updates by @krrishdholakia in #23659
  • fix: make db migration failure exit opt-in via --enforce_prisma_migration_check by @krrishdholakia in #23675
  • [Infra] Optimize CI Pipeline by @yuneng-jiang in #23721

New Contributors

  • @codspeed-hq[bot] made their first contribution in #23676

Full Changelog: v1.82.0.patch5...v1.82.3-stable.patch.1

v1.82.6.dev1

23 Mar 17:45

Choose a tag to compare

v1.82.3.dev.5

24 Mar 00:17

Choose a tag to compare

v1.82.6.rc.1

23 Mar 16:27

Choose a tag to compare

What's Changed

Read more

v1.82.6.dev.1

22 Mar 07:16

Choose a tag to compare

What's Changed

  • [Test] UI: Add unit tests for 10 untested components by @yuneng-jiang in #23891
  • fix: auto-recover shared aiohttp session when closed by @voidborne-d in #23808
  • [Feature] /v2/team/list: Add org admin access control, members_count, and indexes by @yuneng-jiang in #23938
  • [Refactor] UI - Playground: Extract FilePreviewCard from ChatUI by @yuneng-jiang in #23973
  • docs: add v1.82.3 release notes by @joereyna in #23820
  • fix(proxy): model-level guardrails not executing for non-streaming post_call by @michelligabriele in #23774
  • fix(proxy): prevent duplicate callback logs for pass-through endpoint failures by @michelligabriele in #23509
  • docs: Revamp documentation site with new navigation, landing pages, and styling by @Arindam200 in #24023
  • Fix langfuse otel traceparent propagation by @jyeros in #24048
  • [Test] UI: Add unit tests for 10 untested components by @yuneng-jiang in #24036
  • [Fix] UI - Logs: Guardrail Mode Type Crash on Non-String Values by @yuneng-jiang in #24035
  • [Staging] - Ishaan March 17th by @ishaan-jaff in #23903
  • [Infra] Merge daily branch with main by @yuneng-jiang in #24055
  • [Fix] UI - Default Team Settings: Add Missing Permission Options by @yuneng-jiang in #24039
  • fix: /key/block and /key/unblock return 404 (not 401) for non-existent keys by @yuneng-jiang in #23977
  • [Refactor] UI - Playground: Extract ChatMessageBubble from ChatUI by @yuneng-jiang in #24062
  • [Fix] Key Update Endpoint Returns 401 Instead of 404 for Nonexistent Keys by @yuneng-jiang in #24063
  • fix: surface Anthropic code execution results as code_interpreter_call in Responses API by @andrzej-pomirski-yohana in #23784
  • [Feature] UI - Leftnav: Add external link icon to Learning Resources by @yuneng-jiang in #24069
  • Fix thinking blocks dropped when thinking field is null by @xr843 in #24070
  • Preserve router model_group in generic API logs by @emerzon in #24044
  • Fix/proxy only failure call type by @alilxxey in #24050
  • fix(langsmith): populate usage_metadata in outputs for Cost column by @themavik in #24043
  • Fix model repetition detection performance by @hytromo in #18120
  • fix: fix logging for response incomplete streaming + custom pricing on /v1/messages and /v1/responses by @krrishdholakia in #24080
  • docs: add Contributing to Guardrails section to Guardrail Providers sidebar by @krrishdholakia in #24083
  • chore: regenerate poetry.lock to unblock CI (pyproject.toml content hash drift) by @joereyna in #24082
  • Ishaan - March 18th changes by @ishaan-jaff in #24056
  • [Test] UI: Add vitest coverage for 10 untested components by @yuneng-jiang in #24144
  • chore: apply black formatting to fix lint CI by @joereyna in #24092
  • feat(proxy): use AZURE_DEFAULT_API_VERSION for proxy --api_version default by @Sameerlite in #24120
  • chore: apply black formatting to fix lint CI (batch 2) by @joereyna in #24153
  • [Refactor] UI - API Reference: Migrate to Path-Based Routing by @yuneng-jiang in #24155
  • chore: add poetry check --lock to lint CI to prevent stale lockfile merges by @joereyna in #24159
  • [Infra] Merge daily internal branch with main by @yuneng-jiang in #24150
  • chore: apply black formatting to proxy/_types.py to fix lint CI by @joereyna in #24167
  • docs: add LiteLLM license key environment variable instructions by @krrishdholakia in #24168
  • Litellm oss staging 03 18 2026 by @krrishdholakia in #24081
  • chore: apply black formatting to fix lint CI (batch 3) by @joereyna in #24173
  • docs(release-notes): complete v1.82.3 changelog with full PR audit by @joereyna in #24090
  • feat(anthropic): support ANTHROPIC_AUTH_TOKEN and ANTHROPIC_BASE_URL env vars by @devin-petersohn in #24140
  • chore: apply black formatting and enable black pre-commit hook by @joereyna in #24187
  • fix: upgrade mcp to 1.26.0 and bump version to 1.82.5 by @joereyna in #24179
  • [Fix] UI: AntD Messages Not Rendering by @yuneng-jiang in #24192
  • [Feature] UI - Teams: Modernize Teams Table by @yuneng-jiang in #24189
  • [Refactor] Extract useChatHistory hook from ChatUI.tsx by @yuneng-jiang in #24172
  • fix(proxy): add team_member_budget_duration to NewTeamRequest by @michelligabriele in #23484
  • [Feature] Team MCP Server Manager Role by @yuneng-jiang in #24171
  • [Docs] Add missing team_member_budget_duration param to new_team docstring by @yuneng-jiang in #24243
  • feat: add control plane for multi-proxy worker management by @ryan-crabbe in #24217
  • Revert "[Feature] Team MCP Server Manager Role" by @yuneng-jiang in #24255
  • fix(test): mock get_auth_header instead of get_api_key in anthropic file content test by @joereyna in #24258
  • [Infra] Merge internal dev branch with main by @yuneng-jiang in #24260
  • [Feature] MCP team management + per-member granular permissions by @yuneng-jiang in #24266
  • [Refactor] UI - Policies: Extract usePolicyVersions Hook by @yuneng-jiang in #24259
  • [Feature] UI - MCP: Team member permissions drawer and CRUD access by @yuneng-jiang in #24274
  • [Feature] Search Tools: Add access control via object permissions by @yuneng-jiang in #24075
  • [Test] UI: Add vitest coverage for 10 untested components by @yuneng-jiang in #24239

New Contributors

Full Changelog: v1.82.4-nightly...v1.82.6.dev.1

v1.82.6-nightly

22 Mar 07:00

Choose a tag to compare

What's Changed

  • fix(anthropic): preserve thinking.summary when routing to OpenAI Responses API by @Chesars in #21441
  • docs: add thinking.summary field to /v1/messages and reasoning docs by @Chesars in #22823
  • fix(gemini): resolve image token undercounting in usage metadata by @gustipardo in #22608
  • feat(anthropic): add opt-out flag for default reasoning summary by @Chesars in #22904
  • fix(anthropic): align translate_thinking_for_model with default summary injection + docs by @Chesars in #22909
  • fix(fireworks): skip #transform=inline for base64 data URLs by @awais786 in #23729
  • fix(langsmith): avoid no running event loop during sync init by @pandego in #23727
  • fix(gemini): support images in tool_results for /v1/messages routing by @awais786 in #23724
  • fix(model-prices): correct supported_regions for Vertex AI DeepSeek models by @Chesars in #23864
  • fix(model-prices): restore gpt-4-0314 by @Chesars in #23753
  • fix(cache): Fix Redis cluster caching by @cohml in #23480
  • fix(proxy): convert max_budget to float when set via environment variable by @rstar327 in #23855
  • Add Akto Guardrails to LiteLLM by @rzeta-10 in #23250
  • fix(core): map Anthropic 'refusal' finish reason to 'content_filter' by @Chesars in #23899
  • fix(vertex): streaming finish_reason='stop' instead of 'tool_calls' for gemini-3.1-flash-lite-preview by @Chesars in #23895
  • fix: map Chat Completion file type to Responses API input_file by @gambletan in #23618
  • fix(vertex): respect vertex_count_tokens_location for Claude count_tokens by @Chesars in #23907
  • fix(anthropic): preserve cache directive on file-type content blocks by @Chesars in #23906
  • fix(mistral): preserve diarization segments in transcription response by @Chesars in #23925
  • fix(gemini): pass model to context caching URL builder for custom api_base by @Chesars in #23928
  • fix(azure): auto-route gpt-5.4+ tools+reasoning to Responses API by @Chesars in #23926
  • merge main by @Sameerlite in #24119
  • [Test] UI: Add vitest coverage for 10 untested components by @yuneng-jiang in #24144
  • [Refactor] UI - API Reference: Migrate to Path-Based Routing by @yuneng-jiang in #24155
  • [Fix] UI: AntD Messages Not Rendering by @yuneng-jiang in #24192
  • [Feature] UI - Teams: Modernize Teams Table by @yuneng-jiang in #24189
  • [Refactor] Extract useChatHistory hook from ChatUI.tsx by @yuneng-jiang in #24172
  • Day 0: gpt 5.4 mini and nano support by @Sameerlite in #23958
  • [feat]Add prompt management support for responses api by @Sameerlite in #23999
  • docs(vertex): add PayGo/Priority tutorial and cost tracking flow diagramLitellm vertex paygo tutorial by @Sameerlite in #24009
  • feat(file_search): align emulated Responses behavior with native output by @Sameerlite in #23969
  • fix(proxy): pass-through subpath auth for non-admin users by @Sameerlite in #24079
  • fix(polling): check rate limits before creating polling ID by @Sameerlite in #24106
  • docs: note min version for encrypted_content_affinity by @milan-berri in #23854
  • feat(router): add per-model-group deployment affinity by @Sameerlite in #24110
  • Litellm fix ensure alternating roles by @Sameerlite in #24015
  • fix(bedrock): respect api_base and aws_bedrock_runtime_endpoint in count_tokens endpoint by @stias in #24199
  • fix(gemini-embeddings): convert task_type to camelCase taskType for Gemini API by @christopherbaer in #24191
  • fix(vertex-ai): support batch cancel via Vertex API by @Sameerlite in #23957
  • fix(azure-ai-agents): preserve annotations in Bing Search grounding responses by @Sameerlite in #23939
  • fix(logging): merge hidden_params into metadata for streaming requests by @milan-berri in #24220
  • docs(pricing): add official source links for Azure DeepSeek & Cohere … by @Jayachander123 in #20181
  • fix(transcription): fix cost_per_second calculation for audio transcription models by @gvioss in #23842
  • fix(moonshot): preserve reasoning_content on Pydantic Message objects in multi-turn tool calls by @BillionClaw in #23828
  • fix(proxy): add team_member_budget_duration to NewTeamRequest by @michelligabriele in #23484
  • [Feature] Team MCP Server Manager Role by @yuneng-jiang in #24171
  • [Docs] Add missing team_member_budget_duration param to new_team docstring by @yuneng-jiang in #24243
  • feat: add control plane for multi-proxy worker management by @ryan-crabbe in #24217
  • Revert "[Feature] Team MCP Server Manager Role" by @yuneng-jiang in #24255
  • fix(test): mock get_auth_header instead of get_api_key in anthropic file content test by @joereyna in #24258
  • [Infra] Merge internal dev branch with main by @yuneng-jiang in #24260
  • [Feature] Add Audit Log Export to External Callbacks by @yuneng-jiang in #23167
  • fix(adapter): add additionalProperties: false for OpenAI strict mode in Anthropic adapter by @Chesars in #24072
  • feat(gemini): support context circulation for server-side tool combination by @Chesars in #24073
  • feat(bedrock): support cache_control_injection_points for tool_config location by @Chesars in #24076
  • Revert "fix(transcription): fix cost_per_second calculation for audio transcription models" by @Sameerlite in #24297
  • Litellm fix create key tags dropdown by @ryan-crabbe in #24273
  • Litellm oss staging 03 19 2026 by @krrishdholakia in #24174
  • docs: add Gemini/Vertex AI prompt caching support to docs by @krrishdholakia in #24222
  • fix: global secret redaction via root logger + key-name-based pattern matching by @ryan-crabbe in #24305
  • polish: add click-to-copy icon on User ID in internal users table by @ryan-crabbe in #24315
  • polish: remove required asterisks from v3 login form fields by @ryan-crabbe in #24318
  • Litellm ishaan march 20 by @ishaan-jaff in #24303
  • fix(fireworks): skip #transform=inline for base64 data URLs (#23729) by @krrishdholakia in #23818
  • fix(proxy): restore per-entity breakdown in aggregated daily activity endpoint by @michelligabriele in #23471
  • Litellm oss staging 03 05 2026 by @krrishdholakia in #22844
  • Litellm dev sameer 16 march week by @Sameerlite in #24211
  • litellm ryan march 20 by @ryan-crabbe in #24323

New Contributors

Full Changelog: v1.82.3.dev.2...v1.82.6-nightly