fix(proxy): return 5xx on DB infra errors during auth; reserve 401 for genuine auth failures by yassin-berriai · Pull Request #29986 · BerriAI/litellm

yassin-berriai · 2026-06-08T23:45:00Z

Relevant issues

During a production DB incident, customers received 401 Invalid API key for valid keys for several hours. The auth path's DB key lookup raised infrastructure errors (connection refused, transport failure, timeout), and the code treated "the lookup did not return a valid token" the same as "the key is invalid". 401 is wrong for a transient infra failure; the request should fail with a retryable 5xx.

Linear ticket

Pre-Submission checklist

I have added meaningful tests
My PR passes all unit tests on make test-unit
My PR's scope is as isolated as possible; it only solves 1 specific problem
I have requested a Greptile review by commenting @greptileai and received a Confidence Score of at least 4/5 before requesting a maintainer review (5/5 on HEAD d4db3ce)

CI (LiteLLM team)

CI run for the last commit 118 passed, 0 failed: https://github.com/BerriAI/litellm/actions/runs/27174709784

Screenshots / Proof of Fix

Baseline for every "before" below is litellm_internal_staging, the base branch of this PR. On staging, step 3 (DB outage, uncached valid key) returns HTTP 401 {"message":"Authentication Error, Can't reach database server at ...","type":"auth_error"}; the runs below show this branch returning 503 for the same scenario.

Live proxy on localhost:4000 against a real Postgres and the real OpenAI API, single session, steps run in order.

DB up, valid key, real OpenAI -> 200

$ curl -s -w 'HTTP %{http_code}' localhost:4000/v1/chat/completions \
    -H "Authorization: Bearer $KEYA" -H "Content-Type: application/json" \
    -d '{"model":"gpt-4o-mini","messages":[{"role":"user","content":"Say the single word: pong"}]}'
{"id":"chatcmpl-Doe7Xn42BHt9y3JBC37wMBZhwkDHO",...,"choices":[{"finish_reason":"stop","index":0,"message":{"content":"Pong","role":"assistant"...}}],"usage":{"completion_tokens":2,"prompt_tokens":13,"total_tokens":15...}}
HTTP 200

DB up, genuinely invalid key -> 401 (the genuine-auth-failure path is preserved)

$ curl -s -w 'HTTP %{http_code}' localhost:4000/v1/chat/completions \
    -H "Authorization: Bearer sk-bogus-does-not-exist" -H "Content-Type: application/json" \
    -d '{"model":"gpt-4o-mini","messages":[{"role":"user","content":"hi"}]}'
{"error":{"message":"Authentication Error, Invalid proxy server token passed. Received API Key = sk-...xist, Key Hash (Token) =0eab84fa..., Unable to find token in cache or `LiteLLM_VerificationTokenTable`","type":"token_not_found_in_db","param":"key","code":"401"}}
HTTP 401

DB outage (stopped Postgres), uncached valid key -> 503 (on litellm_internal_staging this returns 401)

$ docker stop litellm-pg   # simulate the outage
$ curl -s -w 'HTTP %{http_code}' localhost:4000/v1/chat/completions \
    -H "Authorization: Bearer $KEYB" -H "Content-Type: application/json" \
    -d '{"model":"gpt-4o-mini","messages":[{"role":"user","content":"hi"}]}'
{"error":{"message":"Service Unavailable, the authentication database is temporarily unreachable. Please retry shortly.","type":"no_db_connection","param":"None","code":"503"}}
HTTP 503

The uncached key in step 3 is deliberate: a previously-used key is served from the in-memory cache and never reaches the DB, so the outage is only observable on a key whose lookup must hit Postgres. The 503 body is intentionally generic; the underlying driver error (which carries the DB host and port) is logged server-side only, never returned to the caller.

Follow-up: first-request-of-the-outage edge case

A later live pass surfaced one residual case that still returned 401. At the exact instant the Postgres socket drops, the prisma query engine returns a malformed error payload (user_facing_error.meta is null) and prisma-client-py's handle_response_errors crashes with AttributeError: 'NoneType' object has no attribute 'get' before it can raise the proper P1001 "can't reach database server" error. That bare AttributeError carries no connection keyword, so the classifier missed it and auth fell through to 401.

Reproduced live on a worktree of this branch (proxy on :4103, Postgres in container pg-29986). Postgres is killed with fresh uncached-key auth requests in flight, so several lookups land in the tear-down window.

$ docker kill pg-29986   (fired mid-flight)
--- HTTP status codes (12 fresh uncached keys spanning the outage) ---
   2 401
  10 503
--- a 503 response body returned to the caller ---
{"error":{"message":"Service Unavailable, the authentication database is temporarily unreachable. Please retry shortly.","type":"no_db_connection","param":"None","code":"503"}}
--- proxy-side log correlation ---
prisma 'NoneType ... no attribute get' occurrences: 10
HTTP 401 responses at/after the first AttributeError: 0

The two 401s are the requests fired before the kill while the DB was still up; they are bogus keys the DB confirmed missing, which is correct. After the socket drops, the prisma-engine AttributeError is raised ten times (five lookups, logged twice each) and every request returns 503, none 401. Running the kill-with-requests-in-flight cycle ten times in a row reproduced this on every cycle, and recovery is clean: once Postgres is back, a genuinely invalid key returns 401 again.

Note on the before/after for this edge case: "before" here means this branch without the follow-up commit (on litellm_internal_staging the request 401s regardless, since staging has no 503 classification at all). PrismaClient.get_data wraps the lookup in a three-try backoff.on_exception, so the AttributeError is usually retried and the next attempt returns a clean P1001 that the keyword classifier already maps to 503. The bare AttributeError only escapes to auth as a 401 when the final retry also lands in the sub-second malformed-payload window, which is timing-dependent. Across eleven scripted outage cycles without the follow-up commit I could not force that escape on demand; the regression is therefore pinned by a deterministic unit test that calls the real prisma.engine.utils.handle_response_errors with the malformed payload, captures the genuine AttributeError, and asserts the auth handler returns 503. That test fails (401) without the follow-up commit and passes (503) with it.

Type

🐛 Bug Fix

Changes

The root cause is in the auth exception handler. get_key_object raises a ProxyException with code 401 only when the DB lookup returns no row (a genuinely missing key). When the lookup instead raises an infrastructure error, that raw exception propagates past the except ProxyException guard in _user_api_key_auth_builder and reaches _handle_authentication_error, whose final fallthrough turned every remaining exception into a 401 "Authentication Error". So a DB outage looked identical to a wrong key.

This change keeps 401 for genuine auth failures and converts DB-unavailable conditions to 503. A new classifier PrismaDBExceptionHandler.is_database_service_unavailable_error recognizes connectivity/transport/socket/timeout failures: httpx transport errors, prisma connection errors, the OSError family (ConnectionError, TimeoutError), asyncio.TimeoutError, and asyncpg connection/interface errors. _handle_authentication_error checks this classifier right before the 401 fallthrough and raises a 503 ProxyException (type=no_db_connection) instead. The existing allow_requests_on_db_unavailable HA fallback and all typed auth failures (missing key 401, expired key, budget 429) are untouched.

One real-world subtlety surfaced while validating against a live proxy: prisma-client-py raises the P1001 "can't reach database server" connectivity failure as a DataError, a data-layer type. A type-only check would miss it (data-layer types are deliberately excluded so the HA fallback never grants a token on a genuine data error) and the request would still 401 during an outage. The classifier therefore also consults is_database_transport_error, which keyword-matches the connection message and catches that masquerade, while genuine data errors (no connection keyword) correctly stay 401.

The classifier also maps the Postgres "cached plan must not change result type" error to 503. That error is a transient rolling-deploy condition that _query_first_with_cached_plan_fallback recovers from; if that recovery fails and the error escapes, the customer is still hitting stale DB state, not presenting an invalid key, so 503 is the honest answer. It is matched in this classifier rather than in is_database_transport_error so it does not trigger a reconnect on a connection that is actually healthy.

A follow-up commit covers the prisma-engine tear-down race described in the proof above. When the query engine returns a malformed error payload during the socket drop, prisma-client-py raises a bare AttributeError from inside its prisma.engine layer rather than a typed PrismaError, so neither the type checks nor the keyword match catch it. A new helper is_prisma_engine_internal_error treats a non-PrismaError exception whose traceback passes through a prisma.engine frame as service-unavailable, and is_database_service_unavailable_error consults it. The check is deliberately narrow: it excludes every PrismaError (connectivity ones are already classified, data-layer ones must keep returning 401) and keys off the prisma-engine traceback origin rather than the generic message, so a genuine application AttributeError is never reclassified as 503.

The 503 response body is a fixed generic message and does not echo the underlying exception, so DB connection details (host, port) are never leaked to the caller; the driver error is logged server-side via the existing exception logging.

503 matches the existing precedent in this auth path (the AUTO_REGISTER race resolver already raises a 503 for a transient, retryable condition).

Tests cover the classifier (each infra error type maps to true; the P1001-as-DataError masquerade maps to true; the escaped cached-plan error maps to true; data-layer and unrelated errors map to false; asyncpg via an injected stand-in module), the handler conversion (each infra error and the cached-plan error become 503 with no_db_connection and never say "Invalid API key"; genuine 401s stay 401), and the full builder path (DB infra error end-to-end becomes 503, missing key stays 401, valid key still authenticates). The prisma-engine tear-down case adds a classifier test and an auth-handler test that both call the real prisma.engine.utils.handle_response_errors with the malformed payload to capture the genuine AttributeError, plus narrowness guards that a real application AttributeError and a data-layer PrismaError are not reclassified as 503. Disabling either 503 branch fails these tests.

yassin-berriai · 2026-06-08T23:45:09Z

@greptileai

CLAassistant · 2026-06-08T23:45:18Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

codecov · 2026-06-08T23:48:04Z

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

greptile-apps · 2026-06-08T23:48:47Z

Greptile Summary

This PR fixes a production incident where valid API keys returned 401 Invalid API key during a DB outage by correctly distinguishing infrastructure-level failures (connection refused, transport error, timeout) from genuine auth failures (key not found). The new PrismaDBExceptionHandler.is_database_service_unavailable_error classifier gates a 503 branch inserted just before the 401 fallthrough in _handle_authentication_error.

exception_handler.py: Adds is_database_service_unavailable_error (composite classifier covering httpx transport errors, OSError/TimeoutError, asyncpg connection errors, prisma keyword matches, cached-plan escapes) and is_prisma_engine_internal_error (traceback-frame walk to catch the bare AttributeError prisma raises when its query engine returns a malformed payload during a socket tear-down).
auth_exception_handler.py: Inserts one new if is_database_service_unavailable_error(e): raise 503 branch between the existing ProxyException re-raise and the 401 fallthrough; the generic 503 message does not echo internal DB addressing.
Tests: Parametrized coverage of every infra error type → 503, the P1001-as-DataError masquerade, the prisma engine tear-down race (using the real prisma.engine.utils.handle_response_errors to reproduce the AttributeError), and narrowness guards that genuine auth failures still return 401.

Confidence Score: 5/5

Safe to merge — the change is additive (one new branch before the 401 fallthrough), all pre-existing typed auth failures and the HA fallback path are untouched, and CI confirms 118 tests pass.

The classifier logic is well-reasoned with explicit exclusions for data-layer errors, the 503 branch is correctly ordered after the ProxyException re-raise so it never intercepts a known auth failure, and the test suite covers both the happy path (valid key still authenticates) and the regression cases (each infra error type → 503, missing key → 401). No regressions are introduced.

No files require special attention.

Important Files Changed

Filename	Overview
litellm/proxy/db/exception_handler.py	Adds `is_prisma_engine_internal_error` (traceback-frame walk) and `is_database_service_unavailable_error` (composite classifier) to distinguish transient infra failures from genuine auth failures; logic is well-structured and exclusions are correct
litellm/proxy/auth/auth_exception_handler.py	Inserts a 503 branch between the ProxyException re-raise and the 401 fallthrough; ordering is correct, HA-fallback path is untouched, and message is generic (no internal DB details leaked)
tests/test_litellm/proxy/db/test_exception_handler.py	Comprehensive new tests covering all infra error types, the P1001-as-DataError masquerade, the cached-plan case, asyncpg injection, and narrowness guards; calls `prisma.engine.utils.handle_response_errors` directly to capture the real `AttributeError`
tests/test_litellm/proxy/auth/test_auth_exception_handler.py	New parametrized tests for DB infra → 503, prisma engine tear-down → 503, and genuine auth failure → 401; tests are additive (no existing assertions weakened)
tests/test_litellm/proxy/auth/test_user_api_key_auth.py	Adds end-to-end builder tests driving the real `_user_api_key_auth_builder` to verify 503 on infra error, 401 on missing key, and success on valid key; existing test unchanged except a cosmetic line-length reformat

_{Reviews (5): Last reviewed commit: "fix(proxy): classify prisma-engine teard..." | Re-trigger Greptile}

greptile-apps · 2026-06-08T23:48:51Z

+        # OSError already covers ConnectionError and (Py3.3+) TimeoutError.
+        # asyncio.TimeoutError is a distinct class before Py3.11.
+        if isinstance(e, (OSError, asyncio.TimeoutError)):
+            return True


isinstance(e, (OSError, asyncio.TimeoutError)) catches every OSError subclass, including FileNotFoundError, PermissionError, IsADirectoryError, etc. In the auth DB-lookup path these non-network errors are exceedingly rare, and classifying them as 503 is still more correct than 401, but tightening the check to the networking subclasses (ConnectionError, TimeoutError) makes the intent explicit and avoids surprising classification if an unrelated OSError ever propagates here.

Suggested change

# OSError already covers ConnectionError and (Py3.3+) TimeoutError.

# asyncio.TimeoutError is a distinct class before Py3.11.

if isinstance(e, (OSError, asyncio.TimeoutError)):

return True

# ConnectionError covers network subclasses (ConnectionRefusedError,

# ConnectionResetError, etc.). TimeoutError covers ETIMEDOUT.

# asyncio.TimeoutError is a distinct class before Py3.11; check it

# explicitly so Py3.10 environments are covered.

if isinstance(e, (ConnectionError, TimeoutError, asyncio.TimeoutError)):

return True

Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!

greptile-apps · 2026-06-08T23:50:27Z

Greptile Summary

This PR fixes a production incident where a database outage caused valid API keys to return 401 Invalid API key for several hours. The root cause was that infrastructure-level DB failures propagated past the typed ProxyException guard in the auth exception handler and fell through to a catch-all 401.

Adds PrismaDBExceptionHandler.is_database_service_unavailable_error, a classifier that recognises connectivity/transport/socket/timeout failures (httpx transport errors, prisma connection errors, OSError family, asyncio.TimeoutError, asyncpg connection/interface errors) including the P1001-masquerades-as-DataError edge case.
Inserts a 503 raise in _handle_authentication_error just before the 401 fallthrough, so DB infra errors now surface as retryable no_db_connection responses instead of misleading auth rejections; genuine 401s (missing key, expired key) and the existing allow_requests_on_db_unavailable HA fallback are untouched.
Test coverage includes per-error-type unit tests for the classifier, handler-level tests asserting the 401\u2194503 split, and three end-to-end builder tests (infra error \u2192 503, missing key \u2192 401, valid key \u2192 success).

Confidence Score: 4/5

Safe to merge; the change is conservative and never grants access where none was granted before.

The logic is well-scoped and the test suite is thorough. Two non-blocking observations: the 503 message includes str(e) which may expose internal DB host/port to callers, and deployments using allow_requests_on_db_unavailable: true won't see the HA pass-through token for native OSError/asyncio.TimeoutError (they get 503 instead, which is correct but not the configured HA behaviour).

No files require special attention; the core change in auth_exception_handler.py and db/exception_handler.py is well-tested.

Important Files Changed

Filename	Overview
litellm/proxy/auth/auth_exception_handler.py	Adds a 503 raise before the 401 fallthrough; ordering is correct (ProxyException re-raise happens first, then the new infra check, then the legacy 401). Minor: the 503 message embeds str(e) which can expose internal DB address in client responses.
litellm/proxy/db/exception_handler.py	New is_database_service_unavailable_error classifier correctly delegates to existing helpers and adds OSError/asyncio.TimeoutError/asyncpg coverage. Gap: OSError/asyncio.TimeoutError are not covered by is_database_connection_error, so allow_requests_on_db_unavailable HA fallback doesn't fire for those types.
tests/test_litellm/proxy/auth/test_auth_exception_handler.py	New parametrized tests cover each infra-error type -> 503, genuine auth failures -> 401, and the P1001-as-DataError masquerade; all mock-only, no real network calls.
tests/test_litellm/proxy/auth/test_user_api_key_auth.py	Three end-to-end builder tests cover DB infra error -> 503, missing key -> 401, and valid key -> success.
tests/test_litellm/proxy/db/test_exception_handler.py	Unit tests for is_database_service_unavailable_error cover infra failures, P1001-masquerade-as-DataError, data-layer exclusions, and asyncpg via a monkeypatched stand-in module.

_{Reviews (2): Last reviewed commit: "fix(proxy): return 5xx on DB infra error..." | Re-trigger Greptile}

yassin-berriai · 2026-06-08T23:58:26Z

@greptileai I've pushed updates: narrowed the cached-plan transient to 503, and the 503 response body no longer echoes the underlying driver error (no DB host/port leakage; logged server-side only). Please re-review.

yassin-berriai · 2026-06-09T00:16:41Z

Thanks for the review. Note the last reviewed commit was 5e95927; the current HEAD is d4db3ce and already addresses observation 1.

str(e) leak: fixed. The 503 body is now a fixed generic string ("Service Unavailable, the authentication database is temporarily unreachable. Please retry shortly.") and no longer embeds str(e). The underlying driver error, which carries the DB host/port, is logged server-side via the existing verbose_proxy_logger.exception call and is never returned to the caller. Verified against a live proxy (see the updated Proof of Fix).
OSError/asyncio.TimeoutError vs allow_requests_on_db_unavailable: this is intentional and not a regression. The HA fallback gate (is_database_connection_error) already did not cover native OSError/asyncio.TimeoutError before this PR, so those outages were never passing through; they previously fell through to 401. This PR changes that 401 to 503, which is strictly more correct. Broadening the HA pass-through to new exception types is a separate, security-sensitive change (it grants an anonymous token) and is deliberately out of scope here.

@greptileai please re-review the latest commit (d4db3ce).

yassin-berriai · 2026-06-10T21:28:50Z

@greptileai

…r genuine auth failures

chore(release): backport #27319, #27756, #27921, #28395, #29983, #29984, #29986, #30160, #30327 to stable/1.84.x and cut 1.84.8

chore(release): backport #29493, #29983, #29984, #29986, #30160, #30202, #30327, #30220 to stable/1.87.x and cut 1.87.3

…r genuine auth failures (BerriAI#29986) (cherry picked from commit da9d64b)

…r genuine auth failures (BerriAI#29986)

…r genuine auth failures (BerriAI#29986) (cherry picked from commit da9d64b)

…r genuine auth failures (BerriAI#29986)

This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [ghcr.io/berriai/litellm](https://images.chainguard.dev/directory/image/wolfi-base/overview) ([source](https://github.com/BerriAI/litellm)) | final | minor | `v1.85.1` → `v1.90.0` | --- ### Release Notes <details> <summary>BerriAI/litellm (ghcr.io/berriai/litellm)</summary> ### [`v1.90.0`](https://github.com/BerriAI/litellm/releases/tag/v1.90.0) [Compare Source](https://github.com/BerriAI/litellm/compare/v1.90.0...v1.90.0) ##### Verify Docker Image Signature All LiteLLM Docker images are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). Every release is signed with the same key introduced in [commit `0112e53`](https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0). **Verify using the pinned commit hash (recommended):** A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` **Verify using the release tag (convenience):** Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.90.0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` Expected output: ``` The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key ``` *** ##### What's Changed - fix(responses-bridge): map system-only chat request to system input item by [@milan-berri](https://github.com/milan-berri) in [#29817](https://github.com/BerriAI/litellm/pull/29817) - feat(bedrock): forward strict and additionalProperties to Converse toolSpec by [@mateo-berri](https://github.com/mateo-berri) in [#29814](https://github.com/BerriAI/litellm/pull/29814) - fix(mcp): highlight MCP cards red when the logged-in user is missing per-user env vars by [@mateo-berri](https://github.com/mateo-berri) in [#29856](https://github.com/BerriAI/litellm/pull/29856) - feat(ui): add budget duration to edit team member form by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29717](https://github.com/BerriAI/litellm/pull/29717) - fix(ui): make workflow runs page fill full width by [@yuneng-berri](https://github.com/yuneng-berri) in [#29868](https://github.com/BerriAI/litellm/pull/29868) - feat: standardize rate limit errors with category, rate\_limit\_type, model, and llm\_provider fields by [@mateo-berri](https://github.com/mateo-berri) in [#27687](https://github.com/BerriAI/litellm/pull/27687) - fix(ui): default guardrails page to the Guardrails tab by [@yuneng-berri](https://github.com/yuneng-berri) in [#29872](https://github.com/BerriAI/litellm/pull/29872) - docs(readme): add Deploy on AWS/GCP Terraform section and fix deploy button rendering by [@mateo-berri](https://github.com/mateo-berri) in [#29879](https://github.com/BerriAI/litellm/pull/29879) - refactor(bedrock): build Converse toolSpec via a BedrockToolSpec dict subclass by [@mateo-berri](https://github.com/mateo-berri) in [#29869](https://github.com/BerriAI/litellm/pull/29869) - feat(litellm): add models and repository layers by [@yassin-berriai](https://github.com/yassin-berriai) in [#29686](https://github.com/BerriAI/litellm/pull/29686) - feat(ui): include internal routes in the dashboard's generated OpenAPI types by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29885](https://github.com/BerriAI/litellm/pull/29885) - feat(proxy): publish /v2/model/info in Swagger OpenAPI spec by [@Sameerlite](https://github.com/Sameerlite) in [#29900](https://github.com/BerriAI/litellm/pull/29900) - refactor(ui): single source of truth for migrated-page routing by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29949](https://github.com/BerriAI/litellm/pull/29949) - fix(ui/model-hub): render provider icons on the public model hub by [@yuneng-berri](https://github.com/yuneng-berri) in [#29958](https://github.com/BerriAI/litellm/pull/29958) - fix(ui): keep create guardrail modal open on outside click by [@yuneng-berri](https://github.com/yuneng-berri) in [#29871](https://github.com/BerriAI/litellm/pull/29871) - fix(ui): label default key type as "Full Access" on key edit page by [@yuneng-berri](https://github.com/yuneng-berri) in [#29870](https://github.com/BerriAI/litellm/pull/29870) - fix(ui): unify migrated-route URLs and migrate the API Reference page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29953](https://github.com/BerriAI/litellm/pull/29953) - fix(mcp): let non-creator users OAuth into OBO-mode MCP servers from the Tools page by [@tin-berri](https://github.com/tin-berri) in [#29867](https://github.com/BerriAI/litellm/pull/29867) - Litellm oss staging 080626 by [@Sameerlite](https://github.com/Sameerlite) in [#29932](https://github.com/BerriAI/litellm/pull/29932) - feat(galileo): add health check support for UI callback test by [@Sameerlite](https://github.com/Sameerlite) in [#29908](https://github.com/BerriAI/litellm/pull/29908) - fix(model-management): allow deleting a BYOK model after its team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29875](https://github.com/BerriAI/litellm/pull/29875) - feat(jwt-auth): opt-in fallback to DB team on unresolved JWT claim by [@milan-berri](https://github.com/milan-berri) in [#28913](https://github.com/BerriAI/litellm/pull/28913) - fix(team\_endpoints): don't block /team/update on unchanged team budget by [@milan-berri](https://github.com/milan-berri) in [#29525](https://github.com/BerriAI/litellm/pull/29525) - fix(fireworks): enable tool calling for glm-5p1 in model cost map by [@milan-berri](https://github.com/milan-berri) in [#29697](https://github.com/BerriAI/litellm/pull/29697) - fix(vertex): propagate Vertex AI metadata in streaming success callbacks by [@Sameerlite](https://github.com/Sameerlite) in [#29899](https://github.com/BerriAI/litellm/pull/29899) - fix(ui): show team projects to internal users on key creation by [@milan-berri](https://github.com/milan-berri) in [#28855](https://github.com/BerriAI/litellm/pull/28855) - build(deps): bump pyjwt to 2.13.0 and ws override to 8.20.1 by [@yuneng-berri](https://github.com/yuneng-berri) in [#29982](https://github.com/BerriAI/litellm/pull/29982) - fix(team-management): delete a team's BYOK models when the team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29977](https://github.com/BerriAI/litellm/pull/29977) - feat(vantage): include organization metadata in FOCUS Tags export by [@milan-berri](https://github.com/milan-berri) in [#28184](https://github.com/BerriAI/litellm/pull/28184) - fix(guardrails): read CrowdStrike AIDR identity from both metadata bags by [@yuneng-berri](https://github.com/yuneng-berri) in [#29991](https://github.com/BerriAI/litellm/pull/29991) - fix(mcp): mirror upstream token lifetime instead of forcing a 1h OBO expiry by [@tin-berri](https://github.com/tin-berri) in [#29951](https://github.com/BerriAI/litellm/pull/29951) - feat(azure\_ai): add MAI-Image-2.5 image generation support by [@Sameerlite](https://github.com/Sameerlite) in [#29688](https://github.com/BerriAI/litellm/pull/29688) - fix(mcp): load MCP tool configuration tools via the OBO/passthrough-aware GET path by [@tin-berri](https://github.com/tin-berri) in [#29960](https://github.com/BerriAI/litellm/pull/29960) - fix(team): reserve team budget raises for proxy admins on /team/update by [@milan-berri](https://github.com/milan-berri) in [#30030](https://github.com/BerriAI/litellm/pull/30030) - test(ui): data-driven App Router migration E2E smoke (default + server-root-path) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29974](https://github.com/BerriAI/litellm/pull/29974) - fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through by [@michelligabriele](https://github.com/michelligabriele) in [#24232](https://github.com/BerriAI/litellm/pull/24232) - chore(ui): remove dead App Router route stubs under (dashboard) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30045](https://github.com/BerriAI/litellm/pull/30045) - fix(ui/mcp): reset OAuth state on create-server modal close so a prior server's token no longer leaks into the next add-server session by [@tin-berri](https://github.com/tin-berri) in [#30000](https://github.com/BerriAI/litellm/pull/30000) - fix(mcp): allow team access-group grants in OAuth authorize/token access check by [@tin-berri](https://github.com/tin-berri) in [#30041](https://github.com/BerriAI/litellm/pull/30041) - docs(security): require a reproduction video for vulnerability reports by [@yuneng-berri](https://github.com/yuneng-berri) in [#30063](https://github.com/BerriAI/litellm/pull/30063) - feat(ui): add admin flag to disable in-product UI nudges for everyone by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29796](https://github.com/BerriAI/litellm/pull/29796) - chore(ui): remove dead dashboard files and unused dependencies by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30047](https://github.com/BerriAI/litellm/pull/30047) - fix(proxy): authorize batch files using upload target\_model\_names (LIT-3593) by [@Sameerlite](https://github.com/Sameerlite) in [#30009](https://github.com/BerriAI/litellm/pull/30009) - Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI by [@mateo-berri](https://github.com/mateo-berri) in [#30064](https://github.com/BerriAI/litellm/pull/30064) - Add Claude Fable 5 cost map entries (data-only hotfix for the hosted map) by [@mateo-berri](https://github.com/mateo-berri) in [#30076](https://github.com/BerriAI/litellm/pull/30076) - fix(caching): restore stored prompt\_tokens on embedding cache hits instead of recomputing by [@michelligabriele](https://github.com/michelligabriele) in [#30046](https://github.com/BerriAI/litellm/pull/30046) - Litellm oss 090626 by [@Sameerlite](https://github.com/Sameerlite) in [#30021](https://github.com/BerriAI/litellm/pull/30021) - fix(proxy): self-heal startup/reload prisma reads on engine disconnect by [@michelligabriele](https://github.com/michelligabriele) in [#28803](https://github.com/BerriAI/litellm/pull/28803) - chore(ui): make knip recognize .mjs scripts and openapi-typescript by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30052](https://github.com/BerriAI/litellm/pull/30052) - fix(register\_model): preserve built-in cache pricing when registering custom overrides under unmapped keys by [@yassin-berriai](https://github.com/yassin-berriai) in [#30044](https://github.com/BerriAI/litellm/pull/30044) - \[internal copy of [#28007](https://github.com/BerriAI/litellm/issues/28007)] Fix/gcp model garden streaming by [@mateo-berri](https://github.com/mateo-berri) in [#28363](https://github.com/BerriAI/litellm/pull/28363) - feat(cli): per-agent `lite claude` / `codex` / `opencode` commands that wrap coding agents through the proxy by [@mateo-berri](https://github.com/mateo-berri) in [#29850](https://github.com/BerriAI/litellm/pull/29850) - fix(callbacks): forward callback\_settings to callback initializers and guard consumers against non-dict values by [@yuneng-berri](https://github.com/yuneng-berri) in [#30161](https://github.com/BerriAI/litellm/pull/30161) - fix(mcp): drop orphaned per-user credential rows when an MCP server is deleted by [@tin-berri](https://github.com/tin-berri) in [#30141](https://github.com/BerriAI/litellm/pull/30141) - fix(proxy): recover from cached-plan errors by reconnecting the Prisma client by [@yassin-berriai](https://github.com/yassin-berriai) in [#29983](https://github.com/BerriAI/litellm/pull/29983) - feat(proxy): add option to disable server-side prepared statements for DB lookups by [@yassin-berriai](https://github.com/yassin-berriai) in [#29984](https://github.com/BerriAI/litellm/pull/29984) - fix(release): stop backport releases from overwriting the latest badge by [@yuneng-berri](https://github.com/yuneng-berri) in [#30005](https://github.com/BerriAI/litellm/pull/30005) - feat: add conventional commits and coding guidelines by [@mateo-berri](https://github.com/mateo-berri) in [#30159](https://github.com/BerriAI/litellm/pull/30159) - fix(proxy): return 5xx on DB infra errors during auth; reserve 401 for genuine auth failures by [@yassin-berriai](https://github.com/yassin-berriai) in [#29986](https://github.com/BerriAI/litellm/pull/29986) - fix(ui): dev server 404s on migrated-page links because uiBase hardcodes /ui by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30169](https://github.com/BerriAI/litellm/pull/30169) - refactor(ui): consolidate dashboard to one shell in the (dashboard) layout by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30166](https://github.com/BerriAI/litellm/pull/30166) - fix(proxy): align /v1/model/info with router deployments by [@Sameerlite](https://github.com/Sameerlite) in [#30025](https://github.com/BerriAI/litellm/pull/30025) - fix: completion\_cost AttributeError on streaming Anthropic web\_search responses ([#26153](https://github.com/BerriAI/litellm/issues/26153)) by [@ishaan-berri](https://github.com/ishaan-berri) in [#27346](https://github.com/BerriAI/litellm/pull/27346) - \[internal copy of [#30137](https://github.com/BerriAI/litellm/issues/30137)] perf(realtime): eliminate redundant per-frame JSON work on OpenAI realtime relay by [@mateo-berri](https://github.com/mateo-berri) in [#30142](https://github.com/BerriAI/litellm/pull/30142) - feat(bedrock): aws\_bedrock\_project\_id for bedrock-mantle project / workspace association by [@mateo-berri](https://github.com/mateo-berri) in [#30163](https://github.com/BerriAI/litellm/pull/30163) - chore(hooks): enforce Conventional Commits and Conventional Branches by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30174](https://github.com/BerriAI/litellm/pull/30174) - feat(rate-limiter): allow opting out of v3 TPM reservation and Redis circuit breaker by [@yassin-berriai](https://github.com/yassin-berriai) in [#30211](https://github.com/BerriAI/litellm/pull/30211) - feat(spend\_logs): opt-in native Postgres partitioning for SpendLogs retention by [@yassin-berriai](https://github.com/yassin-berriai) in [#29466](https://github.com/BerriAI/litellm/pull/29466) - feat(ui): migrate playground to path routing and colocate its files by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30185](https://github.com/BerriAI/litellm/pull/30185) - feat(ui): migrate projects and access-groups to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30226](https://github.com/BerriAI/litellm/pull/30226) - fix(proxy): coalesce NULL rollup metrics in aggregated daily-activity by [@michelligabriele](https://github.com/michelligabriele) in [#30151](https://github.com/BerriAI/litellm/pull/30151) - fix(anthropic\_passthrough): resolve costing model from message\_start chunk, litellm\_params and model\_group instead of 'unknown' by [@yassin-berriai](https://github.com/yassin-berriai) in [#30160](https://github.com/BerriAI/litellm/pull/30160) - feat(ui): migrate budgets, workflows, and guardrails-monitor to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30236](https://github.com/BerriAI/litellm/pull/30236) - feat(ui): migrate mcp-servers, search-tools, tag-management, vector-stores, and memory to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30261](https://github.com/BerriAI/litellm/pull/30261) - fix(a2a): forward agent\_extra\_headers through completion bridge by [@mateo-berri](https://github.com/mateo-berri) in [#28277](https://github.com/BerriAI/litellm/pull/28277) - fix(gemini-live): forward audio buffer commit and correct Vertex PCM rate by [@Sameerlite](https://github.com/Sameerlite) in [#29946](https://github.com/BerriAI/litellm/pull/29946) - fix(proxy): skip double-wrapping unified batch output file ids on retrieve by [@Sameerlite](https://github.com/Sameerlite) in [#30011](https://github.com/BerriAI/litellm/pull/30011) - feat: litellm oss 110626 by [@Sameerlite](https://github.com/Sameerlite) in [#30202](https://github.com/BerriAI/litellm/pull/30202) - fix(docker): copy only runtime artifacts into the final image by [@yuneng-berri](https://github.com/yuneng-berri) in [#30243](https://github.com/BerriAI/litellm/pull/30243) - feat(proxy): enforce key/team guardrails on bedrock passthrough routes by [@Sameerlite](https://github.com/Sameerlite) in [#30194](https://github.com/BerriAI/litellm/pull/30194) - feat(gemini): forward web search tools in image generation by [@Sameerlite](https://github.com/Sameerlite) in [#30119](https://github.com/BerriAI/litellm/pull/30119) - fix: bedrock mantle fixes by [@Sameerlite](https://github.com/Sameerlite) in [#30083](https://github.com/BerriAI/litellm/pull/30083) - feat(proxy): add require\_managed\_files setting for file uploads by [@Sameerlite](https://github.com/Sameerlite) in [#30186](https://github.com/BerriAI/litellm/pull/30186) - fix(mcp): honor server\_id for REST tool calls with shared upstream URLs by [@Sameerlite](https://github.com/Sameerlite) in [#30184](https://github.com/BerriAI/litellm/pull/30184) - fix(responses): presidio PII masking for Azure WebSocket and streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30003](https://github.com/BerriAI/litellm/pull/30003) - feat(passthrough): add configurable pass-through request timeouts by [@Sameerlite](https://github.com/Sameerlite) in [#30266](https://github.com/BerriAI/litellm/pull/30266) - fix(google\_genai): preserve complete SSE events in Vertex/Gemini image streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30270](https://github.com/BerriAI/litellm/pull/30270) - fix(proxy): populate access\_via\_team\_ids on /v1/model/info by [@Sameerlite](https://github.com/Sameerlite) in [#30274](https://github.com/BerriAI/litellm/pull/30274) - chore(oss): litellm oss staging 120626 by [@Sameerlite](https://github.com/Sameerlite) in [#30292](https://github.com/BerriAI/litellm/pull/30292) - feat(ui): migrate policies, guardrails, prompts, tool-policies, and skills to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30263](https://github.com/BerriAI/litellm/pull/30263) - feat(ui): migrate caching, cost-tracking, transform-request, ui-theme, and logs to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30267](https://github.com/BerriAI/litellm/pull/30267) - fix(ui): gate dashboard layout on ui config load so deep links work under SERVER\_ROOT\_PATH by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30312](https://github.com/BerriAI/litellm/pull/30312) - feat(ui): migrate admin-panel, logging-and-alerts, model-hub-table, and usage to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30268](https://github.com/BerriAI/litellm/pull/30268) - fix(otel): cap metric attribute cardinality with include/exclude lists by [@yassin-berriai](https://github.com/yassin-berriai) in [#30257](https://github.com/BerriAI/litellm/pull/30257) - fix(proxy): grace-period key rotation 401s; return deprecated-key lookup result directly by [@yuneng-berri](https://github.com/yuneng-berri) in [#30327](https://github.com/BerriAI/litellm/pull/30327) - chore(deps): bump vitest, brace-expansion, pypdf and tornado by [@yuneng-berri](https://github.com/yuneng-berri) in [#30220](https://github.com/BerriAI/litellm/pull/30220) - refactor(ui): remove unreachable /chat page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30178](https://github.com/BerriAI/litellm/pull/30178) - feat(ui): migrate agents and router-settings to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30323](https://github.com/BerriAI/litellm/pull/30323) - feat: strengthen coding conventions in CLAUDE.md by [@mateo-berri](https://github.com/mateo-berri) in [#30333](https://github.com/BerriAI/litellm/pull/30333) - feat(ui): cut the users page over to the /ui/users path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30334](https://github.com/BerriAI/litellm/pull/30334) - feat: ruff strict-rule suppressions baseline gate by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30303](https://github.com/BerriAI/litellm/pull/30303) - feat(guardrails): add Cisco AI Defense integration ([#28249](https://github.com/BerriAI/litellm/issues/28249)) by [@yassin-berriai](https://github.com/yassin-berriai) in [#30338](https://github.com/BerriAI/litellm/pull/30338) - chore(ui): remove dead UI components unreferenced by any page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30340](https://github.com/BerriAI/litellm/pull/30340) - ci: add osv-scanner lockfile scan workflow by [@yuneng-berri](https://github.com/yuneng-berri) in [#30222](https://github.com/BerriAI/litellm/pull/30222) - fix(otel): record full error message on standard exception event in otel v2 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30380](https://github.com/BerriAI/litellm/pull/30380) - test(fireworks): mock whisper transcription tests instead of live calls by [@yuneng-berri](https://github.com/yuneng-berri) in [#30391](https://github.com/BerriAI/litellm/pull/30391) - build(ui): pin esbuild to 0.28.1 via overrides by [@yuneng-berri](https://github.com/yuneng-berri) in [#30390](https://github.com/BerriAI/litellm/pull/30390) - feat(ui): cut the organizations page over to the /ui/organizations path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30336](https://github.com/BerriAI/litellm/pull/30336) - fix(proxy): support SMTP implicit SSL (port 465) by [@yuneng-berri](https://github.com/yuneng-berri) in [#30395](https://github.com/BerriAI/litellm/pull/30395) - fix(mcp): default Linear MCP registry entry to streamable HTTP by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30396](https://github.com/BerriAI/litellm/pull/30396) - fix(ui): stop Virtual Keys page from infinite render loop by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30397](https://github.com/BerriAI/litellm/pull/30397) - fix(streaming): guard raise\_on\_model\_repetition against empty choices by [@shivamrawat1](https://github.com/shivamrawat1) in [#30485](https://github.com/BerriAI/litellm/pull/30485) - feat(otel-v2): emit the 6 gen\_ai.client.\* metrics at parity with v1 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30326](https://github.com/BerriAI/litellm/pull/30326) - fix(mcp): drop phantom 401 span on delegated OAuth2 tool calls by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30494](https://github.com/BerriAI/litellm/pull/30494) - feat(ui): cut the teams page over to the /ui/teams path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30343](https://github.com/BerriAI/litellm/pull/30343) - fix(integrations): cap Anthropic cache\_control injection at 4 blocks by [@shivamrawat1](https://github.com/shivamrawat1) in [#30480](https://github.com/BerriAI/litellm/pull/30480) - chore(codecov): add Batches, Videos, and Realtime components by [@Sameerlite](https://github.com/Sameerlite) in [#30517](https://github.com/BerriAI/litellm/pull/30517) - test(batches): move orphan tests into tests/test\_litellm for CI coverage by [@Sameerlite](https://github.com/Sameerlite) in [#30510](https://github.com/BerriAI/litellm/pull/30510) - fix(guardrails): run pre\_call hook once for model-level guardrails by [@yassin-berriai](https://github.com/yassin-berriai) in [#30543](https://github.com/BerriAI/litellm/pull/30543) - fix(guardrails): stop re-initializing DB guardrails on every poll by [@yassin-berriai](https://github.com/yassin-berriai) in [#30542](https://github.com/BerriAI/litellm/pull/30542) - chore(oss): litellm oss staging 150626 by [@Sameerlite](https://github.com/Sameerlite) in [#30463](https://github.com/BerriAI/litellm/pull/30463) - ci(lint): add blanket-noqa, dataclass-default, and unused-noqa Ruff rules by [@mateo-berri](https://github.com/mateo-berri) in [#30516](https://github.com/BerriAI/litellm/pull/30516) - ci: ratchet lint and type-check gates (ruff preview, ANN, mypy, basedpyright) by [@mateo-berri](https://github.com/mateo-berri) in [#30379](https://github.com/BerriAI/litellm/pull/30379) - fix(proxy): allow internal roles to access vector store CRUD routes by [@shivamrawat1](https://github.com/shivamrawat1) in [#30503](https://github.com/BerriAI/litellm/pull/30503) - fix(otel): stamp gen\_ai.input/output.messages on v2 spans by [@yassin-berriai](https://github.com/yassin-berriai) in [#30548](https://github.com/BerriAI/litellm/pull/30548) - fix(otel): export v2 gen\_ai client metrics to the configured meter provider by [@yassin-berriai](https://github.com/yassin-berriai) in [#30549](https://github.com/BerriAI/litellm/pull/30549) - fix(bedrock): preserve cache\_control for ARN models in /v1/messages adapter by [@mateo-berri](https://github.com/mateo-berri) in [#29823](https://github.com/BerriAI/litellm/pull/29823) - fix: greatly increase basedpyright slack by [@mateo-berri](https://github.com/mateo-berri) in [#30563](https://github.com/BerriAI/litellm/pull/30563) - fix(budget): recompute budget\_reset\_at when budget\_duration changes on /budget/update by [@yassin-berriai](https://github.com/yassin-berriai) in [#30555](https://github.com/BerriAI/litellm/pull/30555) - fix(otel): accept UPPER\_SNAKE\_CASE OTEL\_INSTRUMENTATION\_GENAI\_CAPTURE\_MESSAGE\_CONTENT in v2 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30562](https://github.com/BerriAI/litellm/pull/30562) - chore(lint): remove PLR0915 too-many-statements ruff rule by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30574](https://github.com/BerriAI/litellm/pull/30574) - ci(lint): ratcheted type-discipline gate (mutable collections, casts, guards, kwargs, suppressions) by [@mateo-berri](https://github.com/mateo-berri) in [#30500](https://github.com/BerriAI/litellm/pull/30500) - feat(proxy): add verification\_uri\_complete to CLI SSO device flow by [@yassin-berriai](https://github.com/yassin-berriai) in [#30571](https://github.com/BerriAI/litellm/pull/30571) - chore: litellm oss staging160626 by [@Sameerlite](https://github.com/Sameerlite) in [#30527](https://github.com/BerriAI/litellm/pull/30527) - fix(guardrails): return 400 not 500 when AIM blocks a request by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30573](https://github.com/BerriAI/litellm/pull/30573) - ci(lint): grandfather any-discipline with a per-file ratchet budget (50% headroom) by [@mateo-berri](https://github.com/mateo-berri) in [#30582](https://github.com/BerriAI/litellm/pull/30582) - fix(audio): don't override explicit response\_format with verbose\_json by [@mateo-berri](https://github.com/mateo-berri) in [#30599](https://github.com/BerriAI/litellm/pull/30599) - fix(anthropic): price and surface response service\_tier in cost tracking by [@mateo-berri](https://github.com/mateo-berri) in [#30558](https://github.com/BerriAI/litellm/pull/30558) - feat: add dev and wildcard proxy configs for local testing by [@mateo-berri](https://github.com/mateo-berri) in [#30556](https://github.com/BerriAI/litellm/pull/30556) - fix(proxy): list public team model name in /v1/models by [@ishaan-berri](https://github.com/ishaan-berri) in [#30588](https://github.com/BerriAI/litellm/pull/30588) - ci: drop mypy entirely, standardize type checking on basedpyright by [@mateo-berri](https://github.com/mateo-berri) in [#30648](https://github.com/BerriAI/litellm/pull/30648) - feat(guardrails): surface OpenAI moderation violation\_categories on guardrail traces by [@yassin-berriai](https://github.com/yassin-berriai) in [#30659](https://github.com/BerriAI/litellm/pull/30659) - fix(proxy): resolve list files credentials from team BYOK deployments by [@shivamrawat1](https://github.com/shivamrawat1) in [#30495](https://github.com/BerriAI/litellm/pull/30495) - feat(proxy): add --max\_requests\_before\_restart\_jitter to stagger worker restarts by [@yassin-berriai](https://github.com/yassin-berriai) in [#30601](https://github.com/BerriAI/litellm/pull/30601) - fix(health): correct bedrock embedding health checks by [@mateo-berri](https://github.com/mateo-berri) in [#30583](https://github.com/BerriAI/litellm/pull/30583) - test: harden remaining pass-through CI flakes (image-gen spend poll, ruby assistants timeout) by [@mateo-berri](https://github.com/mateo-berri) in [#30685](https://github.com/BerriAI/litellm/pull/30685) - test(pass\_through): harden vertex spendlog poll against transient empty reads by [@mateo-berri](https://github.com/mateo-berri) in [#30683](https://github.com/BerriAI/litellm/pull/30683) - fix(cost): stop non-string service\_tier from silently dropping cost tracking by [@mateo-berri](https://github.com/mateo-berri) in [#30690](https://github.com/BerriAI/litellm/pull/30690) - feat(proxy): warn at startup when custom\_auth skips common\_checks enforcement by [@tin-berri](https://github.com/tin-berri) in [#30665](https://github.com/BerriAI/litellm/pull/30665) - fix(pod\_lock): release cron lock by matching async\_set\_cache JSON encoding by [@yassin-berriai](https://github.com/yassin-berriai) in [#30600](https://github.com/BerriAI/litellm/pull/30600) - ci: run a local fake OpenAI endpoint instead of the shared Railway mock by [@mateo-berri](https://github.com/mateo-berri) in [#30695](https://github.com/BerriAI/litellm/pull/30695) - ci(windows): pin uv to Python 3.11 so it ignores the preinstalled 3.14 by [@mateo-berri](https://github.com/mateo-berri) in [#30704](https://github.com/BerriAI/litellm/pull/30704) - feat(ui): migrate models page to App Router path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30677](https://github.com/BerriAI/litellm/pull/30677) - refactor(ui): remove orphaned pass-through-settings route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30692](https://github.com/BerriAI/litellm/pull/30692) - fix(cost): stop non-string response service\_tier from dropping cost tracking by [@yuneng-berri](https://github.com/yuneng-berri) in [#30706](https://github.com/BerriAI/litellm/pull/30706) - feat(agent-shin): automated PR/issue triage, low-quality auto-close, and review-gate label lifecycle by [@mateo-berri](https://github.com/mateo-berri) in [#30433](https://github.com/BerriAI/litellm/pull/30433) - chore: litellm oss 170626 by [@Sameerlite](https://github.com/Sameerlite) in [#30637](https://github.com/BerriAI/litellm/pull/30637) - fix(bedrock\_mantle): add SigV4 fallback to chat completions auth by [@mateo-berri](https://github.com/mateo-berri) in [#30714](https://github.com/BerriAI/litellm/pull/30714) - feat(search): add TinyFish as search provider by [@simantak-dabhade](https://github.com/simantak-dabhade) in [#30634](https://github.com/BerriAI/litellm/pull/30634) - feat(ui): migrate old usage report to App Router path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30694](https://github.com/BerriAI/litellm/pull/30694) - fix(proxy): enforce budgets against authoritative DB spend when the cross-pod counter is stale by [@yassin-berriai](https://github.com/yassin-berriai) in [#30684](https://github.com/BerriAI/litellm/pull/30684) - chore(ci): remove Agent Shin pull\_request\_target workflows by [@yuneng-berri](https://github.com/yuneng-berri) in [#30784](https://github.com/BerriAI/litellm/pull/30784) - chore: litellm oss staging by [@Sameerlite](https://github.com/Sameerlite) in [#30745](https://github.com/BerriAI/litellm/pull/30745) - ci(zizmor): also run on litellm\_internal\_staging by [@yuneng-berri](https://github.com/yuneng-berri) in [#30789](https://github.com/BerriAI/litellm/pull/30789) - fix(test): drop references to removed Agent Shin workflows by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30791](https://github.com/BerriAI/litellm/pull/30791) - chore: remove in-product survey and Claude Code feedback nudges by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30773](https://github.com/BerriAI/litellm/pull/30773) - feat(ui): migrate api-keys landing to App Router path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30699](https://github.com/BerriAI/litellm/pull/30699) - feat(proxy): configurable response headers and login-page hint by [@yucheng-berri](https://github.com/yucheng-berri) in [#30792](https://github.com/BerriAI/litellm/pull/30792) - ci(zizmor): gate PRs on medium+ findings and clear existing ones by [@yuneng-berri](https://github.com/yuneng-berri) in [#30797](https://github.com/BerriAI/litellm/pull/30797) - fix(proxy): use e.request\_data for logging\_obj in ModifyResponseException streaming passthrough by [@mateo-berri](https://github.com/mateo-berri) in [#30800](https://github.com/BerriAI/litellm/pull/30800) - chore: make pr template linear portion clearer by [@mateo-berri](https://github.com/mateo-berri) in [#30766](https://github.com/BerriAI/litellm/pull/30766) - chore(typing): add boto3/botocore stubs so basedpyright resolves the AWS SDK by [@mateo-berri](https://github.com/mateo-berri) in [#30815](https://github.com/BerriAI/litellm/pull/30815) - fix(otel): one v2 logger owns the global provider; scope tenant OTLP creds per exporter by [@yucheng-berri](https://github.com/yucheng-berri) in [#30590](https://github.com/BerriAI/litellm/pull/30590) - fix(passthrough): recover output tokens for interrupted anthropic streams by [@yassin-berriai](https://github.com/yassin-berriai) in [#30787](https://github.com/BerriAI/litellm/pull/30787) - fix(proxy): record partial spend on the failure row for interrupted streams by [@yassin-berriai](https://github.com/yassin-berriai) in [#30788](https://github.com/BerriAI/litellm/pull/30788) - fix(ui): repoint dead usage guide link to cost tracking docs by [@yuneng-berri](https://github.com/yuneng-berri) in [#30859](https://github.com/BerriAI/litellm/pull/30859) - fix(ui): warn that team models are deleted in the delete-team modal by [@yuneng-berri](https://github.com/yuneng-berri) in [#29990](https://github.com/BerriAI/litellm/pull/29990) - feat(caching): add valkey-semantic cache backend and fix semantic cache scope keys by [@yassin-berriai](https://github.com/yassin-berriai) in [#30675](https://github.com/BerriAI/litellm/pull/30675) - test(ui): isolate OldTeams delete-warning tests from leaked mock by [@mateo-berri](https://github.com/mateo-berri) in [#30871](https://github.com/BerriAI/litellm/pull/30871) - feat: add lint-gate target and truncation-proof summary to the strict ruff gate by [@mateo-berri](https://github.com/mateo-berri) in [#30877](https://github.com/BerriAI/litellm/pull/30877) - chore(ui): rebuild ui for release by [@yuneng-berri](https://github.com/yuneng-berri) in [#30894](https://github.com/BerriAI/litellm/pull/30894) - chore(ci): bump deps by [@yuneng-berri](https://github.com/yuneng-berri) in [#30899](https://github.com/BerriAI/litellm/pull/30899) - fix(watsonx): wrap string embedding input in array for WatsonX API by [@shivamrawat1](https://github.com/shivamrawat1) in [#30897](https://github.com/BerriAI/litellm/pull/30897) - test: point router/completion/triton tests at the local fake OpenAI endpoint by [@mateo-berri](https://github.com/mateo-berri) in [#30900](https://github.com/BerriAI/litellm/pull/30900) - feat(sandbox): e2b code execution primitive by [@krrish-berri-2](https://github.com/krrish-berri-2) in [#30898](https://github.com/BerriAI/litellm/pull/30898) - fix(ui): source api-keys identity from useAuthorized to stop "User ID is not set" by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30903](https://github.com/BerriAI/litellm/pull/30903) - chore(ui): rebuild ui by [@yuneng-berri](https://github.com/yuneng-berri) in [#30906](https://github.com/BerriAI/litellm/pull/30906) - chore(ci): promote internal staging to main by [@yuneng-berri](https://github.com/yuneng-berri) in [#30907](https://github.com/BerriAI/litellm/pull/30907) - fix(redis): prevent forcing SSLConnection when ssl=False in connection pool by [@Jacopos311](https://github.com/Jacopos311) in [#30770](https://github.com/BerriAI/litellm/pull/30770) - fix(proxy): log UI setup failures instead of silently swallowing by [@sarvesh1327](https://github.com/sarvesh1327) in [#30819](https://github.com/BerriAI/litellm/pull/30819) ##### New Contributors - [@simantak-dabhade](https://github.com/simantak-dabhade) made their first contribution in [#30634](https://github.com/BerriAI/litellm/pull/30634) - [@Jacopos311](https://github.com/Jacopos311) made their first contribution in [#30770](https://github.com/BerriAI/litellm/pull/30770) - [@sarvesh1327](https://github.com/sarvesh1327) made their first contribution in [#30819](https://github.com/BerriAI/litellm/pull/30819) **Full Changelog**: <https://github.com/BerriAI/litellm/compare/v1.89.0...v1.90.0> ### [`v1.90.0`](https://github.com/BerriAI/litellm/releases/tag/v1.90.0) [Compare Source](https://github.com/BerriAI/litellm/compare/v1.89.4...v1.90.0) ##### Verify Docker Image Signature All LiteLLM Docker images are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). Every release is signed with the same key introduced in [commit `0112e53`](https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0). **Verify using the pinned commit hash (recommended):** A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` **Verify using the release tag (convenience):** Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.90.0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` Expected output: ``` The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key ``` *** ##### What's Changed - fix(responses-bridge): map system-only chat request to system input item by [@milan-berri](https://github.com/milan-berri) in [#29817](https://github.com/BerriAI/litellm/pull/29817) - feat(bedrock): forward strict and additionalProperties to Converse toolSpec by [@mateo-berri](https://github.com/mateo-berri) in [#29814](https://github.com/BerriAI/litellm/pull/29814) - fix(mcp): highlight MCP cards red when the logged-in user is missing per-user env vars by [@mateo-berri](https://github.com/mateo-berri) in [#29856](https://github.com/BerriAI/litellm/pull/29856) - feat(ui): add budget duration to edit team member form by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29717](https://github.com/BerriAI/litellm/pull/29717) - fix(ui): make workflow runs page fill full width by [@yuneng-berri](https://github.com/yuneng-berri) in [#29868](https://github.com/BerriAI/litellm/pull/29868) - feat: standardize rate limit errors with category, rate\_limit\_type, model, and llm\_provider fields by [@mateo-berri](https://github.com/mateo-berri) in [#27687](https://github.com/BerriAI/litellm/pull/27687) - fix(ui): default guardrails page to the Guardrails tab by [@yuneng-berri](https://github.com/yuneng-berri) in [#29872](https://github.com/BerriAI/litellm/pull/29872) - docs(readme): add Deploy on AWS/GCP Terraform section and fix deploy button rendering by [@mateo-berri](https://github.com/mateo-berri) in [#29879](https://github.com/BerriAI/litellm/pull/29879) - refactor(bedrock): build Converse toolSpec via a BedrockToolSpec dict subclass by [@mateo-berri](https://github.com/mateo-berri) in [#29869](https://github.com/BerriAI/litellm/pull/29869) - feat(litellm): add models and repository layers by [@yassin-berriai](https://github.com/yassin-berriai) in [#29686](https://github.com/BerriAI/litellm/pull/29686) - feat(ui): include internal routes in the dashboard's generated OpenAPI types by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29885](https://github.com/BerriAI/litellm/pull/29885) - feat(proxy): publish /v2/model/info in Swagger OpenAPI spec by [@Sameerlite](https://github.com/Sameerlite) in [#29900](https://github.com/BerriAI/litellm/pull/29900) - refactor(ui): single source of truth for migrated-page routing by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29949](https://github.com/BerriAI/litellm/pull/29949) - fix(ui/model-hub): render provider icons on the public model hub by [@yuneng-berri](https://github.com/yuneng-berri) in [#29958](https://github.com/BerriAI/litellm/pull/29958) - fix(ui): keep create guardrail modal open on outside click by [@yuneng-berri](https://github.com/yuneng-berri) in [#29871](https://github.com/BerriAI/litellm/pull/29871) - fix(ui): label default key type as "Full Access" on key edit page by [@yuneng-berri](https://github.com/yuneng-berri) in [#29870](https://github.com/BerriAI/litellm/pull/29870) - fix(ui): unify migrated-route URLs and migrate the API Reference page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29953](https://github.com/BerriAI/litellm/pull/29953) - fix(mcp): let non-creator users OAuth into OBO-mode MCP servers from the Tools page by [@tin-berri](https://github.com/tin-berri) in [#29867](https://github.com/BerriAI/litellm/pull/29867) - Litellm oss staging 080626 by [@Sameerlite](https://github.com/Sameerlite) in [#29932](https://github.com/BerriAI/litellm/pull/29932) - feat(galileo): add health check support for UI callback test by [@Sameerlite](https://github.com/Sameerlite) in [#29908](https://github.com/BerriAI/litellm/pull/29908) - fix(model-management): allow deleting a BYOK model after its team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29875](https://github.com/BerriAI/litellm/pull/29875) - feat(jwt-auth): opt-in fallback to DB team on unresolved JWT claim by [@milan-berri](https://github.com/milan-berri) in [#28913](https://github.com/BerriAI/litellm/pull/28913) - fix(team\_endpoints): don't block /team/update on unchanged team budget by [@milan-berri](https://github.com/milan-berri) in [#29525](https://github.com/BerriAI/litellm/pull/29525) - fix(fireworks): enable tool calling for glm-5p1 in model cost map by [@milan-berri](https://github.com/milan-berri) in [#29697](https://github.com/BerriAI/litellm/pull/29697) - fix(vertex): propagate Vertex AI metadata in streaming success callbacks by [@Sameerlite](https://github.com/Sameerlite) in [#29899](https://github.com/BerriAI/litellm/pull/29899) - fix(ui): show team projects to internal users on key creation by [@milan-berri](https://github.com/milan-berri) in [#28855](https://github.com/BerriAI/litellm/pull/28855) - build(deps): bump pyjwt to 2.13.0 and ws override to 8.20.1 by [@yuneng-berri](https://github.com/yuneng-berri) in [#29982](https://github.com/BerriAI/litellm/pull/29982) - fix(team-management): delete a team's BYOK models when the team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29977](https://github.com/BerriAI/litellm/pull/29977) - feat(vantage): include organization metadata in FOCUS Tags export by [@milan-berri](https://github.com/milan-berri) in [#28184](https://github.com/BerriAI/litellm/pull/28184) - fix(guardrails): read CrowdStrike AIDR identity from both metadata bags by [@yuneng-berri](https://github.com/yuneng-berri) in [#29991](https://github.com/BerriAI/litellm/pull/29991) - fix(mcp): mirror upstream token lifetime instead of forcing a 1h OBO expiry by [@tin-berri](https://github.com/tin-berri) in [#29951](https://github.com/BerriAI/litellm/pull/29951) - feat(azure\_ai): add MAI-Image-2.5 image generation support by [@Sameerlite](https://github.com/Sameerlite) in [#29688](https://github.com/BerriAI/litellm/pull/29688) - fix(mcp): load MCP tool configuration tools via the OBO/passthrough-aware GET path by [@tin-berri](https://github.com/tin-berri) in [#29960](https://github.com/BerriAI/litellm/pull/29960) - fix(team): reserve team budget raises for proxy admins on /team/update by [@milan-berri](https://github.com/milan-berri) in [#30030](https://github.com/BerriAI/litellm/pull/30030) - test(ui): data-driven App Router migration E2E smoke (default + server-root-path) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29974](https://github.com/BerriAI/litellm/pull/29974) - fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through by [@michelligabriele](https://github.com/michelligabriele) in [#24232](https://github.com/BerriAI/litellm/pull/24232) - chore(ui): remove dead App Router route stubs under (dashboard) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30045](https://github.com/BerriAI/litellm/pull/30045) - fix(ui/mcp): reset OAuth state on create-server modal close so a prior server's token no longer leaks into the next add-server session by [@tin-berri](https://github.com/tin-berri) in [#30000](https://github.com/BerriAI/litellm/pull/30000) - fix(mcp): allow team access-group grants in OAuth authorize/token access check by [@tin-berri](https://github.com/tin-berri) in [#30041](https://github.com/BerriAI/litellm/pull/30041) - docs(security): require a reproduction video for vulnerability reports by [@yuneng-berri](https://github.com/yuneng-berri) in [#30063](https://github.com/BerriAI/litellm/pull/30063) - feat(ui): add admin flag to disable in-product UI nudges for everyone by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29796](https://github.com/BerriAI/litellm/pull/29796) - chore(ui): remove dead dashboard files and unused dependencies by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30047](https://github.com/BerriAI/litellm/pull/30047) - fix(proxy): authorize batch files using upload target\_model\_names (LIT-3593) by [@Sameerlite](https://github.com/Sameerlite) in [#30009](https://github.com/BerriAI/litellm/pull/30009) - Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI by [@mateo-berri](https://github.com/mateo-berri) in [#30064](https://github.com/BerriAI/litellm/pull/30064) - Add Claude Fable 5 cost map entries (data-only hotfix for the hosted map) by [@mateo-berri](https://github.com/mateo-berri) in [#30076](https://github.com/BerriAI/litellm/pull/30076) - fix(caching): restore stored prompt\_tokens on embedding cache hits instead of recomputing by [@michelligabriele](https://github.com/michelligabriele) in [#30046](https://github.com/BerriAI/litellm/pull/30046) - Litellm oss 090626 by [@Sameerlite](https://github.com/Sameerlite) in [#30021](https://github.com/BerriAI/litellm/pull/30021) - fix(proxy): self-heal startup/reload prisma reads on engine disconnect by [@michelligabriele](https://github.com/michelligabriele) in [#28803](https://github.com/BerriAI/litellm/pull/28803) - chore(ui): make knip recognize .mjs scripts and openapi-typescript by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30052](https://github.com/BerriAI/litellm/pull/30052) - fix(register\_model): preserve built-in cache pricing when registering custom overrides under unmapped keys by [@yassin-berriai](https://github.com/yassin-berriai) in [#30044](https://github.com/BerriAI/litellm/pull/30044) - \[internal copy of [#28007](https://github.com/BerriAI/litellm/issues/28007)] Fix/gcp model garden streaming by [@mateo-berri](https://github.com/mateo-berri) in [#28363](https://github.com/BerriAI/litellm/pull/28363) - feat(cli): per-agent `lite claude` / `codex` / `opencode` commands that wrap coding agents through the proxy by [@mateo-berri](https://github.com/mateo-berri) in [#29850](https://github.com/BerriAI/litellm/pull/29850) - fix(callbacks): forward callback\_settings to callback initializers and guard consumers against non-dict values by [@yuneng-berri](https://github.com/yuneng-berri) in [#30161](https://github.com/BerriAI/litellm/pull/30161) - fix(mcp): drop orphaned per-user credential rows when an MCP server is deleted by [@tin-berri](https://github.com/tin-berri) in [#30141](https://github.com/BerriAI/litellm/pull/30141) - fix(proxy): recover from cached-plan errors by reconnecting the Prisma client by [@yassin-berriai](https://github.com/yassin-berriai) in [#29983](https://github.com/BerriAI/litellm/pull/29983) - feat(proxy): add option to disable server-side prepared statements for DB lookups by [@yassin-berriai](https://github.com/yassin-berriai) in [#29984](https://github.com/BerriAI/litellm/pull/29984) - fix(release): stop backport releases from overwriting the latest badge by [@yuneng-berri](https://github.com/yuneng-berri) in [#30005](https://github.com/BerriAI/litellm/pull/30005) - feat: add conventional commits and coding guidelines by [@mateo-berri](https://github.com/mateo-berri) in [#30159](https://github.com/BerriAI/litellm/pull/30159) - fix(proxy): return 5xx on DB infra errors during auth; reserve 401 for genuine auth failures by [@yassin-berriai](https://github.com/yassin-berriai) in [#29986](https://github.com/BerriAI/litellm/pull/29986) - fix(ui): dev server 404s on migrated-page links because uiBase hardcodes /ui by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30169](https://github.com/BerriAI/litellm/pull/30169) - refactor(ui): consolidate dashboard to one shell in the (dashboard) layout by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30166](https://github.com/BerriAI/litellm/pull/30166) - fix(proxy): align /v1/model/info with router deployments by [@Sameerlite](https://github.com/Sameerlite) in [#30025](https://github.com/BerriAI/litellm/pull/30025) - fix: completion\_cost AttributeError on streaming Anthropic web\_search responses ([#26153](https://github.com/BerriAI/litellm/issues/26153)) by [@ishaan-berri](https://github.com/ishaan-berri) in [#27346](https://github.com/BerriAI/litellm/pull/27346) - \[internal copy of [#30137](https://github.com/BerriAI/litellm/issues/30137)] perf(realtime): eliminate redundant per-frame JSON work on OpenAI realtime relay by [@mateo-berri](https://github.com/mateo-berri) in [#30142](https://github.com/BerriAI/litellm/pull/30142) - feat(bedrock): aws\_bedrock\_project\_id for bedrock-mantle project / workspace association by [@mateo-berri](https://github.com/mateo-berri) in [#30163](https://github.com/BerriAI/litellm/pull/30163) - chore(hooks): enforce Conventional Commits and Conventional Branches by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30174](https://github.com/BerriAI/litellm/pull/30174) - feat(rate-limiter): allow opting out of v3 TPM reservation and Redis circuit breaker by [@yassin-berriai](https://github.com/yassin-berriai) in [#30211](https://github.com/BerriAI/litellm/pull/30211) - feat(spend\_logs): opt-in native Postgres partitioning for SpendLogs retention by [@yassin-berriai](https://github.com/yassin-berriai) in [#29466](https://github.com/BerriAI/litellm/pull/29466) - feat(ui): migrate playground to path routing and colocate its files by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30185](https://github.com/BerriAI/litellm/pull/30185) - feat(ui): migrate projects and access-groups to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30226](https://github.com/BerriAI/litellm/pull/30226) - fix(proxy): coalesce NULL rollup metrics in aggregated daily-activity by [@michelligabriele](https://github.com/michelligabriele) in [#30151](https://github.com/BerriAI/litellm/pull/30151) - fix(anthropic\_passthrough): resolve costing model from message\_start chunk, litellm\_params and model\_group instead of 'unknown' by [@yassin-berriai](https://github.com/yassin-berriai) in [#30160](https://github.com/BerriAI/litellm/pull/30160) - feat(ui): migrate budgets, workflows, and guardrails-monitor to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30236](https://github.com/BerriAI/litellm/pull/30236) - feat(ui): migrate mcp-servers, search-tools, tag-management, vector-stores, and memory to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30261](https://github.com/BerriAI/litellm/pull/30261) - fix(a2a): forward agent\_extra\_headers through completion bridge by [@mateo-berri](https://github.com/mateo-berri) in [#28277](https://github.com/BerriAI/litellm/pull/28277) - fix(gemini-live): forward audio buffer commit and correct Vertex PCM rate by [@Sameerlite](https://github.com/Sameerlite) in [#29946](https://github.com/BerriAI/litellm/pull/29946) - fix(proxy): skip double-wrapping unified batch output file ids on retrieve by [@Sameerlite](https://github.com/Sameerlite) in [#30011](https://github.com/BerriAI/litellm/pull/30011) - feat: litellm oss 110626 by [@Sameerlite](https://github.com/Sameerlite) in [#30202](https://github.com/BerriAI/litellm/pull/30202) - fix(docker): copy only runtime artifacts into the final image by [@yuneng-berri](https://github.com/yuneng-berri) in [#30243](https://github.com/BerriAI/litellm/pull/30243) - feat(proxy): enforce key/team guardrails on bedrock passthrough routes by [@Sameerlite](https://github.com/Sameerlite) in [#30194](https://github.com/BerriAI/litellm/pull/30194) - feat(gemini): forward web search tools in image generation by [@Sameerlite](https://github.com/Sameerlite) in [#30119](https://github.com/BerriAI/litellm/pull/30119) - fix: bedrock mantle fixes by [@Sameerlite](https://github.com/Sameerlite) in [#30083](https://github.com/BerriAI/litellm/pull/30083) - feat(proxy): add require\_managed\_files setting for file uploads by [@Sameerlite](https://github.com/Sameerlite) in [#30186](https://github.com/BerriAI/litellm/pull/30186) - fix(mcp): honor server\_id for REST tool calls with shared upstream URLs by [@Sameerlite](https://github.com/Sameerlite) in [#30184](https://github.com/BerriAI/litellm/pull/30184) - fix(responses): presidio PII masking for Azure WebSocket and streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30003](https://github.com/BerriAI/litellm/pull/30003) - feat(passthrough): add configurable pass-through request timeouts by [@Sameerlite](https://github.com/Sameerlite) in [#30266](https://github.com/BerriAI/litellm/pull/30266) - fix(google\_genai): preserve complete SSE events in Vertex/Gemini image streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30270](https://github.com/BerriAI/litellm/pull/30270) - fix(proxy): populate access\_via\_team\_ids on /v1/model/info by [@Sameerlite](https://github.com/Sameerlite) in [#30274](https://github.com/BerriAI/litellm/pull/30274) - chore(oss): litellm oss staging 120626 by [@Sameerlite](https://github.com/Sameerlite) in [#30292](https://github.com/BerriAI/litellm/pull/30292) - feat(ui): migrate policies, guardrails, prompts, tool-policies, and skills to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30263](https://github.com/BerriAI/litellm/pull/30263) - feat(ui): migrate caching, cost-tracking, transform-request, ui-theme, and logs to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30267](https://github.com/BerriAI/litellm/pull/30267) - fix(ui): gate dashboard layout on ui config load so deep links work under SERVER\_ROOT\_PATH by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30312](https://github.com/BerriAI/litellm/pull/30312) - feat(ui): migrate admin-panel, logging-and-alerts, model-hub-table, and usage to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30268](https://github.com/BerriAI/litellm/pull/30268) - fix(otel): cap metric attribute cardinality with include/exclude lists by [@yassin-berriai](https://github.com/yassin-berriai) in [#30257](https://github.com/BerriAI/litellm/pull/30257) - fix(proxy): grace-period key rotation 401s; return deprecated-key lookup result directly by [@yuneng-berri](https://github.com/yuneng-berri) in [#30327](https://github.com/BerriAI/litellm/pull/30327) - chore(deps): bump vitest, brace-expansion, pypdf and tornado by [@yuneng-berri](https://github.com/yuneng-berri) in [#30220](https://github.com/BerriAI/litellm/pull/30220) - refactor(ui): remove unreachable /chat page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30178](https://github.com/BerriAI/litellm/pull/30178) - feat(ui): migrate agents and router-settings to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30323](https://github.com/BerriAI/litellm/pull/30323) - feat: strengthen coding conventions in CLAUDE.md by [@mateo-berri](https://github.com/mateo-berri) in [#30333](https://github.com/BerriAI/litellm/pull/30333) - feat(ui): cut the users page over to the /ui/users path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30334](https://github.com/BerriAI/litellm/pull/30334) - feat: ruff strict-rule suppressions baseline gate by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30303](https://github.com/BerriAI/litellm/pull/30303) - feat(guardrails): add Cisco AI Defense integration ([#28249](https://github.com/BerriAI/litellm/issues/28249)) by [@yassin-berriai](https://github.com/yassin-berriai) in [#30338](https://github.com/BerriAI/litellm/pull/30338) - chore(ui): remove dead UI components unreferenced by any page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30340](https://github.com/BerriAI/litellm/pull/30340) - ci: add osv-scanner lockfile scan workflow by [@yuneng-berri](https://github.com/yuneng-berri) in [#30222](https://github.com/BerriAI/litellm/pull/30222) - fix(otel): record full error message on standard exception event in otel v2 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30380](https://github.com/BerriAI/litellm/pull/30380) - test(fireworks): mock whisper transcription tests instead of live calls by [@yuneng-berri](https://github.com/yuneng-berri) in [#30391](https://github.com/BerriAI/litellm/pull/30391) - build(ui): pin esbuild to 0.28.1 via overrides by [@yuneng-berri](https://github.com/yuneng-berri) in [#30390](https://github.com/BerriAI/litellm/pull/30390) - feat(ui): cut the organizations page over to the /ui/organizations path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30336](https://github.com/BerriAI/litellm/pull/30336) - fix(proxy): support SMTP implicit SSL (port 465) by [@yuneng-berri](https://github.com/yuneng-berri) in [#30395](https://github.com/BerriAI/litellm/pull/30395) - fix(mcp): default Linear MCP registry entry to streamable HTTP by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30396](https://github.com/BerriAI/litellm/pull/30396) - fix(ui): stop Virtual Keys page from infinite render loop by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30397](https://github.com/BerriAI/litellm/pull/30397) - fix(streaming): guard raise\_on\_model\_repetition against empty choices by [@shivamrawat1](https://github.com/shivamrawat1) in [#30485](https://github.com/BerriAI/litellm/pull/30485) - feat(otel-v2): emit the 6 gen\_ai.client.\* metrics at parity with v1 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30326](https://github.com/BerriAI/litellm/pull/30326) - fix(mcp): drop phantom 401 span on delegated OAuth2 tool calls by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30494](https://github.com/BerriAI/litellm/pull/30494) - feat(ui): cut the teams page over to the /ui/teams path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30343](https://github.com/BerriAI/litellm/pull/30343) - fix(integrations): cap Anthropic cache\_control injection at 4 blocks by [@shivamrawat1](https://github.com/shivamrawat1) in [#30480](https://github.com/BerriAI/litellm/pull/30480) - chore(codecov): add Batches, Videos, and Realtime components by [@Sameerlite](https://github.com/Sameerlite) in [#30517](https://github.com/BerriAI/litellm/pull/30517) - test(batches): move orphan tests into tests/test\_litellm for CI coverage by [@Sameerlite](https://github.com/Sameerlite) in [#30510](https://github.com/BerriAI/litellm/pull/30510) - fix(guardrails): run pre\_call hook once for model-level guardrails by [@yassin-berriai](https://github.com/yassin-berriai) in [#30543](http…

greptile-apps Bot reviewed Jun 8, 2026

View reviewed changes

Comment thread litellm/proxy/auth/auth_exception_handler.py

Comment thread litellm/proxy/db/exception_handler.py

yassin-berriai force-pushed the litellm_fix/db-error-returns-503-not-401 branch from 5e95927 to d4db3ce Compare June 8, 2026 23:58

yuneng-berri approved these changes Jun 10, 2026

View reviewed changes

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

2b80a45

…r genuine auth failures

yassin-berriai force-pushed the litellm_fix/db-error-returns-503-not-401 branch from 4917f83 to 2b80a45 Compare June 10, 2026 22:53

yassin-berriai enabled auto-merge (squash) June 10, 2026 23:07

yassin-berriai merged commit da9d64b into litellm_internal_staging Jun 10, 2026
119 of 120 checks passed

yassin-berriai deleted the litellm_fix/db-error-returns-503-not-401 branch June 10, 2026 23:48

yuneng-berri mentioned this pull request Jun 13, 2026

chore(release): backport #27319, #27756, #27921, #28395, #29983, #29984, #29986, #30160, #30327 to stable/1.84.x and cut 1.84.8 #30332

Merged

mateo-berri added a commit that referenced this pull request Jun 13, 2026

Merge pull request #30332 from BerriAI/litellm_backport_1_84_x_0612

34e9d7d

chore(release): backport #27319, #27756, #27921, #28395, #29983, #29984, #29986, #30160, #30327 to stable/1.84.x and cut 1.84.8

yuneng-berri added a commit that referenced this pull request Jun 14, 2026

Merge pull request #30405 from BerriAI/litellm_backport_1_87_x_0613

5c8b847

chore(release): backport #29493, #29983, #29984, #29986, #30160, #30202, #30327, #30220 to stable/1.87.x and cut 1.87.3

This was referenced Jun 14, 2026

chore(release): backport DB-resilience, passthrough, model-info, budget, and deps fixes to stable/1.88.x #30408

Merged

chore(release): backport 1.84.8 patch set + MCP/model-info/DB fixes to stable/1.89.x and cut 1.89.1 #30502

Merged

mrgizmo212 pushed a commit to ttgaillc/ttginf that referenced this pull request Jun 16, 2026

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

b337b63

…r genuine auth failures (BerriAI#29986) (cherry picked from commit da9d64b)

michaelxer pushed a commit to michaelxer/litellm that referenced this pull request Jun 17, 2026

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

bde085f

…r genuine auth failures (BerriAI#29986)

michaelxer pushed a commit to michaelxer/litellm that referenced this pull request Jun 17, 2026

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

90d73c8

…r genuine auth failures (BerriAI#29986)

koladefaj pushed a commit to koladefaj/litellm that referenced this pull request Jun 17, 2026

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

72d4d2c

…r genuine auth failures (BerriAI#29986)

factnn pushed a commit to factnn/litellm that referenced this pull request Jun 18, 2026

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

6ba08ff

…r genuine auth failures (BerriAI#29986)

marioleonardo pushed a commit to marioleonardo/litellm-mongodb-patched that referenced this pull request Jun 19, 2026

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

c3f1b37

…r genuine auth failures (BerriAI#29986) (cherry picked from commit da9d64b)

fzowl pushed a commit to fzowl/litellm that referenced this pull request Jun 24, 2026

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 fo…

38c9df5

…r genuine auth failures (BerriAI#29986)

ishaan-berri mentioned this pull request Jun 25, 2026

LiteLLM Stability Sprint Roadmap #30484

Open

13 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 for genuine auth failures#29986

fix(proxy): return 5xx on DB infra errors during auth; reserve 401 for genuine auth failures#29986
yassin-berriai merged 1 commit into
litellm_internal_stagingfrom
litellm_fix/db-error-returns-503-not-401

yassin-berriai commented Jun 8, 2026 •

edited

Loading

Uh oh!

yassin-berriai commented Jun 8, 2026

Uh oh!

CLAassistant commented Jun 8, 2026

Uh oh!

codecov Bot commented Jun 8, 2026 •

edited

Loading

Uh oh!

greptile-apps Bot commented Jun 8, 2026 •

edited

Loading

Important Files Changed

Uh oh!

greptile-apps Bot Jun 8, 2026

Uh oh!

greptile-apps Bot commented Jun 8, 2026

Important Files Changed

Uh oh!

Uh oh!

Uh oh!

yassin-berriai commented Jun 8, 2026

Uh oh!

yassin-berriai commented Jun 9, 2026

Uh oh!

yassin-berriai commented Jun 10, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Uh oh!

Conversation

yassin-berriai commented Jun 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Relevant issues

Linear ticket

Pre-Submission checklist

CI (LiteLLM team)

Screenshots / Proof of Fix

Follow-up: first-request-of-the-outage edge case

Type

Changes

Uh oh!

yassin-berriai commented Jun 8, 2026

Uh oh!

CLAassistant commented Jun 8, 2026

Uh oh!

codecov Bot commented Jun 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

greptile-apps Bot commented Jun 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Greptile Summary

Confidence Score: 5/5

Important Files Changed

Uh oh!

greptile-apps Bot Jun 8, 2026

Choose a reason for hiding this comment

Uh oh!

greptile-apps Bot commented Jun 8, 2026

Greptile Summary

Confidence Score: 4/5

Important Files Changed

Uh oh!

Uh oh!

Uh oh!

yassin-berriai commented Jun 8, 2026

Uh oh!

yassin-berriai commented Jun 9, 2026

Uh oh!

yassin-berriai commented Jun 10, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

yassin-berriai commented Jun 8, 2026 •

edited

Loading

codecov Bot commented Jun 8, 2026 •

edited

Loading

greptile-apps Bot commented Jun 8, 2026 •

edited

Loading