feat(bedrock): aws_bedrock_project_id for bedrock-mantle project / workspace association by mateo-berri · Pull Request #30163 · BerriAI/litellm

mateo-berri · 2026-06-10T21:50:34Z

Relevant issues

Fixes #30070

Linear ticket

n/a

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

I have added meaningful tests
My PR passes all unit tests on make test-unit (ran tests/test_litellm/llms/bedrock/, tests/test_litellm/llms/bedrock_mantle/, tests/test_litellm/test_utils.py and tests/test_litellm/proxy/auth/test_auth_utils.py; 988 + 203 passed)
My PR's scope is as isolated as possible; it only solves 1 specific problem
I have requested a Greptile review by commenting @greptileai and received a Confidence Score of at least 4/5 before requesting a maintainer review (Greptile scored 4/5; its one P2 style note is answered inline)

Delays in PR merge?

If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review).

CI (LiteLLM team)

Branch creation CI run
Link:
CI run for the last commit
Link:
Merge / cherry-pick CI run
Links:

Screenshots / Proof of Fix

AWS associates an inference request with a Bedrock project through a header on the bedrock-mantle endpoint: OpenAI-Project: {project-id} on the OpenAI-compatible APIs (Projects docs) and anthropic-workspace: {project-id} on the Anthropic Messages API (Workspaces docs); projects and workspaces are the same resource. Setting data_retention.mode on a project is how you opt a single workload into provider_data_share for models like Claude Fable 5 while the account stays on default (Data retention docs)

The account used for this proof reproduces the issue exactly; Fable 5 is unavailable under the account default retention mode:

$ curl -sS "https://bedrock-mantle.us-east-1.api.aws/v1/models" -H "Authorization: Bearer $AWS_BEARER_TOKEN_BEDROCK" \
    | python3 -c "import json,sys; [print(json.dumps(m)) for m in json.load(sys.stdin)['data'] if m['id']=='anthropic.claude-fable-5']"
{"created": 1780272000, "data_retention": {"allowed_modes": ["provider_data_share"], "mode": "default", "source": "model_default"}, "id": "anthropic.claude-fable-5", "object": "model", "owned_by": "system", "status": "unavailable", "status_reason": "This model is not available under data retention mode 'default'."}

The test key is a long-term Bedrock API key, which by default cannot create projects or change retention (bedrock-mantle:CreateProject denied), so the proof uses the account's default project for the happy path and a nonexistent project id for the negative path. The negative path is the important one; AWS rejecting the request with the project ARN proves LiteLLM transmitted the header end to end

Proxy config:

model_list:
  - model_name: gpt-oss-default-project
    litellm_params:
      model: bedrock_mantle/openai.gpt-oss-20b
      api_key: os.environ/AWS_BEARER_TOKEN_BEDROCK
      aws_bedrock_project_id: default
  - model_name: gpt-oss-bad-project
    litellm_params:
      model: bedrock_mantle/openai.gpt-oss-20b
      api_key: os.environ/AWS_BEARER_TOKEN_BEDROCK
      aws_bedrock_project_id: proj_doesnotexist000000
  - model_name: haiku-mantle-default-workspace
    litellm_params:
      model: bedrock/mantle/anthropic.claude-haiku-4-5
      aws_region_name: us-east-1
      aws_bedrock_project_id: default

Started with python litellm/proxy/proxy_cli.py --config /tmp/issue_30070_config.yaml --port 4000, then against the live AWS endpoint (real requests, real cost):

$ curl -sS http://localhost:4000/v1/chat/completions -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" \
    -d '{"model": "gpt-oss-default-project", "messages": [{"role": "user", "content": "Reply with exactly: ok"}], "max_tokens": 50}'
{"id": "chatcmpl-18fe3301-545a-4502-87a8-ee0163eedc80", ..., "choices": [{"finish_reason": "stop", "index": 0, "message": {"content": "ok", "role": "assistant", ...}}], ...}

$ curl -sS http://localhost:4000/v1/chat/completions -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" \
    -d '{"model": "gpt-oss-bad-project", "messages": [{"role": "user", "content": "Reply with exactly: ok"}], "max_tokens": 50}'
{"error": {"message": "litellm.APIConnectionError: Bedrock_mantleException - {\"error\":{\"code\":\"not_found_error\",\"message\":\"Project 'arn:aws:bedrock-mantle:us-east-1:888602223428:project/proj_doesnotexist000000 does not exist.\", ...}}", ...}}

$ curl -sS http://localhost:4000/v1/chat/completions -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" \
    -d '{"model": "haiku-mantle-default-workspace", "messages": [{"role": "user", "content": "Reply with exactly: ok"}], "max_tokens": 50}'
{"id": "chatcmpl-b3476171-f2a9-4052-8d7e-fb71211c2167", ..., "choices": [{"finish_reason": "stop", "index": 0, "message": {"content": "ok", "role": "assistant", ...}}], ...}

$ curl -sS http://localhost:4000/v1/messages -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" \
    -d '{"model": "haiku-mantle-default-workspace", "max_tokens": 50, "messages": [{"role": "user", "content": "Reply with exactly: ok"}]}'
{"model": "haiku-mantle-default-workspace", "id": "msg_bdrk_k6mg4fcknlezlqiwd6aubi5r3ouy7wfwjaoxww5bk2ngx4foyssq", "type": "message", "role": "assistant", "content": [{"type": "text", "text": "ok"}], "stop_reason": "end_turn", ...}

One observation from live testing: the Anthropic Messages path on bedrock-mantle currently accepts unknown anthropic-workspace values without erroring, while the OpenAI-compatible path validates OpenAI-Project strictly. The mocked-transport tests assert the anthropic-workspace header is on the wire for both Anthropic-format routes

To fully resolve the issue scenario, the user creates a project, sets its retention to provider_data_share per the AWS docs above, and points aws_bedrock_project_id at it on the Fable 5 model entry; the account default stays untouched

The Veria review flagged that an authenticated proxy client could pass aws_bedrock_project_id in the request body and, because client kwargs win the router merge, run requests under any project reachable with the deployment's shared AWS credentials. The field is now on the proxy's banned request-body params list, the same mechanism that already guards aws_bedrock_runtime_endpoint, so client bodies are rejected by default while deployment config keeps working; admins can restore clientside passthrough via general_settings.allow_client_side_credentials or per-deployment configurable_clientside_auth_params. Against the same live proxy:

$ curl -sS http://localhost:4000/v1/chat/completions -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" \
    -d '{"model": "gpt-oss-default-project", "messages": [{"role": "user", "content": "hi"}], "aws_bedrock_project_id": "proj_attacker000000"}'
{"error":{"message":"Authentication Error, Rejected Request: aws_bedrock_project_id is not allowed in request body. Clientside passthrough requires explicit admin opt-in via either `general_settings.allow_client_side_credentials = true` (proxy-wide) or `configurable_clientside_auth_params` on the deployment in your proxy config.yaml. Relevant Issue: https://huntr.com/bounties/4001e1a2-7b7a-4776-a3ae-e6692ec3d997","type":"auth_error","param":"None","code":"401"}}

$ curl -sS http://localhost:4000/v1/chat/completions -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" \
    -d '{"model": "gpt-oss-default-project", "messages": [{"role": "user", "content": "Say ok and nothing else"}], "max_tokens": 200}' \
    | python3 -c "import json,sys; r=json.load(sys.stdin); print(json.dumps({'model': r['model'], 'content': r['choices'][0]['message']['content']}))"
{"model": "gpt-oss-default-project", "content": "ok"}

Type

🆕 New Feature

Changes

Adds a new litellm_params field aws_bedrock_project_id that associates a bedrock-mantle request with an Amazon Bedrock project. It is attached as the OpenAI-Project header in BedrockMantleChatConfig (OpenAI-compatible chat) and BedrockMantleResponsesAPIConfig (Responses), and as the anthropic-workspace header in AmazonMantleConfig (bedrock/mantle/... chat) and AmazonMantleMessagesConfig (/v1/messages). The param works per model entry in the proxy config and as a per-request kwarg in the SDK

The param is registered on CredentialLiteLLMParams and in get_litellm_params so it flows through litellm_params on every route, and it is explicitly excluded from the provider-specific kwarg passthrough in utils.py so it can never leak into a request body (previously any aws_* kwarg on the bedrock provider would have ended up in the Invoke body or in Converse additionalModelRequestFields). The dashboard's generated schema.d.ts is regenerated via npm run gen:api since the new field surfaces in the proxy OpenAPI spec

On the proxy, the field is added to _BANNED_REQUEST_BODY_PARAMS so an authenticated caller cannot override the deployment's project association from the request body (flagged by the Veria review); the standard opt-ins general_settings.allow_client_side_credentials and per-deployment configurable_clientside_auth_params restore clientside passthrough where an admin wants it

The issue also asked about an optional aws_bedrock_data_retention_mode request field. AWS exposes no per-request retention selector; retention is a property of the project or account, configured via the Projects and Data Retention APIs, so that part is intentionally out of scope

Tests cover header injection for all four configs (positive and negative), two mocked-transport end-to-end completions asserting the exact header on the wire and that aws_bedrock_project_id is absent from the request body, the /v1/messages async path, a regression test that the param is excluded from bedrock optional_params while other aws_* params keep flowing, and proxy-boundary regression tests that a client-supplied aws_bedrock_project_id is rejected by default and allowed under the proxy-wide opt-in

…ect association Adds a litellm_params field to associate bedrock-mantle requests with an Amazon Bedrock project, sent as the OpenAI-Project header on the OpenAI-compatible chat and responses paths and as the anthropic-workspace header on the Anthropic messages paths. This lets a single model entry opt into a project-scoped data retention mode (e.g. provider_data_share for Claude Fable 5) while the account-wide setting stays on default. The param is carried via litellm_params only and is explicitly excluded from optional_params so it can never leak into a request body. Fixes #30070

codecov · 2026-06-10T21:54:06Z

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Generated with npm run gen:api after adding the field to LiteLLM_Params

mateo-berri · 2026-06-11T02:12:20Z

bugbot run

greptile-apps · 2026-06-11T02:13:40Z

Greptile Summary

This PR adds a new aws_bedrock_project_id litellm param that associates bedrock-mantle requests with an Amazon Bedrock project or workspace, enabling per-model data-retention control without touching account defaults.

The param is surfaced on all four relevant config classes: BedrockMantleChatConfig and BedrockMantleResponsesAPIConfig inject it as OpenAI-Project, while AmazonMantleConfig and AmazonMantleMessagesConfig inject it as anthropic-workspace. An explicit guard in utils.py prevents it from ever reaching optional_params (and therefore the request body) for the bedrock provider.
The param is registered in CredentialLiteLLMParams, LiteLLMParamsTypedDict, _OPTIONAL_KWARGS_KEYS, and the get_litellm_params() call in main.py, following the same pattern as other aws_* params. Tests cover header presence/absence, clean request body, and end-to-end mocked-transport paths for all four config classes.

Confidence Score: 4/5

Safe to merge; the only finding is a minor style concern about provider-specific filtering logic added to utils.py rather than inside llms/.

The implementation is well-scoped and thorough: headers are injected in all four affected config classes, the param is correctly excluded from optional_params via an explicit guard in utils.py, and mocked-transport tests verify both the header presence and the clean request body for every path. The one flag is that the aws_bedrock_project_id guard in utils.py is provider-specific logic placed outside the llms/ directory, which the team's style guide discourages. The guard is functionally necessary (the general aws_* filter would not cover the bedrock provider path), and the same function already contains comparable guards for aws_*, vertex_*, and hf_model_name, so the pattern is at least internally consistent.

No files require special attention beyond the style note on litellm/utils.py.

Important Files Changed

Filename	Overview
litellm/utils.py	Adds explicit `aws_bedrock_project_id` exclusion in `PreProcessNonDefaultParams.base_pre_process_non_default_params` to prevent the param from leaking into optional_params (and therefore request bodies) for the bedrock provider.
litellm/llms/bedrock/chat/mantle/transformation.py	Adds `validate_environment` override to `AmazonMantleConfig` that injects `anthropic-workspace` header from `litellm_params["aws_bedrock_project_id"]`.
litellm/llms/bedrock/messages/mantle_transformation.py	Adds `validate_anthropic_messages_environment` override to `AmazonMantleMessagesConfig` to inject `anthropic-workspace` header on the `/v1/messages` path.
litellm/llms/bedrock_mantle/chat/transformation.py	Adds `validate_environment` override to `BedrockMantleChatConfig` to inject `OpenAI-Project` header from `litellm_params.get("aws_bedrock_project_id")`.
litellm/llms/bedrock_mantle/responses/transformation.py	Adds `OpenAI-Project` header injection in `BedrockMantleResponsesAPIConfig.validate_environment` using typed attribute access on `GenericLiteLLMParams`.
litellm/litellm_core_utils/get_litellm_params.py	Registers `aws_bedrock_project_id` in `_OPTIONAL_KWARGS_KEYS` so it is extracted from kwargs and stored in `litellm_params` when passed to `get_litellm_params()`.
litellm/main.py	Explicitly threads `aws_bedrock_project_id` from `completion()` kwargs into the `get_litellm_params()` call, consistent with how `tpm`, `rpm`, and `use_xai_oauth` are forwarded.
litellm/types/router.py	Adds `aws_bedrock_project_id: Optional[str] = None` to both `CredentialLiteLLMParams` (in the AWS section) and `LiteLLMParamsTypedDict`.

_{Reviews (1): Last reviewed commit: "chore(ui): regenerate schema.d.ts for aw..." | Re-trigger Greptile}

cursor

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit f3f4dc8. Configure here.}

veria-ai · 2026-06-11T02:25:27Z

PR overview

All previously flagged issues have been addressed. No open security concerns remain on this pull request.

Security review

No open security issues remain on this pull request.

Fixed/addressed: 1 · PR risk: 0/10

The deployment pins aws_bedrock_project_id so the project's data retention policy applies to its requests. Without this guard an authenticated caller could supply the field in the request body and, since client kwargs win the router merge, run requests under any project reachable with the deployment's shared AWS credentials. Adds the field to _BANNED_REQUEST_BODY_PARAMS so it is rejected at the auth boundary by default while remaining available through the existing admin opt-ins (allow_client_side_credentials proxy-wide or configurable_clientside_auth_params per deployment).

mateo-berri · 2026-06-11T04:21:16Z

QA proof

…rkspace association (BerriAI#30163) * feat(bedrock): support aws_bedrock_project_id for bedrock-mantle project association Adds a litellm_params field to associate bedrock-mantle requests with an Amazon Bedrock project, sent as the OpenAI-Project header on the OpenAI-compatible chat and responses paths and as the anthropic-workspace header on the Anthropic messages paths. This lets a single model entry opt into a project-scoped data retention mode (e.g. provider_data_share for Claude Fable 5) while the account-wide setting stays on default. The param is carried via litellm_params only and is explicitly excluded from optional_params so it can never leak into a request body. Fixes BerriAI#30070 * chore(ui): regenerate schema.d.ts for aws_bedrock_project_id Generated with npm run gen:api after adding the field to LiteLLM_Params * fix(proxy): ban client-supplied aws_bedrock_project_id in request bodies The deployment pins aws_bedrock_project_id so the project's data retention policy applies to its requests. Without this guard an authenticated caller could supply the field in the request body and, since client kwargs win the router merge, run requests under any project reachable with the deployment's shared AWS credentials. Adds the field to _BANNED_REQUEST_BODY_PARAMS so it is rejected at the auth boundary by default while remaining available through the existing admin opt-ins (allow_client_side_credentials proxy-wide or configurable_clientside_auth_params per deployment).

tanvithakur94 · 2026-06-11T15:36:45Z

@Sameerlite Is project_id also supported for bedrock converse APIs as well?

Sameerlite · 2026-06-11T16:32:51Z

@mateo-berri can answer

mateo-berri · 2026-06-11T18:02:48Z

@tanvithakur94 No. AWS only accepts the project association header on the bedrock-mantle endpoint (OpenAI-Project on the OpenAI-compatible APIs, anthropic-workspace on the Anthropic Messages API), so aws_bedrock_project_id covers the bedrock_mantle/... and bedrock/mantle/... routes: chat completions, Responses, and /v1/messages. The Converse and Invoke APIs on bedrock-runtime have no project parameter at all; the AWS docs say to use inference profiles there instead (see the "Projects vs. Inference Profiles" table in https://docs.aws.amazon.com/bedrock/latest/userguide/projects.html)

If you need the equivalent isolation, tagging, and cost tracking on Converse, LiteLLM already supports application inference profiles today; set the deployment's model to the profile ARN, e.g. model: bedrock/converse/arn:aws:bedrock:us-east-1:123456789012:application-inference-profile/xyz

…rkspace association (BerriAI#30163) * feat(bedrock): support aws_bedrock_project_id for bedrock-mantle project association Adds a litellm_params field to associate bedrock-mantle requests with an Amazon Bedrock project, sent as the OpenAI-Project header on the OpenAI-compatible chat and responses paths and as the anthropic-workspace header on the Anthropic messages paths. This lets a single model entry opt into a project-scoped data retention mode (e.g. provider_data_share for Claude Fable 5) while the account-wide setting stays on default. The param is carried via litellm_params only and is explicitly excluded from optional_params so it can never leak into a request body. Fixes BerriAI#30070 * chore(ui): regenerate schema.d.ts for aws_bedrock_project_id Generated with npm run gen:api after adding the field to LiteLLM_Params * fix(proxy): ban client-supplied aws_bedrock_project_id in request bodies The deployment pins aws_bedrock_project_id so the project's data retention policy applies to its requests. Without this guard an authenticated caller could supply the field in the request body and, since client kwargs win the router merge, run requests under any project reachable with the deployment's shared AWS credentials. Adds the field to _BANNED_REQUEST_BODY_PARAMS so it is rejected at the auth boundary by default while remaining available through the existing admin opt-ins (allow_client_side_credentials proxy-wide or configurable_clientside_auth_params per deployment).

marty-sullivan · 2026-06-20T21:23:05Z

@tanvithakur94 as an add-on to what @mateo-berri said, yes this is the unfortunate state of things right now. If your concern is around data retention parameter, the only way to set this for converse/invoke api is at the AWS account level. Hoping for more flexibility on this from AWS soon, would be nice if they did support it via custom inference profile as suggested above.

…rkspace association (BerriAI#30163) * feat(bedrock): support aws_bedrock_project_id for bedrock-mantle project association Adds a litellm_params field to associate bedrock-mantle requests with an Amazon Bedrock project, sent as the OpenAI-Project header on the OpenAI-compatible chat and responses paths and as the anthropic-workspace header on the Anthropic messages paths. This lets a single model entry opt into a project-scoped data retention mode (e.g. provider_data_share for Claude Fable 5) while the account-wide setting stays on default. The param is carried via litellm_params only and is explicitly excluded from optional_params so it can never leak into a request body. Fixes BerriAI#30070 * chore(ui): regenerate schema.d.ts for aws_bedrock_project_id Generated with npm run gen:api after adding the field to LiteLLM_Params * fix(proxy): ban client-supplied aws_bedrock_project_id in request bodies The deployment pins aws_bedrock_project_id so the project's data retention policy applies to its requests. Without this guard an authenticated caller could supply the field in the request body and, since client kwargs win the router merge, run requests under any project reachable with the deployment's shared AWS credentials. Adds the field to _BANNED_REQUEST_BODY_PARAMS so it is rejected at the auth boundary by default while remaining available through the existing admin opt-ins (allow_client_side_credentials proxy-wide or configurable_clientside_auth_params per deployment).

This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [ghcr.io/berriai/litellm](https://images.chainguard.dev/directory/image/wolfi-base/overview) ([source](https://github.com/BerriAI/litellm)) | final | minor | `v1.85.1` → `v1.90.0` | --- ### Release Notes <details> <summary>BerriAI/litellm (ghcr.io/berriai/litellm)</summary> ### [`v1.90.0`](https://github.com/BerriAI/litellm/releases/tag/v1.90.0) [Compare Source](https://github.com/BerriAI/litellm/compare/v1.90.0...v1.90.0) ##### Verify Docker Image Signature All LiteLLM Docker images are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). Every release is signed with the same key introduced in [commit `0112e53`](https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0). **Verify using the pinned commit hash (recommended):** A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` **Verify using the release tag (convenience):** Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.90.0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` Expected output: ``` The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key ``` *** ##### What's Changed - fix(responses-bridge): map system-only chat request to system input item by [@milan-berri](https://github.com/milan-berri) in [#29817](https://github.com/BerriAI/litellm/pull/29817) - feat(bedrock): forward strict and additionalProperties to Converse toolSpec by [@mateo-berri](https://github.com/mateo-berri) in [#29814](https://github.com/BerriAI/litellm/pull/29814) - fix(mcp): highlight MCP cards red when the logged-in user is missing per-user env vars by [@mateo-berri](https://github.com/mateo-berri) in [#29856](https://github.com/BerriAI/litellm/pull/29856) - feat(ui): add budget duration to edit team member form by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29717](https://github.com/BerriAI/litellm/pull/29717) - fix(ui): make workflow runs page fill full width by [@yuneng-berri](https://github.com/yuneng-berri) in [#29868](https://github.com/BerriAI/litellm/pull/29868) - feat: standardize rate limit errors with category, rate\_limit\_type, model, and llm\_provider fields by [@mateo-berri](https://github.com/mateo-berri) in [#27687](https://github.com/BerriAI/litellm/pull/27687) - fix(ui): default guardrails page to the Guardrails tab by [@yuneng-berri](https://github.com/yuneng-berri) in [#29872](https://github.com/BerriAI/litellm/pull/29872) - docs(readme): add Deploy on AWS/GCP Terraform section and fix deploy button rendering by [@mateo-berri](https://github.com/mateo-berri) in [#29879](https://github.com/BerriAI/litellm/pull/29879) - refactor(bedrock): build Converse toolSpec via a BedrockToolSpec dict subclass by [@mateo-berri](https://github.com/mateo-berri) in [#29869](https://github.com/BerriAI/litellm/pull/29869) - feat(litellm): add models and repository layers by [@yassin-berriai](https://github.com/yassin-berriai) in [#29686](https://github.com/BerriAI/litellm/pull/29686) - feat(ui): include internal routes in the dashboard's generated OpenAPI types by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29885](https://github.com/BerriAI/litellm/pull/29885) - feat(proxy): publish /v2/model/info in Swagger OpenAPI spec by [@Sameerlite](https://github.com/Sameerlite) in [#29900](https://github.com/BerriAI/litellm/pull/29900) - refactor(ui): single source of truth for migrated-page routing by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29949](https://github.com/BerriAI/litellm/pull/29949) - fix(ui/model-hub): render provider icons on the public model hub by [@yuneng-berri](https://github.com/yuneng-berri) in [#29958](https://github.com/BerriAI/litellm/pull/29958) - fix(ui): keep create guardrail modal open on outside click by [@yuneng-berri](https://github.com/yuneng-berri) in [#29871](https://github.com/BerriAI/litellm/pull/29871) - fix(ui): label default key type as "Full Access" on key edit page by [@yuneng-berri](https://github.com/yuneng-berri) in [#29870](https://github.com/BerriAI/litellm/pull/29870) - fix(ui): unify migrated-route URLs and migrate the API Reference page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29953](https://github.com/BerriAI/litellm/pull/29953) - fix(mcp): let non-creator users OAuth into OBO-mode MCP servers from the Tools page by [@tin-berri](https://github.com/tin-berri) in [#29867](https://github.com/BerriAI/litellm/pull/29867) - Litellm oss staging 080626 by [@Sameerlite](https://github.com/Sameerlite) in [#29932](https://github.com/BerriAI/litellm/pull/29932) - feat(galileo): add health check support for UI callback test by [@Sameerlite](https://github.com/Sameerlite) in [#29908](https://github.com/BerriAI/litellm/pull/29908) - fix(model-management): allow deleting a BYOK model after its team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29875](https://github.com/BerriAI/litellm/pull/29875) - feat(jwt-auth): opt-in fallback to DB team on unresolved JWT claim by [@milan-berri](https://github.com/milan-berri) in [#28913](https://github.com/BerriAI/litellm/pull/28913) - fix(team\_endpoints): don't block /team/update on unchanged team budget by [@milan-berri](https://github.com/milan-berri) in [#29525](https://github.com/BerriAI/litellm/pull/29525) - fix(fireworks): enable tool calling for glm-5p1 in model cost map by [@milan-berri](https://github.com/milan-berri) in [#29697](https://github.com/BerriAI/litellm/pull/29697) - fix(vertex): propagate Vertex AI metadata in streaming success callbacks by [@Sameerlite](https://github.com/Sameerlite) in [#29899](https://github.com/BerriAI/litellm/pull/29899) - fix(ui): show team projects to internal users on key creation by [@milan-berri](https://github.com/milan-berri) in [#28855](https://github.com/BerriAI/litellm/pull/28855) - build(deps): bump pyjwt to 2.13.0 and ws override to 8.20.1 by [@yuneng-berri](https://github.com/yuneng-berri) in [#29982](https://github.com/BerriAI/litellm/pull/29982) - fix(team-management): delete a team's BYOK models when the team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29977](https://github.com/BerriAI/litellm/pull/29977) - feat(vantage): include organization metadata in FOCUS Tags export by [@milan-berri](https://github.com/milan-berri) in [#28184](https://github.com/BerriAI/litellm/pull/28184) - fix(guardrails): read CrowdStrike AIDR identity from both metadata bags by [@yuneng-berri](https://github.com/yuneng-berri) in [#29991](https://github.com/BerriAI/litellm/pull/29991) - fix(mcp): mirror upstream token lifetime instead of forcing a 1h OBO expiry by [@tin-berri](https://github.com/tin-berri) in [#29951](https://github.com/BerriAI/litellm/pull/29951) - feat(azure\_ai): add MAI-Image-2.5 image generation support by [@Sameerlite](https://github.com/Sameerlite) in [#29688](https://github.com/BerriAI/litellm/pull/29688) - fix(mcp): load MCP tool configuration tools via the OBO/passthrough-aware GET path by [@tin-berri](https://github.com/tin-berri) in [#29960](https://github.com/BerriAI/litellm/pull/29960) - fix(team): reserve team budget raises for proxy admins on /team/update by [@milan-berri](https://github.com/milan-berri) in [#30030](https://github.com/BerriAI/litellm/pull/30030) - test(ui): data-driven App Router migration E2E smoke (default + server-root-path) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29974](https://github.com/BerriAI/litellm/pull/29974) - fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through by [@michelligabriele](https://github.com/michelligabriele) in [#24232](https://github.com/BerriAI/litellm/pull/24232) - chore(ui): remove dead App Router route stubs under (dashboard) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30045](https://github.com/BerriAI/litellm/pull/30045) - fix(ui/mcp): reset OAuth state on create-server modal close so a prior server's token no longer leaks into the next add-server session by [@tin-berri](https://github.com/tin-berri) in [#30000](https://github.com/BerriAI/litellm/pull/30000) - fix(mcp): allow team access-group grants in OAuth authorize/token access check by [@tin-berri](https://github.com/tin-berri) in [#30041](https://github.com/BerriAI/litellm/pull/30041) - docs(security): require a reproduction video for vulnerability reports by [@yuneng-berri](https://github.com/yuneng-berri) in [#30063](https://github.com/BerriAI/litellm/pull/30063) - feat(ui): add admin flag to disable in-product UI nudges for everyone by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29796](https://github.com/BerriAI/litellm/pull/29796) - chore(ui): remove dead dashboard files and unused dependencies by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30047](https://github.com/BerriAI/litellm/pull/30047) - fix(proxy): authorize batch files using upload target\_model\_names (LIT-3593) by [@Sameerlite](https://github.com/Sameerlite) in [#30009](https://github.com/BerriAI/litellm/pull/30009) - Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI by [@mateo-berri](https://github.com/mateo-berri) in [#30064](https://github.com/BerriAI/litellm/pull/30064) - Add Claude Fable 5 cost map entries (data-only hotfix for the hosted map) by [@mateo-berri](https://github.com/mateo-berri) in [#30076](https://github.com/BerriAI/litellm/pull/30076) - fix(caching): restore stored prompt\_tokens on embedding cache hits instead of recomputing by [@michelligabriele](https://github.com/michelligabriele) in [#30046](https://github.com/BerriAI/litellm/pull/30046) - Litellm oss 090626 by [@Sameerlite](https://github.com/Sameerlite) in [#30021](https://github.com/BerriAI/litellm/pull/30021) - fix(proxy): self-heal startup/reload prisma reads on engine disconnect by [@michelligabriele](https://github.com/michelligabriele) in [#28803](https://github.com/BerriAI/litellm/pull/28803) - chore(ui): make knip recognize .mjs scripts and openapi-typescript by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30052](https://github.com/BerriAI/litellm/pull/30052) - fix(register\_model): preserve built-in cache pricing when registering custom overrides under unmapped keys by [@yassin-berriai](https://github.com/yassin-berriai) in [#30044](https://github.com/BerriAI/litellm/pull/30044) - \[internal copy of [#28007](https://github.com/BerriAI/litellm/issues/28007)] Fix/gcp model garden streaming by [@mateo-berri](https://github.com/mateo-berri) in [#28363](https://github.com/BerriAI/litellm/pull/28363) - feat(cli): per-agent `lite claude` / `codex` / `opencode` commands that wrap coding agents through the proxy by [@mateo-berri](https://github.com/mateo-berri) in [#29850](https://github.com/BerriAI/litellm/pull/29850) - fix(callbacks): forward callback\_settings to callback initializers and guard consumers against non-dict values by [@yuneng-berri](https://github.com/yuneng-berri) in [#30161](https://github.com/BerriAI/litellm/pull/30161) - fix(mcp): drop orphaned per-user credential rows when an MCP server is deleted by [@tin-berri](https://github.com/tin-berri) in [#30141](https://github.com/BerriAI/litellm/pull/30141) - fix(proxy): recover from cached-plan errors by reconnecting the Prisma client by [@yassin-berriai](https://github.com/yassin-berriai) in [#29983](https://github.com/BerriAI/litellm/pull/29983) - feat(proxy): add option to disable server-side prepared statements for DB lookups by [@yassin-berriai](https://github.com/yassin-berriai) in [#29984](https://github.com/BerriAI/litellm/pull/29984) - fix(release): stop backport releases from overwriting the latest badge by [@yuneng-berri](https://github.com/yuneng-berri) in [#30005](https://github.com/BerriAI/litellm/pull/30005) - feat: add conventional commits and coding guidelines by [@mateo-berri](https://github.com/mateo-berri) in [#30159](https://github.com/BerriAI/litellm/pull/30159) - fix(proxy): return 5xx on DB infra errors during auth; reserve 401 for genuine auth failures by [@yassin-berriai](https://github.com/yassin-berriai) in [#29986](https://github.com/BerriAI/litellm/pull/29986) - fix(ui): dev server 404s on migrated-page links because uiBase hardcodes /ui by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30169](https://github.com/BerriAI/litellm/pull/30169) - refactor(ui): consolidate dashboard to one shell in the (dashboard) layout by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30166](https://github.com/BerriAI/litellm/pull/30166) - fix(proxy): align /v1/model/info with router deployments by [@Sameerlite](https://github.com/Sameerlite) in [#30025](https://github.com/BerriAI/litellm/pull/30025) - fix: completion\_cost AttributeError on streaming Anthropic web\_search responses ([#26153](https://github.com/BerriAI/litellm/issues/26153)) by [@ishaan-berri](https://github.com/ishaan-berri) in [#27346](https://github.com/BerriAI/litellm/pull/27346) - \[internal copy of [#30137](https://github.com/BerriAI/litellm/issues/30137)] perf(realtime): eliminate redundant per-frame JSON work on OpenAI realtime relay by [@mateo-berri](https://github.com/mateo-berri) in [#30142](https://github.com/BerriAI/litellm/pull/30142) - feat(bedrock): aws\_bedrock\_project\_id for bedrock-mantle project / workspace association by [@mateo-berri](https://github.com/mateo-berri) in [#30163](https://github.com/BerriAI/litellm/pull/30163) - chore(hooks): enforce Conventional Commits and Conventional Branches by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30174](https://github.com/BerriAI/litellm/pull/30174) - feat(rate-limiter): allow opting out of v3 TPM reservation and Redis circuit breaker by [@yassin-berriai](https://github.com/yassin-berriai) in [#30211](https://github.com/BerriAI/litellm/pull/30211) - feat(spend\_logs): opt-in native Postgres partitioning for SpendLogs retention by [@yassin-berriai](https://github.com/yassin-berriai) in [#29466](https://github.com/BerriAI/litellm/pull/29466) - feat(ui): migrate playground to path routing and colocate its files by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30185](https://github.com/BerriAI/litellm/pull/30185) - feat(ui): migrate projects and access-groups to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30226](https://github.com/BerriAI/litellm/pull/30226) - fix(proxy): coalesce NULL rollup metrics in aggregated daily-activity by [@michelligabriele](https://github.com/michelligabriele) in [#30151](https://github.com/BerriAI/litellm/pull/30151) - fix(anthropic\_passthrough): resolve costing model from message\_start chunk, litellm\_params and model\_group instead of 'unknown' by [@yassin-berriai](https://github.com/yassin-berriai) in [#30160](https://github.com/BerriAI/litellm/pull/30160) - feat(ui): migrate budgets, workflows, and guardrails-monitor to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30236](https://github.com/BerriAI/litellm/pull/30236) - feat(ui): migrate mcp-servers, search-tools, tag-management, vector-stores, and memory to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30261](https://github.com/BerriAI/litellm/pull/30261) - fix(a2a): forward agent\_extra\_headers through completion bridge by [@mateo-berri](https://github.com/mateo-berri) in [#28277](https://github.com/BerriAI/litellm/pull/28277) - fix(gemini-live): forward audio buffer commit and correct Vertex PCM rate by [@Sameerlite](https://github.com/Sameerlite) in [#29946](https://github.com/BerriAI/litellm/pull/29946) - fix(proxy): skip double-wrapping unified batch output file ids on retrieve by [@Sameerlite](https://github.com/Sameerlite) in [#30011](https://github.com/BerriAI/litellm/pull/30011) - feat: litellm oss 110626 by [@Sameerlite](https://github.com/Sameerlite) in [#30202](https://github.com/BerriAI/litellm/pull/30202) - fix(docker): copy only runtime artifacts into the final image by [@yuneng-berri](https://github.com/yuneng-berri) in [#30243](https://github.com/BerriAI/litellm/pull/30243) - feat(proxy): enforce key/team guardrails on bedrock passthrough routes by [@Sameerlite](https://github.com/Sameerlite) in [#30194](https://github.com/BerriAI/litellm/pull/30194) - feat(gemini): forward web search tools in image generation by [@Sameerlite](https://github.com/Sameerlite) in [#30119](https://github.com/BerriAI/litellm/pull/30119) - fix: bedrock mantle fixes by [@Sameerlite](https://github.com/Sameerlite) in [#30083](https://github.com/BerriAI/litellm/pull/30083) - feat(proxy): add require\_managed\_files setting for file uploads by [@Sameerlite](https://github.com/Sameerlite) in [#30186](https://github.com/BerriAI/litellm/pull/30186) - fix(mcp): honor server\_id for REST tool calls with shared upstream URLs by [@Sameerlite](https://github.com/Sameerlite) in [#30184](https://github.com/BerriAI/litellm/pull/30184) - fix(responses): presidio PII masking for Azure WebSocket and streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30003](https://github.com/BerriAI/litellm/pull/30003) - feat(passthrough): add configurable pass-through request timeouts by [@Sameerlite](https://github.com/Sameerlite) in [#30266](https://github.com/BerriAI/litellm/pull/30266) - fix(google\_genai): preserve complete SSE events in Vertex/Gemini image streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30270](https://github.com/BerriAI/litellm/pull/30270) - fix(proxy): populate access\_via\_team\_ids on /v1/model/info by [@Sameerlite](https://github.com/Sameerlite) in [#30274](https://github.com/BerriAI/litellm/pull/30274) - chore(oss): litellm oss staging 120626 by [@Sameerlite](https://github.com/Sameerlite) in [#30292](https://github.com/BerriAI/litellm/pull/30292) - feat(ui): migrate policies, guardrails, prompts, tool-policies, and skills to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30263](https://github.com/BerriAI/litellm/pull/30263) - feat(ui): migrate caching, cost-tracking, transform-request, ui-theme, and logs to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30267](https://github.com/BerriAI/litellm/pull/30267) - fix(ui): gate dashboard layout on ui config load so deep links work under SERVER\_ROOT\_PATH by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30312](https://github.com/BerriAI/litellm/pull/30312) - feat(ui): migrate admin-panel, logging-and-alerts, model-hub-table, and usage to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30268](https://github.com/BerriAI/litellm/pull/30268) - fix(otel): cap metric attribute cardinality with include/exclude lists by [@yassin-berriai](https://github.com/yassin-berriai) in [#30257](https://github.com/BerriAI/litellm/pull/30257) - fix(proxy): grace-period key rotation 401s; return deprecated-key lookup result directly by [@yuneng-berri](https://github.com/yuneng-berri) in [#30327](https://github.com/BerriAI/litellm/pull/30327) - chore(deps): bump vitest, brace-expansion, pypdf and tornado by [@yuneng-berri](https://github.com/yuneng-berri) in [#30220](https://github.com/BerriAI/litellm/pull/30220) - refactor(ui): remove unreachable /chat page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30178](https://github.com/BerriAI/litellm/pull/30178) - feat(ui): migrate agents and router-settings to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30323](https://github.com/BerriAI/litellm/pull/30323) - feat: strengthen coding conventions in CLAUDE.md by [@mateo-berri](https://github.com/mateo-berri) in [#30333](https://github.com/BerriAI/litellm/pull/30333) - feat(ui): cut the users page over to the /ui/users path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30334](https://github.com/BerriAI/litellm/pull/30334) - feat: ruff strict-rule suppressions baseline gate by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30303](https://github.com/BerriAI/litellm/pull/30303) - feat(guardrails): add Cisco AI Defense integration ([#28249](https://github.com/BerriAI/litellm/issues/28249)) by [@yassin-berriai](https://github.com/yassin-berriai) in [#30338](https://github.com/BerriAI/litellm/pull/30338) - chore(ui): remove dead UI components unreferenced by any page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30340](https://github.com/BerriAI/litellm/pull/30340) - ci: add osv-scanner lockfile scan workflow by [@yuneng-berri](https://github.com/yuneng-berri) in [#30222](https://github.com/BerriAI/litellm/pull/30222) - fix(otel): record full error message on standard exception event in otel v2 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30380](https://github.com/BerriAI/litellm/pull/30380) - test(fireworks): mock whisper transcription tests instead of live calls by [@yuneng-berri](https://github.com/yuneng-berri) in [#30391](https://github.com/BerriAI/litellm/pull/30391) - build(ui): pin esbuild to 0.28.1 via overrides by [@yuneng-berri](https://github.com/yuneng-berri) in [#30390](https://github.com/BerriAI/litellm/pull/30390) - feat(ui): cut the organizations page over to the /ui/organizations path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30336](https://github.com/BerriAI/litellm/pull/30336) - fix(proxy): support SMTP implicit SSL (port 465) by [@yuneng-berri](https://github.com/yuneng-berri) in [#30395](https://github.com/BerriAI/litellm/pull/30395) - fix(mcp): default Linear MCP registry entry to streamable HTTP by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30396](https://github.com/BerriAI/litellm/pull/30396) - fix(ui): stop Virtual Keys page from infinite render loop by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30397](https://github.com/BerriAI/litellm/pull/30397) - fix(streaming): guard raise\_on\_model\_repetition against empty choices by [@shivamrawat1](https://github.com/shivamrawat1) in [#30485](https://github.com/BerriAI/litellm/pull/30485) - feat(otel-v2): emit the 6 gen\_ai.client.\* metrics at parity with v1 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30326](https://github.com/BerriAI/litellm/pull/30326) - fix(mcp): drop phantom 401 span on delegated OAuth2 tool calls by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30494](https://github.com/BerriAI/litellm/pull/30494) - feat(ui): cut the teams page over to the /ui/teams path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30343](https://github.com/BerriAI/litellm/pull/30343) - fix(integrations): cap Anthropic cache\_control injection at 4 blocks by [@shivamrawat1](https://github.com/shivamrawat1) in [#30480](https://github.com/BerriAI/litellm/pull/30480) - chore(codecov): add Batches, Videos, and Realtime components by [@Sameerlite](https://github.com/Sameerlite) in [#30517](https://github.com/BerriAI/litellm/pull/30517) - test(batches): move orphan tests into tests/test\_litellm for CI coverage by [@Sameerlite](https://github.com/Sameerlite) in [#30510](https://github.com/BerriAI/litellm/pull/30510) - fix(guardrails): run pre\_call hook once for model-level guardrails by [@yassin-berriai](https://github.com/yassin-berriai) in [#30543](https://github.com/BerriAI/litellm/pull/30543) - fix(guardrails): stop re-initializing DB guardrails on every poll by [@yassin-berriai](https://github.com/yassin-berriai) in [#30542](https://github.com/BerriAI/litellm/pull/30542) - chore(oss): litellm oss staging 150626 by [@Sameerlite](https://github.com/Sameerlite) in [#30463](https://github.com/BerriAI/litellm/pull/30463) - ci(lint): add blanket-noqa, dataclass-default, and unused-noqa Ruff rules by [@mateo-berri](https://github.com/mateo-berri) in [#30516](https://github.com/BerriAI/litellm/pull/30516) - ci: ratchet lint and type-check gates (ruff preview, ANN, mypy, basedpyright) by [@mateo-berri](https://github.com/mateo-berri) in [#30379](https://github.com/BerriAI/litellm/pull/30379) - fix(proxy): allow internal roles to access vector store CRUD routes by [@shivamrawat1](https://github.com/shivamrawat1) in [#30503](https://github.com/BerriAI/litellm/pull/30503) - fix(otel): stamp gen\_ai.input/output.messages on v2 spans by [@yassin-berriai](https://github.com/yassin-berriai) in [#30548](https://github.com/BerriAI/litellm/pull/30548) - fix(otel): export v2 gen\_ai client metrics to the configured meter provider by [@yassin-berriai](https://github.com/yassin-berriai) in [#30549](https://github.com/BerriAI/litellm/pull/30549) - fix(bedrock): preserve cache\_control for ARN models in /v1/messages adapter by [@mateo-berri](https://github.com/mateo-berri) in [#29823](https://github.com/BerriAI/litellm/pull/29823) - fix: greatly increase basedpyright slack by [@mateo-berri](https://github.com/mateo-berri) in [#30563](https://github.com/BerriAI/litellm/pull/30563) - fix(budget): recompute budget\_reset\_at when budget\_duration changes on /budget/update by [@yassin-berriai](https://github.com/yassin-berriai) in [#30555](https://github.com/BerriAI/litellm/pull/30555) - fix(otel): accept UPPER\_SNAKE\_CASE OTEL\_INSTRUMENTATION\_GENAI\_CAPTURE\_MESSAGE\_CONTENT in v2 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30562](https://github.com/BerriAI/litellm/pull/30562) - chore(lint): remove PLR0915 too-many-statements ruff rule by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30574](https://github.com/BerriAI/litellm/pull/30574) - ci(lint): ratcheted type-discipline gate (mutable collections, casts, guards, kwargs, suppressions) by [@mateo-berri](https://github.com/mateo-berri) in [#30500](https://github.com/BerriAI/litellm/pull/30500) - feat(proxy): add verification\_uri\_complete to CLI SSO device flow by [@yassin-berriai](https://github.com/yassin-berriai) in [#30571](https://github.com/BerriAI/litellm/pull/30571) - chore: litellm oss staging160626 by [@Sameerlite](https://github.com/Sameerlite) in [#30527](https://github.com/BerriAI/litellm/pull/30527) - fix(guardrails): return 400 not 500 when AIM blocks a request by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30573](https://github.com/BerriAI/litellm/pull/30573) - ci(lint): grandfather any-discipline with a per-file ratchet budget (50% headroom) by [@mateo-berri](https://github.com/mateo-berri) in [#30582](https://github.com/BerriAI/litellm/pull/30582) - fix(audio): don't override explicit response\_format with verbose\_json by [@mateo-berri](https://github.com/mateo-berri) in [#30599](https://github.com/BerriAI/litellm/pull/30599) - fix(anthropic): price and surface response service\_tier in cost tracking by [@mateo-berri](https://github.com/mateo-berri) in [#30558](https://github.com/BerriAI/litellm/pull/30558) - feat: add dev and wildcard proxy configs for local testing by [@mateo-berri](https://github.com/mateo-berri) in [#30556](https://github.com/BerriAI/litellm/pull/30556) - fix(proxy): list public team model name in /v1/models by [@ishaan-berri](https://github.com/ishaan-berri) in [#30588](https://github.com/BerriAI/litellm/pull/30588) - ci: drop mypy entirely, standardize type checking on basedpyright by [@mateo-berri](https://github.com/mateo-berri) in [#30648](https://github.com/BerriAI/litellm/pull/30648) - feat(guardrails): surface OpenAI moderation violation\_categories on guardrail traces by [@yassin-berriai](https://github.com/yassin-berriai) in [#30659](https://github.com/BerriAI/litellm/pull/30659) - fix(proxy): resolve list files credentials from team BYOK deployments by [@shivamrawat1](https://github.com/shivamrawat1) in [#30495](https://github.com/BerriAI/litellm/pull/30495) - feat(proxy): add --max\_requests\_before\_restart\_jitter to stagger worker restarts by [@yassin-berriai](https://github.com/yassin-berriai) in [#30601](https://github.com/BerriAI/litellm/pull/30601) - fix(health): correct bedrock embedding health checks by [@mateo-berri](https://github.com/mateo-berri) in [#30583](https://github.com/BerriAI/litellm/pull/30583) - test: harden remaining pass-through CI flakes (image-gen spend poll, ruby assistants timeout) by [@mateo-berri](https://github.com/mateo-berri) in [#30685](https://github.com/BerriAI/litellm/pull/30685) - test(pass\_through): harden vertex spendlog poll against transient empty reads by [@mateo-berri](https://github.com/mateo-berri) in [#30683](https://github.com/BerriAI/litellm/pull/30683) - fix(cost): stop non-string service\_tier from silently dropping cost tracking by [@mateo-berri](https://github.com/mateo-berri) in [#30690](https://github.com/BerriAI/litellm/pull/30690) - feat(proxy): warn at startup when custom\_auth skips common\_checks enforcement by [@tin-berri](https://github.com/tin-berri) in [#30665](https://github.com/BerriAI/litellm/pull/30665) - fix(pod\_lock): release cron lock by matching async\_set\_cache JSON encoding by [@yassin-berriai](https://github.com/yassin-berriai) in [#30600](https://github.com/BerriAI/litellm/pull/30600) - ci: run a local fake OpenAI endpoint instead of the shared Railway mock by [@mateo-berri](https://github.com/mateo-berri) in [#30695](https://github.com/BerriAI/litellm/pull/30695) - ci(windows): pin uv to Python 3.11 so it ignores the preinstalled 3.14 by [@mateo-berri](https://github.com/mateo-berri) in [#30704](https://github.com/BerriAI/litellm/pull/30704) - feat(ui): migrate models page to App Router path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30677](https://github.com/BerriAI/litellm/pull/30677) - refactor(ui): remove orphaned pass-through-settings route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30692](https://github.com/BerriAI/litellm/pull/30692) - fix(cost): stop non-string response service\_tier from dropping cost tracking by [@yuneng-berri](https://github.com/yuneng-berri) in [#30706](https://github.com/BerriAI/litellm/pull/30706) - feat(agent-shin): automated PR/issue triage, low-quality auto-close, and review-gate label lifecycle by [@mateo-berri](https://github.com/mateo-berri) in [#30433](https://github.com/BerriAI/litellm/pull/30433) - chore: litellm oss 170626 by [@Sameerlite](https://github.com/Sameerlite) in [#30637](https://github.com/BerriAI/litellm/pull/30637) - fix(bedrock\_mantle): add SigV4 fallback to chat completions auth by [@mateo-berri](https://github.com/mateo-berri) in [#30714](https://github.com/BerriAI/litellm/pull/30714) - feat(search): add TinyFish as search provider by [@simantak-dabhade](https://github.com/simantak-dabhade) in [#30634](https://github.com/BerriAI/litellm/pull/30634) - feat(ui): migrate old usage report to App Router path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30694](https://github.com/BerriAI/litellm/pull/30694) - fix(proxy): enforce budgets against authoritative DB spend when the cross-pod counter is stale by [@yassin-berriai](https://github.com/yassin-berriai) in [#30684](https://github.com/BerriAI/litellm/pull/30684) - chore(ci): remove Agent Shin pull\_request\_target workflows by [@yuneng-berri](https://github.com/yuneng-berri) in [#30784](https://github.com/BerriAI/litellm/pull/30784) - chore: litellm oss staging by [@Sameerlite](https://github.com/Sameerlite) in [#30745](https://github.com/BerriAI/litellm/pull/30745) - ci(zizmor): also run on litellm\_internal\_staging by [@yuneng-berri](https://github.com/yuneng-berri) in [#30789](https://github.com/BerriAI/litellm/pull/30789) - fix(test): drop references to removed Agent Shin workflows by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30791](https://github.com/BerriAI/litellm/pull/30791) - chore: remove in-product survey and Claude Code feedback nudges by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30773](https://github.com/BerriAI/litellm/pull/30773) - feat(ui): migrate api-keys landing to App Router path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30699](https://github.com/BerriAI/litellm/pull/30699) - feat(proxy): configurable response headers and login-page hint by [@yucheng-berri](https://github.com/yucheng-berri) in [#30792](https://github.com/BerriAI/litellm/pull/30792) - ci(zizmor): gate PRs on medium+ findings and clear existing ones by [@yuneng-berri](https://github.com/yuneng-berri) in [#30797](https://github.com/BerriAI/litellm/pull/30797) - fix(proxy): use e.request\_data for logging\_obj in ModifyResponseException streaming passthrough by [@mateo-berri](https://github.com/mateo-berri) in [#30800](https://github.com/BerriAI/litellm/pull/30800) - chore: make pr template linear portion clearer by [@mateo-berri](https://github.com/mateo-berri) in [#30766](https://github.com/BerriAI/litellm/pull/30766) - chore(typing): add boto3/botocore stubs so basedpyright resolves the AWS SDK by [@mateo-berri](https://github.com/mateo-berri) in [#30815](https://github.com/BerriAI/litellm/pull/30815) - fix(otel): one v2 logger owns the global provider; scope tenant OTLP creds per exporter by [@yucheng-berri](https://github.com/yucheng-berri) in [#30590](https://github.com/BerriAI/litellm/pull/30590) - fix(passthrough): recover output tokens for interrupted anthropic streams by [@yassin-berriai](https://github.com/yassin-berriai) in [#30787](https://github.com/BerriAI/litellm/pull/30787) - fix(proxy): record partial spend on the failure row for interrupted streams by [@yassin-berriai](https://github.com/yassin-berriai) in [#30788](https://github.com/BerriAI/litellm/pull/30788) - fix(ui): repoint dead usage guide link to cost tracking docs by [@yuneng-berri](https://github.com/yuneng-berri) in [#30859](https://github.com/BerriAI/litellm/pull/30859) - fix(ui): warn that team models are deleted in the delete-team modal by [@yuneng-berri](https://github.com/yuneng-berri) in [#29990](https://github.com/BerriAI/litellm/pull/29990) - feat(caching): add valkey-semantic cache backend and fix semantic cache scope keys by [@yassin-berriai](https://github.com/yassin-berriai) in [#30675](https://github.com/BerriAI/litellm/pull/30675) - test(ui): isolate OldTeams delete-warning tests from leaked mock by [@mateo-berri](https://github.com/mateo-berri) in [#30871](https://github.com/BerriAI/litellm/pull/30871) - feat: add lint-gate target and truncation-proof summary to the strict ruff gate by [@mateo-berri](https://github.com/mateo-berri) in [#30877](https://github.com/BerriAI/litellm/pull/30877) - chore(ui): rebuild ui for release by [@yuneng-berri](https://github.com/yuneng-berri) in [#30894](https://github.com/BerriAI/litellm/pull/30894) - chore(ci): bump deps by [@yuneng-berri](https://github.com/yuneng-berri) in [#30899](https://github.com/BerriAI/litellm/pull/30899) - fix(watsonx): wrap string embedding input in array for WatsonX API by [@shivamrawat1](https://github.com/shivamrawat1) in [#30897](https://github.com/BerriAI/litellm/pull/30897) - test: point router/completion/triton tests at the local fake OpenAI endpoint by [@mateo-berri](https://github.com/mateo-berri) in [#30900](https://github.com/BerriAI/litellm/pull/30900) - feat(sandbox): e2b code execution primitive by [@krrish-berri-2](https://github.com/krrish-berri-2) in [#30898](https://github.com/BerriAI/litellm/pull/30898) - fix(ui): source api-keys identity from useAuthorized to stop "User ID is not set" by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30903](https://github.com/BerriAI/litellm/pull/30903) - chore(ui): rebuild ui by [@yuneng-berri](https://github.com/yuneng-berri) in [#30906](https://github.com/BerriAI/litellm/pull/30906) - chore(ci): promote internal staging to main by [@yuneng-berri](https://github.com/yuneng-berri) in [#30907](https://github.com/BerriAI/litellm/pull/30907) - fix(redis): prevent forcing SSLConnection when ssl=False in connection pool by [@Jacopos311](https://github.com/Jacopos311) in [#30770](https://github.com/BerriAI/litellm/pull/30770) - fix(proxy): log UI setup failures instead of silently swallowing by [@sarvesh1327](https://github.com/sarvesh1327) in [#30819](https://github.com/BerriAI/litellm/pull/30819) ##### New Contributors - [@simantak-dabhade](https://github.com/simantak-dabhade) made their first contribution in [#30634](https://github.com/BerriAI/litellm/pull/30634) - [@Jacopos311](https://github.com/Jacopos311) made their first contribution in [#30770](https://github.com/BerriAI/litellm/pull/30770) - [@sarvesh1327](https://github.com/sarvesh1327) made their first contribution in [#30819](https://github.com/BerriAI/litellm/pull/30819) **Full Changelog**: <https://github.com/BerriAI/litellm/compare/v1.89.0...v1.90.0> ### [`v1.90.0`](https://github.com/BerriAI/litellm/releases/tag/v1.90.0) [Compare Source](https://github.com/BerriAI/litellm/compare/v1.89.4...v1.90.0) ##### Verify Docker Image Signature All LiteLLM Docker images are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). Every release is signed with the same key introduced in [commit `0112e53`](https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0). **Verify using the pinned commit hash (recommended):** A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` **Verify using the release tag (convenience):** Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.90.0/cosign.pub \ ghcr.io/berriai/litellm:v1.90.0 ``` Expected output: ``` The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key ``` *** ##### What's Changed - fix(responses-bridge): map system-only chat request to system input item by [@milan-berri](https://github.com/milan-berri) in [#29817](https://github.com/BerriAI/litellm/pull/29817) - feat(bedrock): forward strict and additionalProperties to Converse toolSpec by [@mateo-berri](https://github.com/mateo-berri) in [#29814](https://github.com/BerriAI/litellm/pull/29814) - fix(mcp): highlight MCP cards red when the logged-in user is missing per-user env vars by [@mateo-berri](https://github.com/mateo-berri) in [#29856](https://github.com/BerriAI/litellm/pull/29856) - feat(ui): add budget duration to edit team member form by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29717](https://github.com/BerriAI/litellm/pull/29717) - fix(ui): make workflow runs page fill full width by [@yuneng-berri](https://github.com/yuneng-berri) in [#29868](https://github.com/BerriAI/litellm/pull/29868) - feat: standardize rate limit errors with category, rate\_limit\_type, model, and llm\_provider fields by [@mateo-berri](https://github.com/mateo-berri) in [#27687](https://github.com/BerriAI/litellm/pull/27687) - fix(ui): default guardrails page to the Guardrails tab by [@yuneng-berri](https://github.com/yuneng-berri) in [#29872](https://github.com/BerriAI/litellm/pull/29872) - docs(readme): add Deploy on AWS/GCP Terraform section and fix deploy button rendering by [@mateo-berri](https://github.com/mateo-berri) in [#29879](https://github.com/BerriAI/litellm/pull/29879) - refactor(bedrock): build Converse toolSpec via a BedrockToolSpec dict subclass by [@mateo-berri](https://github.com/mateo-berri) in [#29869](https://github.com/BerriAI/litellm/pull/29869) - feat(litellm): add models and repository layers by [@yassin-berriai](https://github.com/yassin-berriai) in [#29686](https://github.com/BerriAI/litellm/pull/29686) - feat(ui): include internal routes in the dashboard's generated OpenAPI types by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29885](https://github.com/BerriAI/litellm/pull/29885) - feat(proxy): publish /v2/model/info in Swagger OpenAPI spec by [@Sameerlite](https://github.com/Sameerlite) in [#29900](https://github.com/BerriAI/litellm/pull/29900) - refactor(ui): single source of truth for migrated-page routing by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29949](https://github.com/BerriAI/litellm/pull/29949) - fix(ui/model-hub): render provider icons on the public model hub by [@yuneng-berri](https://github.com/yuneng-berri) in [#29958](https://github.com/BerriAI/litellm/pull/29958) - fix(ui): keep create guardrail modal open on outside click by [@yuneng-berri](https://github.com/yuneng-berri) in [#29871](https://github.com/BerriAI/litellm/pull/29871) - fix(ui): label default key type as "Full Access" on key edit page by [@yuneng-berri](https://github.com/yuneng-berri) in [#29870](https://github.com/BerriAI/litellm/pull/29870) - fix(ui): unify migrated-route URLs and migrate the API Reference page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29953](https://github.com/BerriAI/litellm/pull/29953) - fix(mcp): let non-creator users OAuth into OBO-mode MCP servers from the Tools page by [@tin-berri](https://github.com/tin-berri) in [#29867](https://github.com/BerriAI/litellm/pull/29867) - Litellm oss staging 080626 by [@Sameerlite](https://github.com/Sameerlite) in [#29932](https://github.com/BerriAI/litellm/pull/29932) - feat(galileo): add health check support for UI callback test by [@Sameerlite](https://github.com/Sameerlite) in [#29908](https://github.com/BerriAI/litellm/pull/29908) - fix(model-management): allow deleting a BYOK model after its team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29875](https://github.com/BerriAI/litellm/pull/29875) - feat(jwt-auth): opt-in fallback to DB team on unresolved JWT claim by [@milan-berri](https://github.com/milan-berri) in [#28913](https://github.com/BerriAI/litellm/pull/28913) - fix(team\_endpoints): don't block /team/update on unchanged team budget by [@milan-berri](https://github.com/milan-berri) in [#29525](https://github.com/BerriAI/litellm/pull/29525) - fix(fireworks): enable tool calling for glm-5p1 in model cost map by [@milan-berri](https://github.com/milan-berri) in [#29697](https://github.com/BerriAI/litellm/pull/29697) - fix(vertex): propagate Vertex AI metadata in streaming success callbacks by [@Sameerlite](https://github.com/Sameerlite) in [#29899](https://github.com/BerriAI/litellm/pull/29899) - fix(ui): show team projects to internal users on key creation by [@milan-berri](https://github.com/milan-berri) in [#28855](https://github.com/BerriAI/litellm/pull/28855) - build(deps): bump pyjwt to 2.13.0 and ws override to 8.20.1 by [@yuneng-berri](https://github.com/yuneng-berri) in [#29982](https://github.com/BerriAI/litellm/pull/29982) - fix(team-management): delete a team's BYOK models when the team is deleted by [@yuneng-berri](https://github.com/yuneng-berri) in [#29977](https://github.com/BerriAI/litellm/pull/29977) - feat(vantage): include organization metadata in FOCUS Tags export by [@milan-berri](https://github.com/milan-berri) in [#28184](https://github.com/BerriAI/litellm/pull/28184) - fix(guardrails): read CrowdStrike AIDR identity from both metadata bags by [@yuneng-berri](https://github.com/yuneng-berri) in [#29991](https://github.com/BerriAI/litellm/pull/29991) - fix(mcp): mirror upstream token lifetime instead of forcing a 1h OBO expiry by [@tin-berri](https://github.com/tin-berri) in [#29951](https://github.com/BerriAI/litellm/pull/29951) - feat(azure\_ai): add MAI-Image-2.5 image generation support by [@Sameerlite](https://github.com/Sameerlite) in [#29688](https://github.com/BerriAI/litellm/pull/29688) - fix(mcp): load MCP tool configuration tools via the OBO/passthrough-aware GET path by [@tin-berri](https://github.com/tin-berri) in [#29960](https://github.com/BerriAI/litellm/pull/29960) - fix(team): reserve team budget raises for proxy admins on /team/update by [@milan-berri](https://github.com/milan-berri) in [#30030](https://github.com/BerriAI/litellm/pull/30030) - test(ui): data-driven App Router migration E2E smoke (default + server-root-path) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29974](https://github.com/BerriAI/litellm/pull/29974) - fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through by [@michelligabriele](https://github.com/michelligabriele) in [#24232](https://github.com/BerriAI/litellm/pull/24232) - chore(ui): remove dead App Router route stubs under (dashboard) by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30045](https://github.com/BerriAI/litellm/pull/30045) - fix(ui/mcp): reset OAuth state on create-server modal close so a prior server's token no longer leaks into the next add-server session by [@tin-berri](https://github.com/tin-berri) in [#30000](https://github.com/BerriAI/litellm/pull/30000) - fix(mcp): allow team access-group grants in OAuth authorize/token access check by [@tin-berri](https://github.com/tin-berri) in [#30041](https://github.com/BerriAI/litellm/pull/30041) - docs(security): require a reproduction video for vulnerability reports by [@yuneng-berri](https://github.com/yuneng-berri) in [#30063](https://github.com/BerriAI/litellm/pull/30063) - feat(ui): add admin flag to disable in-product UI nudges for everyone by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#29796](https://github.com/BerriAI/litellm/pull/29796) - chore(ui): remove dead dashboard files and unused dependencies by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30047](https://github.com/BerriAI/litellm/pull/30047) - fix(proxy): authorize batch files using upload target\_model\_names (LIT-3593) by [@Sameerlite](https://github.com/Sameerlite) in [#30009](https://github.com/BerriAI/litellm/pull/30009) - Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI by [@mateo-berri](https://github.com/mateo-berri) in [#30064](https://github.com/BerriAI/litellm/pull/30064) - Add Claude Fable 5 cost map entries (data-only hotfix for the hosted map) by [@mateo-berri](https://github.com/mateo-berri) in [#30076](https://github.com/BerriAI/litellm/pull/30076) - fix(caching): restore stored prompt\_tokens on embedding cache hits instead of recomputing by [@michelligabriele](https://github.com/michelligabriele) in [#30046](https://github.com/BerriAI/litellm/pull/30046) - Litellm oss 090626 by [@Sameerlite](https://github.com/Sameerlite) in [#30021](https://github.com/BerriAI/litellm/pull/30021) - fix(proxy): self-heal startup/reload prisma reads on engine disconnect by [@michelligabriele](https://github.com/michelligabriele) in [#28803](https://github.com/BerriAI/litellm/pull/28803) - chore(ui): make knip recognize .mjs scripts and openapi-typescript by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30052](https://github.com/BerriAI/litellm/pull/30052) - fix(register\_model): preserve built-in cache pricing when registering custom overrides under unmapped keys by [@yassin-berriai](https://github.com/yassin-berriai) in [#30044](https://github.com/BerriAI/litellm/pull/30044) - \[internal copy of [#28007](https://github.com/BerriAI/litellm/issues/28007)] Fix/gcp model garden streaming by [@mateo-berri](https://github.com/mateo-berri) in [#28363](https://github.com/BerriAI/litellm/pull/28363) - feat(cli): per-agent `lite claude` / `codex` / `opencode` commands that wrap coding agents through the proxy by [@mateo-berri](https://github.com/mateo-berri) in [#29850](https://github.com/BerriAI/litellm/pull/29850) - fix(callbacks): forward callback\_settings to callback initializers and guard consumers against non-dict values by [@yuneng-berri](https://github.com/yuneng-berri) in [#30161](https://github.com/BerriAI/litellm/pull/30161) - fix(mcp): drop orphaned per-user credential rows when an MCP server is deleted by [@tin-berri](https://github.com/tin-berri) in [#30141](https://github.com/BerriAI/litellm/pull/30141) - fix(proxy): recover from cached-plan errors by reconnecting the Prisma client by [@yassin-berriai](https://github.com/yassin-berriai) in [#29983](https://github.com/BerriAI/litellm/pull/29983) - feat(proxy): add option to disable server-side prepared statements for DB lookups by [@yassin-berriai](https://github.com/yassin-berriai) in [#29984](https://github.com/BerriAI/litellm/pull/29984) - fix(release): stop backport releases from overwriting the latest badge by [@yuneng-berri](https://github.com/yuneng-berri) in [#30005](https://github.com/BerriAI/litellm/pull/30005) - feat: add conventional commits and coding guidelines by [@mateo-berri](https://github.com/mateo-berri) in [#30159](https://github.com/BerriAI/litellm/pull/30159) - fix(proxy): return 5xx on DB infra errors during auth; reserve 401 for genuine auth failures by [@yassin-berriai](https://github.com/yassin-berriai) in [#29986](https://github.com/BerriAI/litellm/pull/29986) - fix(ui): dev server 404s on migrated-page links because uiBase hardcodes /ui by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30169](https://github.com/BerriAI/litellm/pull/30169) - refactor(ui): consolidate dashboard to one shell in the (dashboard) layout by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30166](https://github.com/BerriAI/litellm/pull/30166) - fix(proxy): align /v1/model/info with router deployments by [@Sameerlite](https://github.com/Sameerlite) in [#30025](https://github.com/BerriAI/litellm/pull/30025) - fix: completion\_cost AttributeError on streaming Anthropic web\_search responses ([#26153](https://github.com/BerriAI/litellm/issues/26153)) by [@ishaan-berri](https://github.com/ishaan-berri) in [#27346](https://github.com/BerriAI/litellm/pull/27346) - \[internal copy of [#30137](https://github.com/BerriAI/litellm/issues/30137)] perf(realtime): eliminate redundant per-frame JSON work on OpenAI realtime relay by [@mateo-berri](https://github.com/mateo-berri) in [#30142](https://github.com/BerriAI/litellm/pull/30142) - feat(bedrock): aws\_bedrock\_project\_id for bedrock-mantle project / workspace association by [@mateo-berri](https://github.com/mateo-berri) in [#30163](https://github.com/BerriAI/litellm/pull/30163) - chore(hooks): enforce Conventional Commits and Conventional Branches by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30174](https://github.com/BerriAI/litellm/pull/30174) - feat(rate-limiter): allow opting out of v3 TPM reservation and Redis circuit breaker by [@yassin-berriai](https://github.com/yassin-berriai) in [#30211](https://github.com/BerriAI/litellm/pull/30211) - feat(spend\_logs): opt-in native Postgres partitioning for SpendLogs retention by [@yassin-berriai](https://github.com/yassin-berriai) in [#29466](https://github.com/BerriAI/litellm/pull/29466) - feat(ui): migrate playground to path routing and colocate its files by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30185](https://github.com/BerriAI/litellm/pull/30185) - feat(ui): migrate projects and access-groups to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30226](https://github.com/BerriAI/litellm/pull/30226) - fix(proxy): coalesce NULL rollup metrics in aggregated daily-activity by [@michelligabriele](https://github.com/michelligabriele) in [#30151](https://github.com/BerriAI/litellm/pull/30151) - fix(anthropic\_passthrough): resolve costing model from message\_start chunk, litellm\_params and model\_group instead of 'unknown' by [@yassin-berriai](https://github.com/yassin-berriai) in [#30160](https://github.com/BerriAI/litellm/pull/30160) - feat(ui): migrate budgets, workflows, and guardrails-monitor to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30236](https://github.com/BerriAI/litellm/pull/30236) - feat(ui): migrate mcp-servers, search-tools, tag-management, vector-stores, and memory to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30261](https://github.com/BerriAI/litellm/pull/30261) - fix(a2a): forward agent\_extra\_headers through completion bridge by [@mateo-berri](https://github.com/mateo-berri) in [#28277](https://github.com/BerriAI/litellm/pull/28277) - fix(gemini-live): forward audio buffer commit and correct Vertex PCM rate by [@Sameerlite](https://github.com/Sameerlite) in [#29946](https://github.com/BerriAI/litellm/pull/29946) - fix(proxy): skip double-wrapping unified batch output file ids on retrieve by [@Sameerlite](https://github.com/Sameerlite) in [#30011](https://github.com/BerriAI/litellm/pull/30011) - feat: litellm oss 110626 by [@Sameerlite](https://github.com/Sameerlite) in [#30202](https://github.com/BerriAI/litellm/pull/30202) - fix(docker): copy only runtime artifacts into the final image by [@yuneng-berri](https://github.com/yuneng-berri) in [#30243](https://github.com/BerriAI/litellm/pull/30243) - feat(proxy): enforce key/team guardrails on bedrock passthrough routes by [@Sameerlite](https://github.com/Sameerlite) in [#30194](https://github.com/BerriAI/litellm/pull/30194) - feat(gemini): forward web search tools in image generation by [@Sameerlite](https://github.com/Sameerlite) in [#30119](https://github.com/BerriAI/litellm/pull/30119) - fix: bedrock mantle fixes by [@Sameerlite](https://github.com/Sameerlite) in [#30083](https://github.com/BerriAI/litellm/pull/30083) - feat(proxy): add require\_managed\_files setting for file uploads by [@Sameerlite](https://github.com/Sameerlite) in [#30186](https://github.com/BerriAI/litellm/pull/30186) - fix(mcp): honor server\_id for REST tool calls with shared upstream URLs by [@Sameerlite](https://github.com/Sameerlite) in [#30184](https://github.com/BerriAI/litellm/pull/30184) - fix(responses): presidio PII masking for Azure WebSocket and streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30003](https://github.com/BerriAI/litellm/pull/30003) - feat(passthrough): add configurable pass-through request timeouts by [@Sameerlite](https://github.com/Sameerlite) in [#30266](https://github.com/BerriAI/litellm/pull/30266) - fix(google\_genai): preserve complete SSE events in Vertex/Gemini image streaming by [@Sameerlite](https://github.com/Sameerlite) in [#30270](https://github.com/BerriAI/litellm/pull/30270) - fix(proxy): populate access\_via\_team\_ids on /v1/model/info by [@Sameerlite](https://github.com/Sameerlite) in [#30274](https://github.com/BerriAI/litellm/pull/30274) - chore(oss): litellm oss staging 120626 by [@Sameerlite](https://github.com/Sameerlite) in [#30292](https://github.com/BerriAI/litellm/pull/30292) - feat(ui): migrate policies, guardrails, prompts, tool-policies, and skills to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30263](https://github.com/BerriAI/litellm/pull/30263) - feat(ui): migrate caching, cost-tracking, transform-request, ui-theme, and logs to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30267](https://github.com/BerriAI/litellm/pull/30267) - fix(ui): gate dashboard layout on ui config load so deep links work under SERVER\_ROOT\_PATH by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30312](https://github.com/BerriAI/litellm/pull/30312) - feat(ui): migrate admin-panel, logging-and-alerts, model-hub-table, and usage to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30268](https://github.com/BerriAI/litellm/pull/30268) - fix(otel): cap metric attribute cardinality with include/exclude lists by [@yassin-berriai](https://github.com/yassin-berriai) in [#30257](https://github.com/BerriAI/litellm/pull/30257) - fix(proxy): grace-period key rotation 401s; return deprecated-key lookup result directly by [@yuneng-berri](https://github.com/yuneng-berri) in [#30327](https://github.com/BerriAI/litellm/pull/30327) - chore(deps): bump vitest, brace-expansion, pypdf and tornado by [@yuneng-berri](https://github.com/yuneng-berri) in [#30220](https://github.com/BerriAI/litellm/pull/30220) - refactor(ui): remove unreachable /chat page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30178](https://github.com/BerriAI/litellm/pull/30178) - feat(ui): migrate agents and router-settings to path routes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30323](https://github.com/BerriAI/litellm/pull/30323) - feat: strengthen coding conventions in CLAUDE.md by [@mateo-berri](https://github.com/mateo-berri) in [#30333](https://github.com/BerriAI/litellm/pull/30333) - feat(ui): cut the users page over to the /ui/users path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30334](https://github.com/BerriAI/litellm/pull/30334) - feat: ruff strict-rule suppressions baseline gate by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30303](https://github.com/BerriAI/litellm/pull/30303) - feat(guardrails): add Cisco AI Defense integration ([#28249](https://github.com/BerriAI/litellm/issues/28249)) by [@yassin-berriai](https://github.com/yassin-berriai) in [#30338](https://github.com/BerriAI/litellm/pull/30338) - chore(ui): remove dead UI components unreferenced by any page by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30340](https://github.com/BerriAI/litellm/pull/30340) - ci: add osv-scanner lockfile scan workflow by [@yuneng-berri](https://github.com/yuneng-berri) in [#30222](https://github.com/BerriAI/litellm/pull/30222) - fix(otel): record full error message on standard exception event in otel v2 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30380](https://github.com/BerriAI/litellm/pull/30380) - test(fireworks): mock whisper transcription tests instead of live calls by [@yuneng-berri](https://github.com/yuneng-berri) in [#30391](https://github.com/BerriAI/litellm/pull/30391) - build(ui): pin esbuild to 0.28.1 via overrides by [@yuneng-berri](https://github.com/yuneng-berri) in [#30390](https://github.com/BerriAI/litellm/pull/30390) - feat(ui): cut the organizations page over to the /ui/organizations path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30336](https://github.com/BerriAI/litellm/pull/30336) - fix(proxy): support SMTP implicit SSL (port 465) by [@yuneng-berri](https://github.com/yuneng-berri) in [#30395](https://github.com/BerriAI/litellm/pull/30395) - fix(mcp): default Linear MCP registry entry to streamable HTTP by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30396](https://github.com/BerriAI/litellm/pull/30396) - fix(ui): stop Virtual Keys page from infinite render loop by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30397](https://github.com/BerriAI/litellm/pull/30397) - fix(streaming): guard raise\_on\_model\_repetition against empty choices by [@shivamrawat1](https://github.com/shivamrawat1) in [#30485](https://github.com/BerriAI/litellm/pull/30485) - feat(otel-v2): emit the 6 gen\_ai.client.\* metrics at parity with v1 by [@yassin-berriai](https://github.com/yassin-berriai) in [#30326](https://github.com/BerriAI/litellm/pull/30326) - fix(mcp): drop phantom 401 span on delegated OAuth2 tool calls by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30494](https://github.com/BerriAI/litellm/pull/30494) - feat(ui): cut the teams page over to the /ui/teams path route by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#30343](https://github.com/BerriAI/litellm/pull/30343) - fix(integrations): cap Anthropic cache\_control injection at 4 blocks by [@shivamrawat1](https://github.com/shivamrawat1) in [#30480](https://github.com/BerriAI/litellm/pull/30480) - chore(codecov): add Batches, Videos, and Realtime components by [@Sameerlite](https://github.com/Sameerlite) in [#30517](https://github.com/BerriAI/litellm/pull/30517) - test(batches): move orphan tests into tests/test\_litellm for CI coverage by [@Sameerlite](https://github.com/Sameerlite) in [#30510](https://github.com/BerriAI/litellm/pull/30510) - fix(guardrails): run pre\_call hook once for model-level guardrails by [@yassin-berriai](https://github.com/yassin-berriai) in [#30543](http…

chore(ui): regenerate schema.d.ts for aws_bedrock_project_id

f3f4dc8

Generated with npm run gen:api after adding the field to LiteLLM_Params

mateo-berri marked this pull request as ready for review June 11, 2026 02:08

greptile-apps Bot reviewed Jun 11, 2026

View reviewed changes

Comment thread litellm/utils.py

cursor Bot reviewed Jun 11, 2026

View reviewed changes

veria-ai Bot reviewed Jun 11, 2026

View reviewed changes

Comment thread litellm/litellm_core_utils/get_litellm_params.py

mateo-berri requested a review from Sameerlite June 11, 2026 02:44

Sameerlite approved these changes Jun 11, 2026

View reviewed changes

Sameerlite merged commit 49ca04d into litellm_internal_staging Jun 11, 2026
119 checks passed

Sameerlite deleted the litellm_bedrock_project_id branch June 11, 2026 04:31

mateo-berri mentioned this pull request Jun 17, 2026

fix(health): correct bedrock embedding health checks #30583

Merged

4 tasks

ishaan-berri mentioned this pull request Jun 25, 2026

LiteLLM Stability Sprint Roadmap #30484

Open

13 tasks

Uh oh!

Uh oh!

Conversation

mateo-berri commented Jun 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Relevant issues

Linear ticket

Pre-Submission checklist

Delays in PR merge?

CI (LiteLLM team)

Screenshots / Proof of Fix

Type

Changes

Uh oh!

codecov Bot commented Jun 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

mateo-berri commented Jun 11, 2026

Uh oh!

greptile-apps Bot commented Jun 11, 2026

Greptile Summary

Confidence Score: 4/5

Important Files Changed

Uh oh!

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

veria-ai Bot commented Jun 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR overview

Security review

Uh oh!

mateo-berri commented Jun 11, 2026

QA proof

Uh oh!

Uh oh!

tanvithakur94 commented Jun 11, 2026

Uh oh!

Sameerlite commented Jun 11, 2026

Uh oh!

mateo-berri commented Jun 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

marty-sullivan commented Jun 20, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

mateo-berri commented Jun 10, 2026 •

edited

Loading

codecov Bot commented Jun 10, 2026 •

edited

Loading

veria-ai Bot commented Jun 11, 2026 •

edited

Loading

mateo-berri commented Jun 11, 2026 •

edited

Loading