feat(vertex): add 1M context window beta support for Claude Sonnet 4 #10209
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dosubot
bot
added
size:M
Contributor
Update: the previously flagged issue is now resolved in the latest commit(s).
Mention @roomote in a comment to request specific changes to this pull request or fix all unresolved issues. |
![roomote[bot]](https://avatars.githubusercontent.com/in/1546624?s=60&v=4){kind=small}
hannesrudolph
added
the
Issue/PR - Triage
- Add tier pricing for Claude Sonnet 4 models with 1M context support - Implement getModel() to return betas array when vertex1MContext enabled - Update createMessage() to pass anthropic-beta header via requestOptions - Add comprehensive tests for 1M context beta feature - Update existing tests to handle the new requestOptions parameter The vertex1MContext checkbox now properly enables the 1M token context window for supported Vertex AI Claude models (claude-sonnet-4@20250514, claude-sonnet-4-5@20250929) by passing the 'context-1m-2025-08-07' beta header and updating the model pricing accordingly.
dosubot
bot
added
size:L
daniel-lxs
approved these changes
Dec 19, 2025
mrubens
approved these changes
Dec 19, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Adds support for the 1M context window beta feature on Vertex AI for Claude Sonnet 4 models. This feature extends the context window from 200K to 1 million tokens when enabled.
Changes
vertex1MContextboolean setting to provider-settings schemaVERTEX_1M_CONTEXT_MODEL_IDSconstant listing supported models (claude-sonnet-4@20250514, claude-sonnet-4-5@20250929)Important
Adds 1M context window beta support for Claude Sonnet 4 models on Vertex AI, including schema, UI, and translation updates.
vertex1MContextboolean toprovider-settings.tsfor 1M context window beta.VERTEX_1M_CONTEXT_MODEL_IDSinvertex.tsfor supported models.VertexHandlerinanthropic-vertex.tsto handle 1M context window.Vertex.tsxfor enabling 1M context window for supported models.anthropic-vertex.spec.tsto verify 1M context window functionality.This description was created by
for 91fb55d. You can customize this summary. It will automatically update as commits are pushed.