feat: add AWS Bedrock service tier support #9955

roomote · 2025-12-09T20:13:36Z

This PR attempts to address Issue #9874 by implementing AWS Bedrock service tier support.

Summary

Adds support for AWS Bedrock service tiers (STANDARD, FLEX, PRIORITY) allowing users to optimize their AI workloads based on cost and latency requirements.

Changes

✅ Added service tier type definitions and constants
✅ Added awsBedrockServiceTier field to provider settings schema
✅ Updated Bedrock provider to include service_tier parameter in API requests
✅ Implemented tier-specific pricing (75% premium for Priority, 50% discount for Flex)
✅ Added UI selector for service tier in Bedrock settings component
✅ Added translation strings for the new UI elements
✅ Updated supported models list based on AWS documentation

Supported Models

Based on the AWS documentation provided, the following models support service tiers:

Amazon Nova models (Lite, Pro, Pro Latency Optimized)
DeepSeek R1
Qwen models (qwen3-next-80b-a3b, qwen3-coder-480b-a35b)
OpenAI GPT-OSS models (20b, 120b)

Testing

✅ Type checking passes
✅ Linting passes
✅ All existing tests pass

Notes

The pricing multipliers have been updated based on the feedback:

FLEX: 50% discount from standard (0.5x multiplier)
PRIORITY: 75% premium over standard (1.75x multiplier)

Feedback and guidance are welcome!

Closes #9874

Important

Adds AWS Bedrock service tier support with UI updates, pricing adjustments, and tests for tier-specific functionality.

Behavior:
- Adds awsBedrockServiceTier field to provider settings schema in provider-settings.ts.
- Updates AwsBedrockHandler in bedrock.ts to include service_tier in API requests for supported models.
- Implements tier-specific pricing in bedrock.ts with 75% premium for Priority and 50% discount for Flex.
UI:
- Adds UI selector for service tier in Bedrock.tsx.
- Adds translation strings for service tiers in multiple language files.
Testing:
- Adds tests in bedrock.spec.ts for pricing multipliers and API request parameters.
Misc:
- Defines service tier types and constants in bedrock.ts and provider-settings.ts.
- Updates supported models list in bedrock.ts based on AWS documentation.

^{This description was created by}^{for 4936295. You can customize this summary. It will automatically update as commits are pushed.}

- Add service tier type definitions (STANDARD, FLEX, PRIORITY) - Add awsBedrockServiceTier field to provider settings schema - Include service_tier parameter in Bedrock API requests for supported models - Apply tier-specific pricing (75% premium for Priority, 50% discount for Flex) - Add UI selector for service tier in Bedrock settings component - Add models that support service tiers based on AWS documentation: - Amazon Nova models (Lite, Pro, Pro Latency Optimized) - DeepSeek R1 - Qwen models - OpenAI GPT-OSS models - Add translation strings for service tier UI Addresses #9874

roomote · 2025-12-09T20:14:17Z

Rooviewer See task on Roo Cloud

All issues have been resolved. Recent changes fix grammar typos in Catalan and Spanish translations.

Add tests for service tier functionality in bedrock.spec.ts (pricing multipliers, API request parameters, unsupported models)
Add translations for all locales

Previous reviews

990e58c: Review #1

4936295: Review #2

4936295: Review #3

a0b9fd7: Review #4

44190d1: Review #5

7f3481b: Review #6

_{Mention @roomote in a comment to request specific changes to this pull request or fix all unresolved issues.}

roomote · 2025-12-09T20:17:31Z

src/api/providers/bedrock.ts

 		}

+		// Add service tier if specified and model supports it
+		if (this.options.awsBedrockServiceTier && BEDROCK_SERVICE_TIER_MODEL_IDS.includes(baseModelId as any)) {


This service tier feature should have test coverage. The existing bedrock.spec.ts has comprehensive tests for similar features (like the 1M context beta). Consider adding tests for: (1) service tier parameter being included in API requests for supported models, (2) pricing multipliers being correctly applied in getModel(), and (3) service tier NOT being applied for unsupported models.

_{Fix it with Roo Code or mention @roomote and request a fix.}

@roomote amazon.nova-2-lite-v1:0 is also supported for the Service Tiers. Add to the list of models

Fixaroo See task on Roo Cloud

Fixed the reported issues. All local checks passed.

_{View commit | Revert commit}

@roomote
1/Error message received - Unknown Error: The model returned the following errors: Malformed input request: #: extraneous key [service_tier] is not permitted, please reformat your input and try again.
2/The code is adding service_tier to additionalModelRequestFields, but according to the AWS Bedrock documentation, service_tier should be a top-level parameter in the request, not nested inside additionalModelRequestFields. Fix accordingly
3/Documentation https://docs.aws.amazon.com/bedrock/latest/userguide/service-tiers-inference.html

https://docs.aws.amazon.com/bedrock/latest/userguide/custom-model-import-advanced-features.html

Fixaroo See task on Roo Cloud

Fixed the service_tier placement. Per AWS documentation, it must be a top-level request parameter, not nested inside additionalModelRequestFields. All tests pass.

_{View commit | Revert commit}

…coverage

Per AWS Bedrock documentation, service_tier must be a top-level parameter in the API request, not nested inside additionalModelRequestFields. The previous implementation incorrectly placed service_tier inside additionalModelRequestFields which caused "extraneous key [service_tier] is not permitted" errors from the Bedrock API. This fix: - Moves service_tier to be a top-level payload parameter - Updates tests to verify service_tier is at top level - Adds documentation links to the code for reference Refs: https://docs.aws.amazon.com/bedrock/latest/userguide/service-tiers-inference.html

ronyblum · 2025-12-09T21:31:51Z

@Smartsheet-JB-Brown @hannesrudolph @mrubens PR after updates tested locally and works as expected

webview-ui/src/i18n/locales/en/settings.json

roomote · 2025-12-14T19:53:06Z

Fixaroo Follow along on Roo Cloud

Working on the following:

Adding AWS Bedrock service tier translations to all locale files

roomote · 2025-12-14T20:12:57Z

Rooviewer See task on Roo Cloud

Review complete. All previous issues have been addressed and no new issues found.

Add tests for service tier functionality in bedrock.spec.ts
Add amazon.nova-2-lite-v1:0 to supported models list
Move service_tier to top-level request parameter (per AWS docs)
Add translations for all 17 locales

_{Mention @roomote in a comment to request specific changes to this pull request or fix all unresolved issues.}

webview-ui/src/i18n/locales/ca/settings.json

webview-ui/src/i18n/locales/es/settings.json

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

github-project-automation bot added this to Roo Code Roadmap and Roo Code Roadmap Dec 9, 2025

github-project-automation bot moved this to New in Roo Code Roadmap Dec 9, 2025

github-project-automation bot moved this to Triage in Roo Code Roadmap Dec 9, 2025

roomote bot mentioned this pull request Dec 9, 2025

[ENHANCEMENT] - Add support for bedrock service tiers #9874

Closed

roomote bot commented Dec 9, 2025

View reviewed changes

hannesrudolph added the Issue/PR - Triage New issue. Needs quick review to confirm validity and assign labels. label Dec 9, 2025

roomote added 2 commits December 9, 2025 20:34

fix: add amazon.nova-2-lite-v1:0 to service tier models and add test …

44190d1

…coverage

mrubens reviewed Dec 14, 2025

View reviewed changes

webview-ui/src/i18n/locales/en/settings.json Show resolved Hide resolved

Add translations

4936295

mrubens marked this pull request as ready for review December 14, 2025 20:12

mrubens requested review from cte and jr as code owners December 14, 2025 20:12

dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Dec 14, 2025

mrubens approved these changes Dec 14, 2025

View reviewed changes

dosubot bot added Enhancement New feature or request lgtm This PR has been approved by a maintainer labels Dec 14, 2025

ellipsis-dev bot reviewed Dec 14, 2025

View reviewed changes

webview-ui/src/i18n/locales/ca/settings.json Outdated Show resolved Hide resolved

webview-ui/src/i18n/locales/ca/settings.json Outdated Show resolved Hide resolved

webview-ui/src/i18n/locales/es/settings.json Outdated Show resolved Hide resolved

mrubens and others added 3 commits December 14, 2025 15:17

Update webview-ui/src/i18n/locales/ca/settings.json

990e58c

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

Update webview-ui/src/i18n/locales/ca/settings.json

fb13fc3

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

Update webview-ui/src/i18n/locales/es/settings.json

eb5a470

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

mrubens merged commit 9f3122f into main Dec 14, 2025
10 checks passed

mrubens deleted the feature/bedrock-service-tiers branch December 14, 2025 20:26

github-project-automation bot moved this from New to Done in Roo Code Roadmap Dec 14, 2025

roomote bot mentioned this pull request Dec 15, 2025

Changeset version bump #10092

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: add AWS Bedrock service tier support #9955

feat: add AWS Bedrock service tier support #9955

Uh oh!

roomote bot commented Dec 9, 2025 •

edited by ellipsis-dev bot

Loading

Uh oh!

roomote bot commented Dec 9, 2025 •

edited

Loading

Uh oh!

roomote bot Dec 9, 2025

Uh oh!

ronyblum Dec 9, 2025

Uh oh!

roomote bot Dec 9, 2025 •

edited

Loading

Uh oh!

ronyblum Dec 9, 2025

Uh oh!

roomote bot Dec 9, 2025 •

edited

Loading

Uh oh!

ronyblum commented Dec 9, 2025

Uh oh!

Uh oh!

roomote bot commented Dec 14, 2025

Uh oh!

roomote bot commented Dec 14, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

feat: add AWS Bedrock service tier support #9955

feat: add AWS Bedrock service tier support #9955

Uh oh!

Conversation

roomote bot commented Dec 9, 2025 • edited by ellipsis-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Changes

Supported Models

Testing

Notes

Uh oh!

roomote bot commented Dec 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

roomote bot Dec 9, 2025

Choose a reason for hiding this comment

Uh oh!

ronyblum Dec 9, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Dec 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ronyblum Dec 9, 2025

Choose a reason for hiding this comment

Uh oh!

roomote bot Dec 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ronyblum commented Dec 9, 2025

Uh oh!

Uh oh!

roomote bot commented Dec 14, 2025

Uh oh!

roomote bot commented Dec 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

roomote bot commented Dec 9, 2025 •

edited by ellipsis-dev bot

Loading

roomote bot commented Dec 9, 2025 •

edited

Loading

roomote bot Dec 9, 2025 •

edited

Loading

roomote bot Dec 9, 2025 •

edited

Loading

roomote bot commented Dec 14, 2025 •

edited

Loading