You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[BUG] [Bedrock] Application Inference Profiles don't work #1968
Bedrock Inference fails when using Profile with Model=custom-arn and using Application Inference Profile as Custom ARN string.
Error returned is:
Error: Unknown Error: The model returned the following errors: "thinking.type.enabled" is not supported for this model. Use "thinking.type.adaptive" and "output_config.effort" to control thinking behavior.
Additionally, if the ARN is pasted as model name in the profile it is accepted but, the API calls fail as it can't be resolved to an allowed model on Bedrock. One has to know that the option custom-arn even exists.
Context (who is affected and when)
Everyone. All users of Application Inference Profiles in AWS Bedrock.
Reproduction steps
Environment: Windows, VS Code 1.141.0, Zoo Code 3.86.0 (6aa9d01)
Steps to reproduce:
Create new profile with following settings:
API Provider: Amazon Bedrock
Authentication Method: AWS Profile
Model: custom-arn
Custom ARN (example): arn:aws:bedrock:us-west-2:123456789012:application-inference-profile/abcd1234efgh
Type "hi" in the chat box.
An error is returned.
Expected result
the Bedrock API call to succeed and get a response from the model
Actual result
Error: Unknown Error: The model returned the following errors: "thinking.type.enabled" is not supported for this model. Use "thinking.type.adaptive" and "output_config.effort" to control thinking behavior.
Activity
fix(bedrock): resolve custom ARN capabilities from the underlying mod…
fix(bedrock): reset custom ARN base model with the ARN and show 1M ti…
test(bedrock): tighten custom ARN base model assertion and cover tier…
fix(bedrock): keep custom ARN capability overrides tied to their ARN
test(bedrock): add Playwright snapshots for the custom ARN settings
test(bedrock): cover ARN reset auto-detect and Bedrock 1M/service-tie…
fix(bedrock): resolve custom ARN capabilities from the underlying mod…