Skip to content

[BUG] [Bedrock] Application Inference Profiles don't work #1968

Closed

Description

@kw-bivanov

Problem (one or two sentences)

Bedrock Inference fails when using Profile with Model=custom-arn and using Application Inference Profile as Custom ARN string.
Error returned is:
Error: Unknown Error: The model returned the following errors: "thinking.type.enabled" is not supported for this model. Use "thinking.type.adaptive" and "output_config.effort" to control thinking behavior.

Additionally, if the ARN is pasted as model name in the profile it is accepted but, the API calls fail as it can't be resolved to an allowed model on Bedrock. One has to know that the option custom-arn even exists.

Context (who is affected and when)

Everyone. All users of Application Inference Profiles in AWS Bedrock.

Reproduction steps

Environment: Windows, VS Code 1.141.0, Zoo Code 3.86.0 (6aa9d01)
Steps to reproduce:
Create new profile with following settings:

  • API Provider: Amazon Bedrock
  • Authentication Method: AWS Profile
  • Model: custom-arn
  • Custom ARN (example): arn:aws:bedrock:us-west-2:123456789012:application-inference-profile/abcd1234efgh
    Type "hi" in the chat box.
    An error is returned.

Expected result

the Bedrock API call to succeed and get a response from the model

Actual result

Error: Unknown Error: The model returned the following errors: "thinking.type.enabled" is not supported for this model. Use "thinking.type.adaptive" and "output_config.effort" to control thinking behavior.

Variations tried (optional)

No response

App Version

3.86.0

API Provider (optional)

Amazon Bedrock

Model Used (optional)

Claude Opus 5.5 via Application Inference Profile

Zoo Code Task Links (optional)

No response

Relevant logs or errors (optional)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions