Problem statement
Description
Currently, the BedrockLLMClient is hardcoded to use the AnthropicBedrock SDK. While this works perfectly for Claude models, it prevents users from utilizing any other foundation models hosted on Amazon Bedrock (such as Mistral, gpt oss or Amazon Titan).
When a non-Anthropic model ID is configured, the client fails during initialization or execution with a 'NoneType' object is not iterable error, because the Anthropic SDK does not support those model identifiers.
Proposed solution
Proposed Solution
Update BedrockLLMClient to:
- Dynamically detect if a model is an Anthropic Claude model.
- Route Claude models through the existing
AnthropicBedrock SDK.
- Route all other models through the
boto3 Bedrock converse API to allow universal model support on Bedrock.
Impact
This will allow OpenSRE users to use the entire Bedrock model catalog, providing more flexibility for cost, performance, and regional availability.
Problem statement
Description
Currently, the
BedrockLLMClientis hardcoded to use theAnthropicBedrockSDK. While this works perfectly for Claude models, it prevents users from utilizing any other foundation models hosted on Amazon Bedrock (such as Mistral, gpt oss or Amazon Titan).When a non-Anthropic model ID is configured, the client fails during initialization or execution with a
'NoneType' object is not iterableerror, because the Anthropic SDK does not support those model identifiers.Proposed solution
Proposed Solution
Update
BedrockLLMClientto:AnthropicBedrockSDK.boto3BedrockconverseAPI to allow universal model support on Bedrock.Impact
This will allow OpenSRE users to use the entire Bedrock model catalog, providing more flexibility for cost, performance, and regional availability.