Skip to content

[FEATURE]support non-Anthropic models (Mistral/Llama) via Bedrock Converse API #1306

@shubh586

Description

@shubh586

Problem statement

Description

Currently, the BedrockLLMClient is hardcoded to use the AnthropicBedrock SDK. While this works perfectly for Claude models, it prevents users from utilizing any other foundation models hosted on Amazon Bedrock (such as Mistral, gpt oss or Amazon Titan).

When a non-Anthropic model ID is configured, the client fails during initialization or execution with a 'NoneType' object is not iterable error, because the Anthropic SDK does not support those model identifiers.

Proposed solution

Proposed Solution

Update BedrockLLMClient to:

  1. Dynamically detect if a model is an Anthropic Claude model.
  2. Route Claude models through the existing AnthropicBedrock SDK.
  3. Route all other models through the boto3 Bedrock converse API to allow universal model support on Bedrock.

Impact

This will allow OpenSRE users to use the entire Bedrock model catalog, providing more flexibility for cost, performance, and regional availability.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions