Repository navigation
Python: Bug: response_format not supported with AzureAIInferenceChatPromptExecutionSettings #11952
Description
Describe the bug
Response format is not support with AzureAIInferenceChatPromptExecutionSettings. Azure AI Inference chat completion API supports response_format but prompt execution settings do not support this.
To Reproduce
None of the below pass response_format to the underlying completions call -
response_format = JsonSchemaFormat(
name="Recipe_JSON_Schema",
schema=Recipe.model_json_schema(),
description="",
strict=True,
)
AzureAIInferenceChatPromptExecutionSettings(
service_id="service-id", response_format=response_format
)
AzureAIInferenceChatPromptExecutionSettings(
service_id="service-id", extra_parameters={"response_format": response_format}
)
Expected behavior
Screenshots
Platform
- Language: Python
- Source: pip package version 1.26.1
- AI model: [e.g. OpenAI:GPT-4o-mini(2024-07-18)]
- IDE: [e.g. Visual Studio, VS Code]
- OS: [e.g. Windows, Mac]
Additional context
Add any other context about the problem here.
Metadata
Metadata
Assignees
Type
Projects
- Status
Activity
[-]Bug: response_format not supported with AzureAIInferenceChatPromptExecutionSettings[/-][+]Python: Bug: response_format not supported with AzureAIInferenceChatPromptExecutionSettings[/+][-]Bug: response_format not supported with AzureAIInferenceChatPromptExecutionSettings[/-][+].Net: Bug: response_format not supported with AzureAIInferenceChatPromptExecutionSettings[/+][-].Net: Bug: response_format not supported with AzureAIInferenceChatPromptExecutionSettings[/-][+]Python: Bug: response_format not supported with AzureAIInferenceChatPromptExecutionSettings[/+]moonbox3 commentedon May 8, 2025
ManniArora As of last month the Azure AI inference SDK didn't support
response_format. Now, as you point out, they do. This is just a gap. We'll work on getting it handled.moonbox3 commentedon May 8, 2025
Adding context for myself: https://learn.microsoft.com/en-us/rest/api/aifoundry/model-inference/get-chat-completions/get-chat-completions?view=rest-aifoundry-model-inference-2025-05-01&tabs=HTTP#chatcompletionsresponseformatjsonschema
Python: Support structured outputs with Azure AI inference chat compl…
moonbox3 commentedon May 28, 2025
Support for this is included as of 1.32.0.
Python: Support structured outputs with Azure AI inference chat compl…