Skip to content

.Net: Parallel function calls option - #9487

Merged
SergeyMenshykh merged 3 commits into
microsoft:mainfrom
SergeyMenshykh:allow-parallel-function-calls
Oct 31, 2024
Merged

SergeyMenshykh merged 3 commits into
microsoft:mainfrom
SergeyMenshykh:allow-parallel-function-calls

Conversation

@SergeyMenshykh

@SergeyMenshykh SergeyMenshykh commented Oct 31, 2024 •

Copy link
Copy Markdown
Contributor

Motivation and Context

This PR adds the FunctionChoiceBehaviorOptions.AllowParallelCalls option and updates {Azure} OpenAI AI connectors to support it. This option instructs the AI model to generate multiple function calls in a single response when set to true.

"This is especially useful if executing the given functions takes a long time. For example, the model may call functions to get the weather in three different locations at the same time, which will result in a message with three function calls in the tool_calls array." Source - Configuring parallel function calling

Closes: #6636

@SergeyMenshykh SergeyMenshykh added the ai connector Anything related to AI connectors label Oct 31, 2024
@SergeyMenshykh SergeyMenshykh self-assigned this Oct 31, 2024
@markwallace-microsoft Mark Wallace (markwallace-microsoft) added .NET Issue or Pull requests regarding .NET code kernel Issues or pull requests impacting the core kernel kernel.core labels Oct 31, 2024
@SergeyMenshykh
SergeyMenshykh marked this pull request as ready for review October 31, 2024 16:41
@SergeyMenshykh
SergeyMenshykh requested a review from a team as a code owner October 31, 2024 16:41
@SergeyMenshykh
SergeyMenshykh added this pull request to the merge queue Oct 31, 2024
Merged via the queue into microsoft:main with commit d014534 Oct 31, 2024
@SergeyMenshykh
SergeyMenshykh deleted the allow-parallel-function-calls branch October 31, 2024 19:14

This branch was previously deployed

1 inactive deployment
integration — c9e33a29 Deployed Oct 31, 2024 by SergeyMenshykh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai connector Anything related to AI connectors kernel.core kernel Issues or pull requests impacting the core kernel .NET Issue or Pull requests regarding .NET code

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

.Net: Function calling to call only one function at a time (parallel_tool_calls = false)

5 participants