Repository navigation
Streaming support, implementation of IAsyncEnumberalbe #378
Description
Because I see that Example App Chat Copilot's response is too slow, I would like to ask if Streaming will be implemented in the future.
Additional description:
Nuget package Azure.AI.OpenAI supports Streaming
Example:
Response<StreamingChatCompletions> response = await client.GetChatCompletionsStreamingAsync(
deploymentOrModelName: model,
chatCompletionsOptions);
using StreamingChatCompletions streamingChatCompletions = response.Value;
await foreach (StreamingChatChoice choice in streamingChatCompletions.GetChoicesStreaming())
{
await foreach (ChatMessage message in choice.GetMessageStreaming())
{
Console.Write(message.Content);
}
Console.WriteLine("-------------");
}Reacted by Guillaume Lecomte and Roger Barreto
Metadata
Metadata
Assignees
Labels
No labels
Activity
microsoftShannon commentedon Apr 13, 2023
We are working on this.
dedalo commentedon May 6, 2023
did not see this and created other option. link here and follow to close once the issue is solved.
#836
I'm using copilot with signalr to connect status change and streaming and the UX changes completely
IChatCompletion Streaming Support (#829)
IChatCompletion Streaming Support (microsoft#829)