Skip to content

IChatCompletion Streaming Support - #829

Merged
Shawn Callegari (shawncal) merged 19 commits into
microsoft:mainfrom
rogerbarreto:features/ichatcompletion-stream
May 8, 2023
Merged

Shawn Callegari (shawncal) merged 19 commits into
microsoft:mainfrom
rogerbarreto:features/ichatcompletion-stream

Conversation

@rogerbarreto

@rogerbarreto Roger Barreto (rogerbarreto) commented May 5, 2023 •

Copy link
Copy Markdown
Member

Motivation and Context

Get streaming results from chat completion models using the IAsyncEnumerable pattern.

Closes #378
Resolves #378

Added samples how to use those as well as how to implement your own custom chat completion model using streaming capability.

Description

ChatCompletionStream

Co-authored-by: dedalo [email protected]

Contribution Checklist

@github-actions github-actions Bot added .NET Issue or Pull requests regarding .NET code kernel Issues or pull requests impacting the core kernel kernel.core labels May 5, 2023
@rogerbarreto Roger Barreto (rogerbarreto) added the PR: ready for review All feedback addressed, ready for reviews label May 5, 2023
@shawncal
Shawn Callegari (shawncal) force-pushed the features/ichatcompletion-stream branch from dc79269 to 0de719e Compare May 5, 2023 22:58
@dedalo

Rodrigo Roman (dedalo) commented May 7, 2023 •

Copy link
Copy Markdown
Contributor

This works great and helps implement signalr in chat applications wich improves user experience. Looking forward for the merge.

@shawncal
Shawn Callegari (shawncal) merged commit ef85b61 into microsoft:main May 8, 2023
Desmond Howard (dehoward) pushed a commit to lemillermicrosoft/semantic-kernel that referenced this pull request Jun 1, 2023
### Motivation and Context
Get streaming results from chat completion models using the
IAsyncEnumerable pattern.

Closes microsoft#378 
Resolves microsoft#378 

Added samples how to use those as well as how to implement your own
custom chat completion model using streaming capability.

Co-authored-by: dedalo <[email protected]>
Co-authored-by: Shawn Callegari <[email protected]>
@rogerbarreto
Roger Barreto (rogerbarreto) deleted the features/ichatcompletion-stream branch December 5, 2023 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kernel Issues or pull requests impacting the core kernel .NET Issue or Pull requests regarding .NET code PR: ready for review All feedback addressed, ready for reviews

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Streaming support, implementation of IAsyncEnumberalbe

4 participants