Skip to content

Flag indicate end of stream #240

Closed
Closed
Flag indicate end of stream#240
Assignees
ncomly-nvidia
Labels
feature requestNew feature or request. This includes new model, dtype, functionality supportstaletriagedIssue has been triaged by maintainers
@yunfeng-scale

Description

@yunfeng-scale
yunfeng-scale
opened on Nov 1, 2023

Hi, during request streaming it'll be helpful to have a flag to indicate end of generation. Can you help with this feature request?

Metadata

Metadata

Assignees

Labels

feature requestNew feature or request. This includes new model, dtype, functionality supportstaletriagedIssue has been triaged by maintainers

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions