Skip to content

Return TGI errors#313

Merged
yunfeng-scale merged 4 commits intomainfrom
yunfeng-tgi-error
Oct 11, 2023
Merged

Return TGI errors#313
yunfeng-scale merged 4 commits intomainfrom
yunfeng-tgi-error

Conversation

@yunfeng-scale
Copy link
Copy Markdown
Contributor

@yunfeng-scale yunfeng-scale commented Oct 10, 2023

Return TGI errors to upstream

@yixu34
Copy link
Copy Markdown
Member

yixu34 commented Oct 10, 2023

Can you double check your linter settings to see if they match what's in this repo?

@yunfeng-scale
Copy link
Copy Markdown
Contributor Author

Can you double check your linter settings to see if they match what's in this repo?

fixed

@yunfeng-scale
Copy link
Copy Markdown
Contributor Author

Can you double check your linter settings to see if they match what's in this repo?

i'm not sure why formatting changed, i'm using the same .black.toml file

@yunfeng-scale yunfeng-scale requested a review from a team October 11, 2023 19:15
):
fake_llm_model_endpoint_service.add_model_endpoint(llm_model_endpoint_sync_tgi[0])
fake_model_endpoint_service.sync_model_endpoint_inference_gateway.response = SyncEndpointPredictV1Response(
status=TaskStatus.SUCCESS,
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably outside of the scope of this PR but I was hoping we could get rid of status in the response, since we handle errors separately anyway.

@yunfeng-scale yunfeng-scale merged commit 4ef1eed into main Oct 11, 2023
@yunfeng-scale yunfeng-scale deleted the yunfeng-tgi-error branch October 11, 2023 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants