Skip to content

[Feature] add cli command chat,complete #4037

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
Jiang-Jia-Jun merged 1 commit into from
Sep 11, 2025
Merged

[Feature] add cli command chat,complete #4037

Jiang-Jia-Jun merged 1 commit into from
Sep 11, 2025

Conversation

@memoryCoderC
Copy link
Collaborator

@memoryCoderC memoryCoderC commented Sep 10, 2025 •
edited
Loading

添加cli命令chat,complete,通过openAI sdk调用接口

使用方式

使用fastdeploy命令执行相关操作

  1. -h 可以查看帮助
  2. -v 查询版本信息

接口使用方式

fastdeploy chat 调用chat接口
fastdeploy complete  调用complete接口
fastdeploy {chat,complete} -h 查看子命令帮助信息

示例：
fastdeploy chat --url http://localhost:8490/v1 -q 你好

可以参考vllm方式进行使用，后续增加描述文档
https://docs.vllm.ai/en/latest/cli/complete.html
https://docs.vllm.ai/en/latest/cli/chat.html

@paddle-bot
Copy link

paddle-bot bot commented Sep 10, 2025

Thanks for your contribution!

@paddle-bot paddle-bot bot added the contributor External developers label Sep 10, 2025
@memoryCoderC memoryCoderC force-pushed the develop branch 12 times, most recently from 6069ac5 to 5ba04f6 Compare September 10, 2025 14:59
@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 850465e into PaddlePaddle:develop Sep 11, 2025
34 of 39 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Jiang-Jia-Jun Jiang-Jia-Jun Jiang-Jia-Jun approved these changes

@sunlei1024 sunlei1024 sunlei1024 approved these changes

Assignees

No one assigned

Labels

contributor External developers

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@memoryCoderC @Jiang-Jia-Jun @sunlei1024