Checklist

• 1. I have searched related issues but cannot get the expected help.
• 2. The bug has not been fixed in the latest version.
• 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
• 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 5. Please use English, otherwise it will be closed.

Describe the bug

After deploying deepseekv3-0324 using sglang 0.4.5-post3-cu124,
when testing the function call with message of role "tool",
the sglang replay with " Internal Server Error "

Reproduction

After deploying deepseekv3-0324 using sglang 0.4.5-post3-cu124,
when testing the function call with message of role "tool",
the sglang replay with " Internal Server Error "

curl "http://XXXX/v1/chat/completions"
-H "Content-Type: application/json"
-d '{
"messages": [
{
"role": "user",
"content": "Add these numbers: 7 and 22."
},
{
"role": "assistant",
"tool_calls": [
{
"id": "0",
"type": "function",
"function": {
"name": "add",
"arguments": "{"a": 7, "b": 22}"
}
}
]
},
{
"role": "tool",
"tool_call_id": "0",
"content": "{"type":"text","text":"29","annotations":null}"
}
],
"model": "mssgpt_v3",
"stream": false,
"tools": [
{
"type": "function",
"function": {
"name": "add",
"description": "",
"parameters": {
"properties": {
"a": {
"title": "A",
"type": "integer"
},
"b": {
"title": "B",
"type": "integer"
}
},
"required": [
"a",
"b"
],
"title": "addArguments",
"type": "object"
}
}
},
{
"type": "function",
"function": {
"name": "get_secret_word",
"description": "get secret word",
"parameters": {
"properties": {},
"title": "get_secret_wordArguments",
"type": "object"
}
}
},
{
"type": "function",
"function": {
"name": "get_current_weather",
"description": "get current weather",
"parameters": {
"properties": {
"city": {
"title": "City",
"type": "string"
}
},
"required": [
"city"
],
"title": "get_current_weatherArguments",
"type": "object"
}
}
}
]
}
'

Internal Server Error

Environment

sglang 0.4.5-post3
deepseekv3-0324