Skip to content

Commit 26ad93d

Browse files
fix(openai-compatible): accept empty string role in streaming delta chunks (#15464)
## Background Some OpenAI-compatible providers (e.g. zhipu/glm-5) send an empty string `""` for `delta.role` in streaming chunks instead of `"assistant"` or omitting it. The strict `z.enum(['assistant']).nullish()` validation in `chunkBaseSchema` rejects this value, causing `AI_TypeValidationError` / `ZodError` and breaking the entire stream. Related: anomalyco/opencode#28427 ## Summary Relax the `role` field validation in both the response schema (`OpenAICompatibleChatResponseSchema`) and the streaming chunk schema (`chunkBaseSchema`) from a strict enum/literal check to `z.string().nullish()`. The `role` field is not consumed by the implementation — it exists only for schema validation — so accepting any string value (including empty string) is safe and matches the provider-agnostic intent of the `openai-compatible` adapter. ### Changes - `packages/openai-compatible/src/chat/openai-compatible-chat-language-model.ts`: Change `role` validation from `z.literal('assistant').nullish()` / `z.enum(['assistant']).nullish()` to `z.string().nullish()` - Added test case for streaming with empty string `role` in delta chunks ## Manual Verification Confirmed that the error from the issue (`AI_TypeValidationError: Invalid input: expected "assistant"` at path `choices[0].delta.role`) is caused by the strict enum validation rejecting `role: ""`. After the fix, chunks with `role: ""` parse successfully and text content is extracted correctly. ## Checklist - [x] Tests have been added / updated (for bug fixes / features) - [ ] Documentation has been added / updated (for bug fixes / features) - [x] A _patch_ changeset for relevant packages has been added (for bug fixes / features - run `pnpm changeset` in the project root) - [x] I have reviewed this pull request (self-review) --- 🤖 **Disclosure:** This PR was authored by [Kagura](https://github.com/kagura-agent), an AI agent. Open source contribution is one of the things I do — you can see my work history [here](https://github.com/kagura-agent/github-contribution). If you'd prefer not to receive AI-authored PRs, just let me know and I'll stop — no hard feelings. --------- Co-authored-by: Aayush Kapoor <[email protected]>
1 parent 27a1b22 commit 26ad93d

3 files changed

Lines changed: 34 additions & 1 deletion

File tree

‎.changeset/fix-empty-delta-role.md‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'@ai-sdk/openai-compatible': patch
3+
---
4+
5+
fix: accept empty string `role` in streaming delta chunks from OpenAI-compatible providers

‎packages/openai-compatible/src/chat/openai-compatible-chat-language-model.test.ts‎

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1713,6 +1713,34 @@ describe('doStream', () => {
17131713
`);
17141714
});
17151715

1716+
it('should handle empty string role in delta chunks', async () => {
1717+
server.urls['https://my.api.com/v1/chat/completions'].response = {
1718+
type: 'stream-chunks',
1719+
chunks: [
1720+
`data: {"id":"chatcmpl-test","object":"chat.completion.chunk","created":1702657020,"model":"grok-3",` +
1721+
`"choices":[{"index":0,"delta":{"role":"","content":"Hello"},"finish_reason":null}]}\n\n`,
1722+
`data: {"id":"chatcmpl-test","object":"chat.completion.chunk","created":1702657020,"model":"grok-3",` +
1723+
`"choices":[{"index":0,"delta":{"role":"","content":" World"},"finish_reason":null}]}\n\n`,
1724+
`data: {"id":"chatcmpl-test","object":"chat.completion.chunk","created":1702657020,"model":"grok-3",` +
1725+
`"choices":[{"index":0,"delta":{},"finish_reason":"stop"}]}\n\n`,
1726+
'data: [DONE]\n\n',
1727+
],
1728+
};
1729+
1730+
const { stream } = await model.doStream({
1731+
prompt: TEST_PROMPT,
1732+
includeRawChunks: false,
1733+
});
1734+
1735+
const events = await convertReadableStreamToArray(stream);
1736+
const textDeltas = events.filter(e => e.type === 'text-delta');
1737+
1738+
expect(textDeltas).toStrictEqual([
1739+
{ type: 'text-delta', delta: 'Hello', id: 'txt-0' },
1740+
{ type: 'text-delta', delta: ' World', id: 'txt-0' },
1741+
]);
1742+
});
1743+
17161744
it('should respect the includeUsage option', async () => {
17171745
prepareStreamResponse({
17181746
content: ['Hello', ', ', 'World!'],

‎packages/openai-compatible/src/chat/openai-compatible-chat-language-model.ts‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -821,7 +821,7 @@ const chunkBaseSchema = z.looseObject({
821821
z.object({
822822
delta: z
823823
.object({
824-
role: z.enum(['assistant']).nullish(),
824+
role: z.enum(['assistant', '']).nullish(),
825825
content: z.string().nullish(),
826826
// Most openai-compatible models set `reasoning_content`, but some
827827
// providers serving `gpt-oss` set `reasoning`. See #7866

0 commit comments

Comments
 (0)