Skip to content

Conversation

@zoooo0820
Copy link
Collaborator

@zoooo0820 zoooo0820 commented Aug 5, 2025

fix error happened when stop sequence of requests has out-of-bound illegal value.

  • num of stop sequences is over the FD_MAX_STOP_SEQS_NUM . In this case, the client will receive the error message like
openai.BadRequestError: Error code: 400 - {'object': 'error', 'message': 'Length of stop ([2, 16, 2, 1, 3, 3]) exceeds the limit max_model_len(5).Please reduce the number of stop or set a lager max_stop_seqs_num by `FD_MAX_STOP_SEQS_NUM`', 'code': 400}
  • length of one stop sequences is over the FD_STOP_SEQS_MAX_LEN. In this case, the client will receive the error message like
openai.BadRequestError: Error code: 400 - {'object': 'error', 'message': 'Length of stop_seqs(16) exceeds the limit max_model_len(8).Please reduce the length of stop sequences or set a larger stop_seqs_max_len by `FD_STOP_SEQS_MAX_LEN`', 'code': 400}

@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 9423c57 into PaddlePaddle:develop Aug 7, 2025
11 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants