Assistant Threads Create: 400: messages array too long

API
, ,
1

Hi,

I’m running into issues when creating new threads with existing messages. Sending POST to https://api.openai.com/v1/threads with more than 32 messages. Since this limit isn’t documented anywhere, I wonder, is it intentional?

Error:

{
	"error": {
		"message": "Invalid 'messages': array too long. Expected an array with maximum length 32, but got an array with length 36 instead.",
		"type": "invalid_request_error",
		"param": "messages",
		"code": "array_above_max_length"
	}
}

I would like to restore “backups” of previous threads with more than 32 messages. The only workaround I could think of was to manually create messages using the message/createMessage API, but that increases the latency by quite a bit since this would have to be a sequential operation. I would appreciate any pointers in the right directions.

Thanks!

3 Likes
2

I’m running into the same trouble. Most frustrating that this limit is not documented anywhere.

3

@oleg4 did you find any solutions to this?

4

Not an ideal one :confused: I ended up creating a thread with 32 messages and then sequentially populate the rest:

const first32Messages = chatMessages.slice(0, 32);
// There is a undocumented limit of 32 messages per thread when creating a thread with messages
const mappedMessages: OpenAIClient.Beta.Threads.ThreadCreateParams.Message[] =
  first32Messages.map(mapChatMessageToThreadMessage);

thread = await client.beta.threads.create({ messages: mappedMessages });
const overLimitMessages = chatMessages.slice(32).map(mapChatMessageToThreadMessage);

// Send the remaining messages that exceed the limit of 32 sequentially
for (const message of overLimitMessages) {
  await client.beta.threads.messages.create(thread.id, message);
}

Which is obviously not great because there’s added delay for each threads.messages.create operation as it fires a request.

5

I encountered

openai.BadRequestError: Error code: 400 - {'error': {'message': "Invalid 'content': string too long. Expected a string with maximum length 256000, but got a string with length 268401 instead.", 'type': 'invalid_request_error', 'param': 'content', 'code': 'string_above_max_length'}}

which is similar but a different another error.

6

It’s frustrating that this limit isn’t documented anywhere :pensive_face: