Skip to content

Handle API Rate Limits sensibly #887

@swamikevala

Description

@swamikevala

While running goose with Anthropic API, I get the following error:

Ran into this error: Rate limit exceeded: Some(Object {"error": Object {"message": String("This request would exceed y
our organization’s rate limit of 80,000 input tokens per minute. For details, refer to: https://docs.anthropic.com/en/
api/rate-limits; see the response headers for current usage. Please reduce the prompt length or the maximum tokens req
uested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your opti
ons for a rate limit increase."), "type": String("rate_limit_error")}, "type": String("error")}).

Please retry if you think this is a transient or recoverable error.

( O)>                                                        

Goose should be able to fall back to a different API-Key or model, or be able to adjust it's frequency of API calls so that it stays within the limits and is able to make progress on the task. Not just stop

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestp2Priority 2 - Medium

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions