-
Notifications
You must be signed in to change notification settings - Fork 3.2k
Handle API Rate Limits sensibly #887
Copy link
Copy link
Labels
Description
While running goose with Anthropic API, I get the following error:
Ran into this error: Rate limit exceeded: Some(Object {"error": Object {"message": String("This request would exceed y
our organization’s rate limit of 80,000 input tokens per minute. For details, refer to: https://docs.anthropic.com/en/
api/rate-limits; see the response headers for current usage. Please reduce the prompt length or the maximum tokens req
uested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your opti
ons for a rate limit increase."), "type": String("rate_limit_error")}, "type": String("error")}).
Please retry if you think this is a transient or recoverable error.
( O)>
Goose should be able to fall back to a different API-Key or model, or be able to adjust it's frequency of API calls so that it stays within the limits and is able to make progress on the task. Not just stop
Reactions are currently unavailable