-
-
Notifications
You must be signed in to change notification settings - Fork 452
Output token count is highly inaccurate. #705
Copy link
Copy link
Open
Description
Anthropic changed the way output tokens are treated in the logs. Neither thinking tokens nor tool use tokens are being correctly counted.
You need to use a more complex method to reconstruct accurate output tokens from the other values.
See this example from writing a fairly long markdown file:
This is 8836 output tokens, not 13!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels