Consistent key name for cached tokens

I'd like to read the cached tokens from a `ChatResponse` but the key in `ChatResponse.Usage.AdditionalCounts` depends on the provider:
- [`InputTokenDetails.CachedTokenCount` for OpenAI](https://github.com/dotnet/extensions/blob/152765fd47617f6930029a74f22d7d36ccda9f31/src/Libraries/Microsoft.Extensions.AI.OpenAI/OpenAIResponsesChatClient.cs#L1151)
- [`CachedContentTokenCount` for VertexAI](https://github.com/googleapis/google-cloud-dotnet/blob/d620e5295931ed90b6ccb3617a72f10d46ad7601/apis/Google.Cloud.VertexAI.Extensions/Google.Cloud.VertexAI.Extensions/PredictionServiceChatClient.cs#L518)
- [`CacheReadInputTokens` for Anthropic](https://github.com/anthropics/anthropic-sdk-csharp/blob/957b674e9bc2db9e9526a402bb2338778788413e/src/Anthropic/AnthropicClientExtensions.cs#L942)

Could we do a breaking a change to have a consistent key for the cached tokens or maybe add the cache tokens as a property of UsageDetails?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Consistent key name for cached tokens #7101

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Consistent key name for cached tokens #7101

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions