Overview

Recent models from OpenAI support explicit caching: https://developers.openai.com/api/docs/guides/prompt-caching#prompt-cache-breakpoints

Motivation

Can it improve caching?

Use cases

No response

Proposed solution

No response

Alternatives

No response

Related issues

No response

Additional context

No response