OpenAI Developers introduces a Prompt Caching Dashboard and diagnostics API
OpenAI Developers has introduced a new Prompt Caching Dashboard on platform.openai.com that tracks cache-hit rates.
A diagnostics API identifies changes that prevented reuse and estimates how many tokens were affected.