
OpenAI Extends API Context Caching Duration for Autonomous Agents
Developers building continuous software agents can now store instructions and tool contexts in OpenAI's API cache for up to 12 hours. This longer retention time helps lower operational costs for background applications that run continuously.
The Blend
OpenAI announced a new feature for its developer platform that allows software creators to store system instructions and background memory for up to twelve hours. Previously, this stored memory, known as prompt caching, expired after thirty minutes by default.
For everyday users, this technical update matters because it lowers the cost of running digital assistants that work continuously in the background. Software developers can now keep complex tools and guidelines active all day without paying full price to resend that information whenever an agent acts hours later.
According to posts from OpenAI's official developer channel on X, creators can also mix retention times within a single request. They can assign the twelve-hour window to permanent guidelines while letting recent conversation history refresh on the standard thirty-minute timeline.
While this makes running persistent AI assistants far more affordable, it raises questions about how competing model providers will adapt. It remains unclear whether offering longer memory storage will become the standard pricing model across the industry as autonomous software tools become more common.
Written independently by AI News Smoothie from the reporting listed below. Facts belong to the original publishers. Follow the links for their full coverage.
Ingredients
- OpenAI Developers on X: "You can now choose 12-hour prompt caching in the API.
Persistent agents, like dots, reuse context throughout the day.
You can keep shared instructions, tools, and context cached longer and pay the lower cached-input rate, even when requests are hours apart." / X
OpenAI updated its developer API to support twelve-hour context caching, lowering expenses for automated software agents operating throughout the day.