Cache-Augmented Generation (CAG)

An alternative to classic RAG: instead of dynamically retrieving documents on every query, the system loads the entire knowledge base into the model's context up front and leverages a state cache (KV-cache) or a shared prefix. It eliminates the latency and errors of the retrieval stage, working best with long context (2024-2025).