Infinite context vs RAG

An architectural debate over how to supply a model with knowledge: whether to dump all the data into an ever-larger context window, or to select fragments via retrieval-augmented generation backed by a vector database. At stake are cost, latency, precision, and the risk of losing information within long context. The discussion has been growing since 2024.