Glossary · term

Workload–Router–Pool Architecture (WRP)

An inference-optimization framework that decomposes the problem into three axes: workload type, routing logic, and the pool of compute resources. Described in 2026 within the vLLM Semantic Router Project, it captures the shift from "a bigger model" toward an architecture of fleets of models and routers selected based on cost and latency.

Training2026Wave 2 · 2024Maturity: 1/5

Maturity rationale

single R2 source, 2025-26 neologism