Glossary · term
Router models / Cascade routing
A lightweight orchestration layer that analyzes an incoming prompt and routes it to a model appropriate to the task's complexity: simple queries go to cheaper, smaller models (SLMs), while difficult ones go to larger models. The cascade variant may try a cheaper model first and escalate when confidence is low. E.g., RouteLLM, Martian.
LLMOps2024–2026Wave 2 · 2024Maturity: 5/5
Maturity rationale
Model Liability Framework — in regulatory circulation