Glossary · term

Router models / Cascade routing

A lightweight orchestration layer that analyzes an incoming prompt and routes it to a model appropriate to the task's complexity: simple queries go to cheaper, smaller models (SLMs), while difficult ones go to larger models. The cascade variant may try a cheaper model first and escalate when confidence is low. E.g., RouteLLM, Martian.

LLMOps2024–2026Wave 2 · 2024Maturity: 5/5

Maturity rationale

Model Liability Framework — in regulatory circulation