Inference & optimisation
Model routing
Selecting different models based on task, risk, cost or availability.
Definition
Model routing applies rules or learned classifiers to send each request to the most appropriate model or system configuration.
Why it matters
Routing can improve economics and resilience but makes validation, user disclosure and outcome consistency more complex.
Related concepts
- Mixture of experts
An architecture that activates selected specialist sub-networks for each input.
- Model version
A uniquely identifiable release or snapshot of a model.
- Fallback
A safe alternative when the preferred AI path cannot continue.