Production operations
Continuous evaluation
Rerunning tests as a system and its environment change.
Definition
Continuous evaluation automatically or regularly repeats selected evals before releases and during production monitoring.
Why it matters
It turns evaluation from a one-off approval exercise into an ongoing control against regressions and drift.
Related concepts
- Evaluation suite
A coordinated collection of evals covering different capabilities and risks.
- Model or system drift
Performance changing as models, data, users or environments evolve.
- Production monitoring
Observing system behaviour and outcomes after deployment.