Risk & governance
Reproducibility
The ability to repeat an evaluation under documented conditions.
Definition
A reproducible eval preserves the dataset, system configuration, model version, prompts, tools, scorer and inference settings.
Why it matters
Without reproducibility, score changes cannot be reliably attributed to a model or system improvement.
Related concepts
- System under test
The complete configuration being evaluated—not only the model.
- Evaluation harness
The software and rules used to run and score an eval.
- Audit trail
A durable record of inputs, evidence, decisions, actions and versions.