Inference & optimisation
Temperature
A setting controlling randomness in a model's token selection.
Definition
Temperature rescales token probabilities during generation, with lower values usually producing more consistent and conservative outputs.
Why it matters
Changing temperature can alter reproducibility, creativity and error rates, so it belongs in the documented system configuration.
Related concepts
- Sampling
Selecting generated tokens from the probability distribution produced by a model.
- System under test
The complete configuration being evaluated—not only the model.
- Reproducibility
The ability to repeat an evaluation under documented conditions.