Models & architecture
Reasoning model
A model optimised to spend additional computation solving complex tasks.
Definition
A reasoning model generates or uses intermediate computational steps before returning an answer, often with adjustable inference effort.
Why it matters
Additional reasoning can improve finance and coding tasks but increases latency, cost and the need to control inference budgets.
Related concepts
- Inference budget
The compute, token, time or attempt allowance given to solve a task.
- Chain of thought
Intermediate reasoning steps produced or used while solving a task.
- Cost per task
The full variable cost of completing a defined unit of work.