Models & architecture
Long-context model
A model designed to process unusually large amounts of input at once.
Definition
A long-context model supports a large context window for documents, histories or codebases without requiring every item to be retrieved separately.
Why it matters
Advertised capacity is not equivalent to accurate recall or reasoning across an entire annual report, policy library or transaction history.
Related concepts
- Attention
A mechanism that weights which parts of an input matter for each output.
- Retrieval-augmented generation
Generating answers using information retrieved at request time.
- Context window
The maximum information a model can process in one interaction.