Models & architecture
Context window
The maximum information a model can process in one interaction.
Definition
The context window includes instructions, retrieved documents, conversation history, tool results and the generated response.
Why it matters
A large advertised window does not prove accurate use of every detail; long-context retrieval and attention still require testing.
Related concepts
- System under test
The complete configuration being evaluated—not only the model.
- Retrieval-augmented generation
Generating answers using information retrieved at request time.
- Token
A unit of text processed or generated by a language model.