The context window is the total number of tokens an LLM can hold in its working memory during a conversation or task — including both the input (prompt, documents, conversation history) and the output (generated response). Larger context windows allow models to process longer documents, maintain coherence across lengthy conversations, and perform more complex reasoning tasks. Context window size varies by model and is a key factor when selecting an AI tool for tasks involving large amounts of text.
AI Fundamentals
| LLM
What is Context Window?
The maximum amount of text a language model can process and consider in a single interaction.
FAQs
Questions about Context Window
What is a context window in AI, explained simply?
A context window is the amount of text an AI model can consider at once, both what you’ve given it and what it’s generating, measured in tokens rather than words. Once a conversation or document exceeds that limit, the model starts losing track of the earliest parts, since they fall outside its working memory.
Why does context window size matter when using AI tools?
A larger context window lets a model handle longer documents, longer conversations, or more reference material in one go without forgetting earlier details, which matters for tasks like reviewing a long report or having an extended back and forth conversation. Different AI tools and plans offer noticeably different context window sizes.
What happens when an AI conversation exceeds its context window?
The model typically starts dropping or summarizing the earliest parts of the conversation to make room for new input, which can cause it to forget instructions or details mentioned much earlier. For long projects, it often helps to periodically restate key context or start a fresh conversation with a clear summary.
