Context window

The maximum amount of text, in tokens, a language model can consider at once, including the prompt and its answer. Longer windows cost more compute and models often use the middle poorly.

Used in these articles

Related terms

AI and machine learning

• AI agent
• Brain-computer interface
• Combinatorial optimization
• Computer vision
• Deep learning
• Domain generalization
• Electroencephalography
• Frontier model
• Hallucination
• Inference
• Large language model
• Machine learning
• Matrix multiplication
• Memristor
• Metaheuristic
• Model drift
• Multiply-accumulate
• Neural network
• Neuromorphic computing
• NP-hard
• Operations research
• Quantization
• Reinforcement learning
• Reservoir computing
• Self-play
• Spiking neural network
• SSVEP
• Token
• Training
• Transformer