Glossary
The amount of text a language model can consider at once for a request, measured in tokens.
Everything the model should see has to fit: system instruction, conversation, supplied documents and the expected answer. When it is full, something has to give.
Large windows do not solve the problem by themselves. Models attend to the beginning and the end more reliably than the middle, and every extra token costs money and time.