All terms

Glossary

Chunking

Splitting documents into sections that can be searched individually and handed to a model.

Sections that are too large dilute retrieval, because a hit drags in much that does not fit. Too small and context is torn apart, leaving the answer without grounding.

Better approaches split along document structure, headings and paragraphs, rather than by fixed character count.