How Models Learn

Chunking

Splitting long documents into short passages so each can be embedded and retrieved separately.

Splitting articles into passages, called chunking, matters too.
From Retrieval-augmented generation, step “How many passages go in? Top-k”

See it in action

Try chunking hands-on in the lesson Retrieval-augmented generation, part of the How AI assistants work course.

Open the lesson