How Models Learn

Truncation

Cutting text, often the oldest messages, so that a conversation fits inside the context window.

Here the app drops the oldest exchanges first, a kind of truncation.
From Tokens and context windows, step “When the chat outgrows the window”

See it in action

Try truncation hands-on in the lesson Tokens and context windows, part of the How AI assistants work course.

Open the lesson