How Models Learn

Chat template

The fixed text format, with special tokens, that lays out a conversation for an assistant model.

Every conversation is laid out as one long text in a fixed format, a chat template, with special tokens marking who is speaking.
From Instruction tuning and RLHF, step “Step 1: learn from demonstrations”

See it in action

Try chat template hands-on in the lesson Instruction tuning and RLHF, part of the How AI assistants work course.

Open the lesson