Demonstration

An example reply, written or chosen by a person, used to show a model the behaviour wanted.

For InstructGPT, OpenAI’s 2022 recipe, labellers wrote these demonstrations for about 13,000 training prompts.
From Instruction tuning and RLHF, step “Step 1: learn from demonstrations”

See it in action

Try demonstration hands-on in the lesson Instruction tuning and RLHF, part of the How AI assistants work course.

Open the lesson