Reward model
A model trained on preference data to give a response a single score predicting how much people would like it.
The rankings are then used to train a reward model: a network that reads a prompt and a response and outputs one number, a score for how much people would like it.
See it in action
Try reward model hands-on in the lesson Instruction tuning and RLHF, part of the How AI assistants work course.