Sampling

Choosing the next token at random, weighted by the model’s probabilities.

See it in action

Try sampling hands-on in the lesson Predicting the next word, part of the AI fundamentals course.

Open the lesson