How Models Learn

Greedy decoding

Always choosing the single most likely next token.

Always taking the top token, called greedy decoding, sounds sensible but often gets stuck.
From Predicting the next word, step “One token at a time”

See it in action

Try greedy decoding hands-on in the lesson Predicting the next word, part of the AI fundamentals course.

Open the lesson