Value

In attention, the information a token passes on to the tokens that attend to it.

Each token also has a third vector, its value: the information it passes on when someone pays attention to it.
From Attention, step “Mixing in the values”

See it in action

Try value hands-on in the lesson Attention, part of the AI fundamentals course.

Open the lesson