Key

In attention, a vector describing what a token offers, matched against queries.

To score how well two tokens match, multiply the query and the key number by number and add the results up.
From Attention, step “Queries and keys”

See it in action

Try key hands-on in the lesson Attention, part of the AI fundamentals course.

Open the lesson