Query

In attention, a vector describing what a token is looking for.

To score how well two tokens match, multiply the query and the key number by number and add the results up.
From Attention, step “Queries and keys”

See it in action

Try query hands-on in the lesson Attention, part of the AI fundamentals course.

Open the lesson