Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsSequences, Language & Attention

Attention Score

Click to multiply a query and a key, one matching pair of numbers at a time, adding as you go. The total, called a dot product, is the attention score.

0.6×0.4—
-0.2×0.3—
0.5×0.7—
score0.00

Multiply matching positions and add. That is a dot product — the same operation a convolution filter performs.

Customize