Click to turn four raw word scores, one of them negative, into attention weights with softmax. Every weight becomes positive and lands between 0 and 1.
the
0.30
cat
2.40
sat
1.10
down
-0.60
Raw scores can be negative and have no upper bound — unusable as weights.
