One query is scored against four positions of a sentence, giving the raw score row
s=[2.0, 1.0, 1.0, 0.0]
Softmax — exponentiate every score, then divide by the total — turns that row into attention weights:
softmax(s)i=∑jesjesi⟹softmax(s)≈[0.5344, 0.1966, 0.1966, 0.0723]
Below are four other score rows over the same four positions. Exactly one of them produces the identical weight at every position — 0.5344 on the first, 0.1966 on the second and third, 0.0723 on the fourth.
Which row is it?