Inside an attention layer built at width d=4, one position has produced the query
q=[2−103]
and the three positions it is attending to have produced the keys
k1=[1211],k2=[0420],k3=[3101]
What is the row of scaled attention scores (s1, s2, s3) that this query produces — the numbers that go into the softmax?