Swap "dog bites man" to "man bites dog" and attention sees the exact same unordered set of words. That lost order is why position must be added in.
Two sentences with opposite meanings look identical to attention. Nothing in the mechanism knows which word came first.
