Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsSequences, Language & Attention

Attention in Translation

Click to add attention to a translation model. Instead of one summary of the French sentence, the decoder can look at every word directly, at every step.

le
chat
noir
dort
↑
decoder

Without attention the decoder sees only one summary vector.

Customize