Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsSequences, Language & Attention

Translation Bottleneck

A four-word French sentence is squeezed into one fixed-size vector. The decoder, which writes the translation, sees nothing but that vector.

le
chat
noir
dort
→
→
...

Every encoder state is discarded. Only that one amber vector reaches the decoder — the entire input, however long, squeezed through it.

Customize