Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsSequences, Language & Attention

Transformer Stack

Click to add transformer blocks one by one, up to six. Each new block gives every token one more round of sharing information.

one hop of information between any two tokens

One block lets tokens look at each other once. Real understanding needs conclusions built on earlier conclusions — which needs depth.

Customize