Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsSequences, Language & Attention

Backpropagation Through Time

Step forward through five time steps of a recurrent network, each one reusing the same weights. This is the chain that the error later travels back along.

t=0
W
→
t=1
W
→
t=2
W
→
t=3
W
→
t=4
W

The forward pass runs left to right through time, each step feeding the next. Nothing here is new — it is the forward pass from Card 2, repeated once per token.

Customize