VisualizationsSequences, Language & Attention

LSTM Gates

Slide the forget gate to choose how much of its old memory an LSTM keeps. Near 1 it keeps everything; near 0 it wipes the memory clean.

old cell state

0.80

-0.50

0.60

0.30

↓ × forget

0.80

-0.50

0.60

0.30

forget1.00

Near 1: keep everything.

Customize