A plain RNN carries one memory, rewritten at every step. Click to add an LSTM's cell state: a second, long-term memory that is hard to disturb.
A plain RNN carries one memory, rewritten at every step.