Click to add 36 more layers to a 20-layer network. Training error gets worse, not better, which is the puzzle residual connections solve.
A 20-layer network trains nicely. What happens if we add 36 more layers?
