Bars show the numbers growing bigger at each layer as small changes add up. Turn normalization on to reset every layer to a steady size.
Each layer nudges the scale a little. Over a deep stack, small nudges compound into numbers the network cannot train on.
