Slide a point along the sigmoid curve and read its slope. It is never above 0.25 and nearly zero at the ends, so gradients shrink layer by layer.
The steepest sigmoid ever gets is 0.25 — and out at the flat ends it is very nearly zero.
