Two small networks side by side: a shallow one with one hidden layer and a deep one with three. Adding hidden layers is what makes a network deep.
“Deep” describes how many transformations get composed.
