Four layers in a row, with only the output lit up. Backpropagation starts at the end, the only place the error is known, and works back toward the input.
input
←
hidden 1
←
hidden 2
←
output
Backpropagation starts at the end, because the end is the only place the error is known.
