A flat line shows the learning rate, or step size, never changing during training. That works early on, but near the end the steps are too big to settle.
The rate never changes. Early progress is fine, but near the bottom the steps are too big to settle.
