A model is trained on the loss
with the usual update rule
starting from .
For this loss there is exactly one learning rate that would carry the parameter from onto the minimising value of in a single step — a perfect stride, landing precisely at the bottom.
An impatient engineer decides that if is good, then training three times faster must be better, and runs the model with
Starting again from , what is the value of the loss after one step at this larger learning rate?
Give the loss rounded to 2 decimal places.