Gradient descent is run on the mean-squared-error loss
with the update rules
The data are the four points
Training starts at and with learning rate . Both parameters are updated simultaneously, each using the predictions from the starting values.
What are and after exactly one step?
Once you get it right, the reasoning behind the answer shows up here.
Select all that apply.
The slope tells you which way is uphill, so you subtract it to head downhill. Near the edge the ground is steep and the steps are long. As the ground flattens the slope shrinks, so the steps shrink with it, and the walk eases into the bottom instead of shooting past it.