Gradient descent is used to fit a line y^=b0+b1x to the four points
(1,2),(2,3),(3,5),(4,6)
The loss is the mean squared error
J(b0,b1)=n1∑i=1n(b0+b1xi−yi)2
and the parameters are updated with
b0:=b0−ηn2∑(y^i−yi),b1:=b1−ηn2∑(y^i−yi)xi
Training starts at b0=0.5 and b1=1.0 with learning rate η=0.1. Both parameters are updated simultaneously, each gradient computed from the predictions at the starting values.
Exactly one step is taken. What is the value of the loss J at the new parameters?
Round your answer to 2 decimal places.