Gradient descent is run on the mean-squared-error loss
J(b0,b1)=n1∑i=1n(b0+b1xi−yi)2
with the update rules
b0:=b0−ηn2∑(y^i−yi),b1:=b1−ηn2∑(y^i−yi)xi
The data are the four points
(1,3),(2,5),(3,4),(4,8)
Training starts at b0=1 and b1=1 with learning rate η=0.1. Both parameters are updated simultaneously, each using the predictions from the starting values.
What are b0 and b1 after exactly one step?