The loss L(w)=2w2−8w is minimised twice, both runs starting from w0=5 with α=0.1.
Run A — plain gradient descent
wt+1=wt−αL′(wt)
Run B — momentum (velocity starts at zero, β=0.9)
vt=βvt−1+L′(wt),wt+1=wt−αvt
Run each for three updates. What is w3 in each run, and what has momentum actually done?