Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsCalculus & Optimization

Optimization & Gradient Descent

Slide one knob and watch the score move along a U-shaped curve. Optimization means finding the setting with the lowest score, at the bottom.

One Knob, One Score

Spoons of sugar1.2

Score for every setting of the knob (score = 6.55)

024680369
Score right now: 6.55
Best score you have found: 6.55 at 1.2 spoons

Optimizing means exactly this: turn the knob, read the score, keep the setting with the lowest score. Lower is better, so we are always hunting for the bottom of the curve. Everything that follows is about doing this hunt automatically, without checking every setting by hand.

Customize