Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsNeural Networks & How They Learn

Comparing Optimizers

The paths of three optimizers, or ways of stepping downhill, on a round bowl seen from above. On an easy shape like this, all three do fine.

plainmomentumadam

On an easy round bowl every optimizer does fine. The differences barely show.

Customize