GitHub - lilipads/gradient_descent_viz: interactive visualization of 5 popular gradient descent methods with step-by-step illustration and hyperparameter tuning UI
Gradient Descent Visualization
Gradient Descent Viz is a desktop app that visualizes some popular gradient descent methods
in machine learning, including (vanilla) gradient descent, momentum, AdaGrad, RMSProp and Adam. My hope is that by playing around with the different settings, anyone -- beginner or expert -- can come away with new intuitive understanding of these methods. Read here for the accompanying blog post that explains these methods in detail.
Features
Choose between a few different s...
Read more at github.com