Gradient Descent Optimization

Know a great resource on Gradient Descent Optimization? Send it to us at contactbackprop@gmail.com!

Lectures

Gradient Descent: Downhill to a Minimum

  • MIT OpenCourseWare Lecture on Gradient Descent

Posts

Gradient Descent

  • A simple introduction of gradient descent and a brief look at other GD algorithms


Gradient Descent | ML Glossary

  • A short lesson on Gradient Descent along with some code


Gradient Descent applied to neural networks

  • A look at how neural networks learn using gradient descent


An overview of gradient descent optimization algorithms

  • A post explaining simple gradient descent algorithms and more complex versions for deep learning

Code Examples

Gradient descent example

  • Simple implementation of gradient descent for linear regression with numpy


Gradient Descent Example for Linear Regression

  • A simple example in a jupyter notebook with visualization

Tagged Pages: Adam Optimizer, Neural Networks (MLPs)

Know a great resource on Gradient Descent Optimization? Send it to us at contactbackprop@gmail.com!