Lectures

Gradient Descent: Downhill to a Minimum

• MIT OpenCourseWare Lecture on Gradient Descent

Videos

Gradient Descent, how neural networks learn | 3blue1brown

• By 3blue1brown

Gradient Descent, Step-by-step

• Explanation by StatQuest

Gradient Descent, Logistic Regression Gradient Descent, Gradient Descent on m Examples, Gradient Descent for Neural Networks,

• Andrew Ng’s videos on Gradient Descent from his Coursera course

Posts

Gradient Descent

• A simple introduction of gradient descent and a brief look at other GD algorithms

Gradient Descent | ML Glossary

• A short lesson on Gradient Descent along with some code

Gradient Descent applied to neural networks

• A look at how neural networks learn using gradient descent

An overview of gradient descent optimization algorithms

• A post explaining simple gradient descent algorithms and more complex versions for deep learning

Code Examples

Gradient descent example

• Simple implementation of gradient descent for linear regression with numpy

Gradient Descent Example for Linear Regression

• A simple example in a jupyter notebook with visualization