Backpropagation

Know a great resource on Backpropagation? Send it to us at contactbackprop@gmail.com!

Papers

Learning Representations by Back-propagating Errors

The famous paper introducing backpropagation for machine learning

Lectures

Andrej Karpathy’s lecture on backpropagtion

A University of Michigan lecture on backprop by Justin Johnson

Lecture 4: Backpropagation and Neural Networks

A Stanford Lecture on backprop by Serena Yeung

Videos

3Blue1Brown on Backpropagation Part 1 and Part 2

A couple videos explaining backpropagation and the underlying math

While you’re at it, check out the rest of his videos on neural networks

Gradient Descent for Neural Networks and Backpropagation Intuition

Andrew Ng’s walkthrough of backpropagation from his Coursera course

Posts

Yes, You Should Understand Backprop

A medium post by Andrej Karpathy about why learning backprop is still important

A lesson on backpropagation from Karpathy’s Stanford course

A brilliant (pun intended), detailed lesson on backprop by Brilliant.org

A review of the chain rule, backpropagation, and some code

Code Examples

A simple example of training a neural network in pytorch using backpropagation

Neural Network backpropagation from scratch in Python

A cool example of training a neural network from scratch with just numpy

Tagged Pages: Neural Networks (MLPs)

Know a great resource on Backpropagation? Send it to us at contactbackprop@gmail.com!