Long Short-Term Memory (LSTMs)
Know a great resource on LSTMs? Send it to us at contactbackprop@gmail.com!
Papers
Original Paper introducing LSTMs in 1997
A tutorial into Long Short-term Memory Recurrent Neural Networks
A detailed, more technical explanation of LSTMs from 2019
Videos
Video by Andrew Ng explaining LSTMs and comparing them to GRUs
Video by CodeEmporium
Illustrated Guide to LSTM’s and GRU’s
A lesson on LSTMs (and GRUs)
Posts
An excellent blog post explaining LSTMs with illustrations
Illustrated Guide to LSTM’s and GRU’s
A popular post on towardsdatascience explaining LSTMs (and GRUs)
Long Short-Term Memory: From Zero to Hero
Explanation of LSTMs with code and an example project
Code Examples
A simple example of a LSTM trained on MNIST
A simple example of a LSTM network in pytorch
A tutorial on:
How to represent categorical variables in networks
How to build a recurrent neural network (RNN) from scratch
How to build a LSTM network from scratch
How to build a LSTM network in PyTorch
Textbook Sections
LSTM | Deep Learning Chapter 10.10.1 (Page 404)
A section on LSTMS from the Goodfellow Deep Learning textbook
Long Short-term Memory | Chapter 9.2
A section on LSTMs from the Deep Dive into Deep Learning textbook
Related Pages: Gated Recurrent Units
Know a great resource on LSTMs? Send it to us at contactbackprop@gmail.com!