Papers

Long Short-Term Memory

• Original Paper introducing LSTMs in 1997

A tutorial into Long Short-term Memory Recurrent Neural Networks

• A detailed, more technical explanation of LSTMs from 2019

Videos

Long Short Term Memory

• Video by Andrew Ng explaining LSTMs and comparing them to GRUs

LSTM Networks - EXPLAINED!

• Video by CodeEmporium

Illustrated Guide to LSTM’s and GRU’s

• A lesson on LSTMs (and GRUs)

Posts

Understanding LSTM Networks

• An excellent blog post explaining LSTMs with illustrations

Illustrated Guide to LSTM’s and GRU’s

• A popular post on towardsdatascience explaining LSTMs (and GRUs)

Long Short-Term Memory: From Zero to Hero

• Explanation of LSTMs with code and an example project

Code Examples

LSTM in Tensorflow

• A simple example of a LSTM trained on MNIST

LSTM in Pytorch

• A simple example of a LSTM network in pytorch

RNNs and LSTMs from Scratch

• A tutorial on:

  • How to represent categorical variables in networks

  • How to build a recurrent neural network (RNN) from scratch

  • How to build a LSTM network from scratch

  • How to build a LSTM network in PyTorch

Textbook Sections

LSTM | Deep Learning Chapter 10.10.1 (Page 404)

• A section on LSTMS from the Goodfellow Deep Learning textbook

Long Short-term Memory | Chapter 9.2

• A section on LSTMs from the Deep Dive into Deep Learning textbook

APIs

Pytorch: torch.nn.LSTM

Keras: tf.keras.layers.LSTM