Long Short-Term Memory (LSTMs)

Know a great resource on LSTMs? Send it to us at contactbackprop@gmail.com!

Tags: Recurrent Neural Networks, Gated Recurrent Units

Papers

Long Short-Term Memory

  • Original Paper introducing LSTMs in 1997


A tutorial into Long Short-term Memory Recurrent Neural Networks

  • A detailed, more technical explanation of LSTMs from 2019

Videos

Long Short Term Memory

  • Video by Andrew Ng explaining LSTMs and comparing them to GRUs


LSTM Networks - EXPLAINED!

  • Video by CodeEmporium


Illustrated Guide to LSTM’s and GRU’s

  • A lesson on LSTMs (and GRUs)

Posts

Understanding LSTM Networks

  • An excellent blog post explaining LSTMs with illustrations


Illustrated Guide to LSTM’s and GRU’s

  • A popular post on towardsdatascience explaining LSTMs (and GRUs)


Long Short-Term Memory: From Zero to Hero

  • Explanation of LSTMs with code and an example project

Code Examples

LSTM in Tensorflow

  • A simple example of a LSTM trained on MNIST


LSTM in Pytorch

  • A simple example of a LSTM network in pytorch


RNNs and LSTMs from Scratch

  • A tutorial on:

    • How to represent categorical variables in networks

    • How to build a recurrent neural network (RNN) from scratch

    • How to build a LSTM network from scratch

    • How to build a LSTM network in PyTorch


Textbook Sections

LSTM | Deep Learning Chapter 10.10.1 (Page 404)

  • A section on LSTMS from the Goodfellow Deep Learning textbook


Long Short-term Memory | Chapter 9.2

  • A section on LSTMs from the Deep Dive into Deep Learning textbook

Related Pages: Gated Recurrent Units

Know a great resource on LSTMs? Send it to us at contactbackprop@gmail.com!