Papers

Improving Language Understanding by Generative Pre-Training

• Paper by OpenAI introducing GPT-1

Videos

What is GPT

• A video with visuals of the GPT-1 model

GPT Explained

• A short video covering the main details of the GPT-1 paper

GPT-1

• A video which discusses the basics of GPT-1

Posts

GPT - Generalized Language Models

• A section on GPT-1 from Lilian Weng’s blog post

Code Examples

GPT Tutorial

• A GPT-1 tutorial/implementation walkthrough in pytorch

OpenAI’s GPT code

• The code provided with the GPT paper (in tensorflow 1)

Karpathy’s minGPT

• A pytorch implementation of a mini GPT for learners

minGPT-TF

• A tensorflow recreation of Karpathy’s minGPT

APIs

Transformers GPT API

• A GPT-1 api for Natural Language Processing tasks in pytorch and tensorflow

Paper for the api