Papers

Longformer: The Long-Document Transformer

• Paper introducing the Longformer

Videos

Longformer: The Long-Document Transformer

• Paper walkthrough by Yannic Kilcher

How much memory does Longformer use?

• By Yannic Kilcher

Posts

Longformer

• A short overview of the Longformer by Papers with Code

Longformer — The Long-Document Transformer

• A summary of the Longformer paper

Code Examples

Longformer

• Implementation of the Longformer using Pytorch

APIs

Longformer API

• Hugging Face’s Longformer API