Longformer

Know a great resource on the Longformer? Send it to us at contactbackprop@gmail.com!

Tags: Transformers

Papers

Longformer: The Long-Document Transformer

  • Paper introducing the Longformer

Videos

Longformer: The Long-Document Transformer

  • Paper walkthrough by Yannic Kilcher


How much memory does Longformer use?

  • By Yannic Kilcher

Posts

Longformer

  • A short overview of the Longformer by Papers with Code


Longformer — The Long-Document Transformer

  • A summary of the Longformer paper

Code Examples

Longformer

  • Implementation of the Longformer using Pytorch

APIs

Longformer API

  • Hugging Face’s Longformer API

Know a great resource on the Longformer? Send it to us at contactbackprop@gmail.com!