Universal Transformer

Know a great resource on Universal Transformers? Send it to us at contactbackprop@gmail.com!

Tags: Transformers

Papers

Universal Transformers

  • The paper introducing Universal Transformers

Posts

Universal Transformers

  • Post explaining Universal Transformers by one of their creators


Make it Recurrent (Universal Transformer)

  • A quick look at Universal Transformers in a Lilian Weng blog post


Moving Beyond Translation with the Universal Transformer

  • A short blog post by Google AI

Code Examples

Universal Transformer Pytorch

  • A repo with a clear implementation


Universal Transformer Code

  • This folder has files that implement the Universal Transformer by Google Research

APIs

Tensor2Tensor Library

This library has a Universal Transformer visible here

Know a great resource on Universal Transformers? Send it to us at contactbackprop@gmail.com!