Papers

Universal Transformers

• The paper introducing Universal Transformers

Posts

Universal Transformers

• Post explaining Universal Transformers by one of their creators

Make it Recurrent (Universal Transformer)

• A quick look at Universal Transformers in a Lilian Weng blog post

Moving Beyond Translation with the Universal Transformer

• A short blog post by Google AI

Code Examples

Universal Transformer Pytorch

• A repo with a clear implementation

Universal Transformer Code

• This folder has files that implement the Universal Transformer by Google Research

APIs

Tensor2Tensor Library

This library has a Universal Transformer visible here