Papers

ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations

• Paper introducing ALBERT

Lectures

ALBERT Lecture

• A 30 minute presentation on the ALBERT model

Posts

ALBERT

• A short section on ALBERT from a Lilian Weng blog post

ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations

• A post summarizing ALBERT from Google AI’s blog

Code Examples

ALBERT

• Repo with ALBERT code released with ALBERT paper

ALBERT Pytorch

• A pytorch implementation

ALBERT TF2.0

• ALBERT pretraining and fine-tuning with TF2.0

APIs

Transformers - ALBERT

• API as part of the Transformers library