ALBERT

Know a great resource on ALBERT? Send it to us at contactbackprop@gmail.com!

Tags: Transformers, BERT

Lectures

ALBERT Lecture

  • A 30 minute presentation on the ALBERT model

Posts

ALBERT

  • A short section on ALBERT from a Lilian Weng blog post


ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations

  • A post summarizing ALBERT from Google AI’s blog

Code Examples

ALBERT

  • Repo with ALBERT code released with ALBERT paper


ALBERT Pytorch

  • A pytorch implementation


ALBERT TF2.0

  • ALBERT pretraining and fine-tuning with TF2.0

APIs

Transformers - ALBERT

  • API as part of the Transformers library

Know a great resource on ALBERT? Send it to us at contactbackprop@gmail.com!