ALBERT
Know a great resource on ALBERT? Send it to us at contactbackprop@gmail.com!
Tags: Transformers, BERT
Papers
ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations
Paper introducing ALBERT
Posts
A short section on ALBERT from a Lilian Weng blog post
ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations
A post summarizing ALBERT from Google AI’s blog
Code Examples
Repo with ALBERT code released with ALBERT paper
A pytorch implementation
ALBERT pretraining and fine-tuning with TF2.0
Know a great resource on ALBERT? Send it to us at contactbackprop@gmail.com!