RoBERTa

Know a great resource on RoBERTa? Send it to us at contactbackprop@gmail.com!

Tags: Transformers, BERT

Videos

RoBERTa Paper Walkthrough

  • By Yannic Kilcher

Posts

RoBERTa: A Robustly Optimized BERT Pretraining Approach

  • Short blog post about RoBERTa by Facebook AI


RoBERTa

  • Short section on RoBERTa in a Lilian Weng blog post

Code Examples

RoBERTa Code

  • Code released with the RoBERTa paper

APIs

Transformers - RoBERTa

  • API for RoBERTa from the transformers package

Know a great resource on RoBERTa? Send it to us at contactbackprop@gmail.com!