Switch Transformers
Know a great resource on Switch Transformers? Send it to us at contactbackprop@gmail.com!
Tags: Transformers
Papers
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Original Paper introducing switch transformers
Videos
Switch Transformers paper walkthrough
By Yannic Kilcher
Switch Transformer - 1.6 Trillion Parameters
A short video taking a quick look at the switch transformers paper
Know a great resource on Switch Transformers? Send it to us at contactbackprop@gmail.com!