Layer Normalization

Know a great resource on Layer Normalization? Send it to us at contactbackprop@gmail.com!

Tags: Batch Normalization

Papers

Layer Normalization

  • Paper introducing layer normalization

Posts

Layer Normalization Explained

  • Short explanation with link back to paper and code example


Layer Normalization Explained | Lei Mao’s Log Book

  • A short, mathematical explanation of layer normalization

Code Examples

Pytorch Layer Normalization

  • Implementation of layer norm in pytorch

Tagged Pages: Transformers

Know a great resource on Layer Normalization? Send it to us at contactbackprop@gmail.com!