Papers

Layer Normalization

• Paper introducing layer normalization

Posts

Layer Normalization Explained

• Short explanation with link back to paper and code example

Layer Normalization Explained | Lei Mao’s Log Book

• A short, mathematical explanation of layer normalization

Code Examples

Pytorch Layer Normalization

• Implementation of layer norm in pytorch

APIs

Pytorch

• torch.nn.LayerNorm

• torch.nn.functional.layer_norm

Tensorflow

• tf.keras.layers.LayerNormalization