Skip to content

Latest commit

 

History

History
18 lines (11 loc) · 360 Bytes

layer_normalization.md

File metadata and controls

18 lines (11 loc) · 360 Bytes
tags
ml

Layer Normalization

Introduced in a paper by Lei Ba et al. 2016.

Definition

Layer normalization is applied for all dimensions of a single input.

All normalizations

  • $N$ is batch dimension
  • $H$, $W$ is height and width of 3D input
  • $C$ are channels of 3D input