Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift | VitaVision
PaperICML 2015 · 2015

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

1page built on it
0more pages cite it
0narratives
6registry papers cite it

In the Atlas

ConceptPrimary source of
Normalization

Standardises intermediate activations over a chosen index set, then restores capacity with a learned affine transform; batch, layer, instance, and group normalization differ only in which indices are pooled.

Lineage

Papers in the Atlas registry only · one dot per paper
Built upon by · 6
’15’16’17’18’19’20Layer Normalization (2016)Group Normalization (2018)Momentum Contrast for Unsupervised Visual Representation Learning (2019)A Simple Framework for Contrastive Learning of Visual Representations (2020)Bootstrap your own latent: A new approach to self-supervised Learning (2020)PointRend: Image Segmentation As Rendering (2020)