Batch and layer normalization
Overview
Understand normalization in a neural network
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Layer Normalization
- https://www.pinecone.io/learn/batch-layer-normalization/
Batch and layer normalization
| batch normalization | layer normalization | |
|---|---|---|
| trainable parameter | 2*num_feature | 2 |
| normalization across | num_batch | num_feature |
Enjoy Reading This Article?
Here are some more articles you might like to read next: