12. Normalization, Training Trick, Regulization and Early Stopping

Lecture 46 Normalization

Discussion Content : Normalization Definition, Local Response Normalization (Inter-Channel, Intra-Channel), Need of Normalization Content File : https://drive.google.com/file/d/1aVX8...

Lecture 47 Batch Normalization I

.Discussion Content : Batch Normalization Definition, Mathematical Formulation and Derivation for Back-Propagation Content File : https://drive.google.com/file/d/1P-F3...

Lecture 48 Batch Normalization II

Discussion Content : Batch Normalization Performance Revisiting Batch-Normalization, Effect of Batch-Normalization Content File : https://drive.google.com/file/d/1XtA1...

Lecture 49 Layer, Instance, Group Normalization

Discussion Content : Other Normalization Techniques Layer Normalization, Instance Normalization, Group Normalization

Content File : https://drive.google.com/file/d/1T8PH...

Lecture 50 Training Trick, Regularization,Early Stopping

Discussion Content : Effective Training Techniques Overfitting/Underfitting, Regularization, Data Augmentation, Dropout, Early stopping

Content File : https://drive.google.com/file/d/1b5br...

***Important Links:

1. About the Course

2. Topic Wise Learning

3. Previous Topic 

4. Next Topic

5. Assignment