# Regularization and generalization

Subject: Deep Learning

Exam: MT2

Reader: https://deep-learning-study-room.vercel.app/#mt2/read/6

Canonical: https://deep-learning-study-room.vercel.app/read/dl/mt2/chapter/6/

Overfitting, L1/L2 penalties, dropout and early stopping: mechanisms, equations, comparisons and numerical applications.

1. [Recognizing overfitting and underfitting](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s0/)
2. [L1 and L2 add a cost for large weights](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s1/)
3. [Drill 28 Regularized objective](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s28/)
4. [Drill 29 L1 update on positive and negative weights](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s29/)
5. [Drill 30 L2 update](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s30/)
6. [Drill 41 Mixed backpropagation and L2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s41/)
7. [Dropout removes activations during training](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s3/)
8. [Early stopping uses the best validation point](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s4/)
9. [Choosing a remedy](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s6/)
10. [Inverted dropout during training and inference](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s7/)
11. [Drill 31 Inverted dropout](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s31/)
12. [Drill 42 Mixed dropout and a momentum update](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s42/)
13. [F25 Q1c](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s0/)
14. [R26 Q1c](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s0/)
15. [F23 Q7b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s7/)
16. [R24 Q3b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s3/)
17. [F22 Q3a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s3/)
18. [F22 Q6b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s9/)
19. [R23 Q2b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s4/)