# MT2 numerical practice from direct to mixed

Subject: Deep Learning

Exam: MT2

Reader: https://deep-learning-study-room.vercel.app/#mt2/guide/17

Canonical: https://deep-learning-study-room.vercel.app/read/dl/mt2/guide/17/

1. [Start here](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-intro/)
2. [How to solve a mixed numerical without guessing](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s0/)
3. [Drill 1 Signs and brackets](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s1/)
4. [Drill 2 Half sum versus mean](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s2/)
5. [Drill 3 Natural log and probability](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s3/)
6. [Drill 4 Dot product and bias](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s4/)
7. [Drill 5 Matrix rows receive inputs](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s5/)
8. [Drill 6 Chain rule on a tiny loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s6/)
9. [Drill 7 Sigmoid with binary cross entropy](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s7/)
10. [Drill 8 Activation contrast](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s8/)
11. [Drill 9 Softmax and true class loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s9/)
12. [Drill 10 Sigmoid neuron gradient](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s10/)
13. [Drill 11 Full ReLU backpropagation](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s11/)
14. [Drill 12 Two output sigmoid backpropagation](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s12/)
15. [Drill 13 A negative ReLU blocks this path](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s13/)
16. [Drill 14 Batch and sequential SGD](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s14/)
17. [Drill 15 Incomplete mini batch](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s15/)
18. [Drill 16 GD variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s16/)
19. [Drill 17 GD variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s17/)
20. [Drill 18 Momentum variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s18/)
21. [Drill 19 Momentum variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s19/)
22. [Drill 20 Nesterov variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s20/)
23. [Drill 21 Nesterov variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s21/)
24. [Drill 22 AdaGrad variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s22/)
25. [Drill 23 AdaGrad variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s23/)
26. [Drill 24 RMSProp variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s24/)
27. [Drill 25 RMSProp variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s25/)
28. [Drill 26 Adam variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s26/)
29. [Drill 27 Adam variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s27/)
30. [Drill 28 Regularized objective](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s28/)
31. [Drill 29 L1 update on positive and negative weights](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s29/)
32. [Drill 30 L2 update](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s30/)
33. [Drill 31 Inverted dropout](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s31/)
34. [Drill 32 Convolution with a negative coefficient](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s32/)
35. [Drill 33 Padding stride and channels](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s33/)
36. [Drill 34 Max and average pooling](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s34/)
37. [Drill 35 Complete small CNN](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s35/)
38. [Drill 36 Reverse a spatial formula](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s36/)
39. [Drill 37 Bottleneck cost with new values](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s37/)
40. [Drill 38 Residual addition](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s38/)
41. [Drill 39 Two RNN steps](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s39/)
42. [Drill 40 Mixed convolution pool dense and loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s40/)
43. [Drill 41 Mixed backpropagation and L2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s41/)
44. [Drill 42 Mixed dropout and a momentum update](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s42/)
45. [Drill 43 Mixed CNN dimensions softmax and loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s43/)
46. [Drill 44 Inception concatenation and parameter count](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s44/)
47. [Drill 45 Projection shortcut](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s45/)
48. [Revising solved examples](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s46/)