# Questions and complete answers

Subject: Deep Learning

Exam: MT2

Reader: https://deep-learning-study-room.vercel.app/#mt2/practice

Canonical: https://deep-learning-study-room.vercel.app/read/dl/mt2/index/practice/

1. [Model answer: explain an artificial neuron](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c4-s6/)
2. [Model answer: why a network needs nonlinear activation](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c4-s8/)
3. [Model answer: forward propagation, backpropagation and updating](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c4-s13/)
4. [Model answer: batch, stochastic and mini-batch training](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c5-s5/)
5. [Model answer: momentum and Nesterov](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c5-s11/)
6. [Model answer: AdaGrad, RMSProp and Adam](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c5-s16/)
7. [Model answer: regularization and the L1–L2 difference](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s2/)
8. [Model answer: generalization and early stopping](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s5/)
9. [Model answer: dropout with training and inference explained](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c6-s8/)
10. [Model answer: CNN structure and parameter sharing](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c7-s11/)
11. [Model answer: shape, activations and parameters](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c7-s13/)
12. [Model answer: feature extraction and fine-tuning](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c8-s5/)
13. [Model answer: AlexNet, Inception and ResNet](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c8-s8/)
14. [MT1A Q2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c10-s0/)
15. [MT1A Q3](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c10-s1/)
16. [MT1A Q4](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c10-s2/)
17. [MT1B Q3](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c10-s3/)
18. [MT1B Q4](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c10-s4/)
19. [F25 Q1c](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s0/)
20. [F25 Q2b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s2/)
21. [F25 Q3b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s3/)
22. [F25 Q4a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s4/)
23. [F25 Q5b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s5/)
24. [F25 Q6a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s6/)
25. [F25 Q7b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c11-s7/)
26. [R26 Q1c](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s0/)
27. [R26 Q2b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s2/)
28. [R26 Q3b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s3/)
29. [R26 Q4a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s4/)
30. [R26 Q5b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s6/)
31. [R26 Q6a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s7/)
32. [R26 Q7b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c12-s8/)
33. [F23 Q1b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s0/)
34. [F23 Q1d](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s1/)
35. [F23 Q3b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s2/)
36. [F23 Q4a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s3/)
37. [F23 Q5a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s4/)
38. [F23 Q6b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s5/)
39. [F23 Q7b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c13-s7/)
40. [R24 Q1c](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s0/)
41. [R24 Q1d](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s1/)
42. [R24 Q2b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s2/)
43. [R24 Q3b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s3/)
44. [R24 Q4b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s4/)
45. [R24 Q5a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s5/)
46. [R24 Q6b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c14-s6/)
47. [F22 Q1a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s0/)
48. [F22 Q1b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s1/)
49. [F22 Q3a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s3/)
50. [F22 Q3b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s4/)
51. [F22 Q4a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s5/)
52. [F22 Q4b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s6/)
53. [F22 Q5b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s7/)
54. [F22 Q6a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s8/)
55. [F22 Q6b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c15-s9/)
56. [R23 Q1b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s1/)
57. [R23 Q1d](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s2/)
58. [R23 Q2a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s3/)
59. [R23 Q2b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s4/)
60. [R23 Q4a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s5/)
61. [R23 Q4b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s6/)
62. [R23 Q6a](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s7/)
63. [R23 Q6b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s8/)
64. [R23 Q7b](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c16-s9/)
65. [Drill 1 Signs and brackets](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s1/)
66. [Drill 2 Half sum versus mean](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s2/)
67. [Drill 3 Natural log and probability](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s3/)
68. [Drill 4 Dot product and bias](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s4/)
69. [Drill 5 Matrix rows receive inputs](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s5/)
70. [Drill 6 Chain rule on a tiny loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s6/)
71. [Drill 7 Sigmoid with binary cross entropy](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s7/)
72. [Drill 8 Activation contrast](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s8/)
73. [Drill 9 Softmax and true class loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s9/)
74. [Drill 10 Sigmoid neuron gradient](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s10/)
75. [Drill 11 Full ReLU backpropagation](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s11/)
76. [Drill 12 Two output sigmoid backpropagation](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s12/)
77. [Drill 13 A negative ReLU blocks this path](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s13/)
78. [Drill 14 Batch and sequential SGD](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s14/)
79. [Drill 15 Incomplete mini batch](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s15/)
80. [Drill 16 GD variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s16/)
81. [Drill 17 GD variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s17/)
82. [Drill 18 Momentum variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s18/)
83. [Drill 19 Momentum variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s19/)
84. [Drill 20 Nesterov variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s20/)
85. [Drill 21 Nesterov variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s21/)
86. [Drill 22 AdaGrad variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s22/)
87. [Drill 23 AdaGrad variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s23/)
88. [Drill 24 RMSProp variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s24/)
89. [Drill 25 RMSProp variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s25/)
90. [Drill 26 Adam variation 1](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s26/)
91. [Drill 27 Adam variation 2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s27/)
92. [Drill 28 Regularized objective](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s28/)
93. [Drill 29 L1 update on positive and negative weights](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s29/)
94. [Drill 30 L2 update](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s30/)
95. [Drill 31 Inverted dropout](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s31/)
96. [Drill 32 Convolution with a negative coefficient](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s32/)
97. [Drill 33 Padding stride and channels](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s33/)
98. [Drill 34 Max and average pooling](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s34/)
99. [Drill 35 Complete small CNN](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s35/)
100. [Drill 36 Reverse a spatial formula](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s36/)
101. [Drill 37 Bottleneck cost with new values](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s37/)
102. [Drill 38 Residual addition](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s38/)
103. [Drill 40 Mixed convolution pool dense and loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s40/)
104. [Drill 41 Mixed backpropagation and L2](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s41/)
105. [Drill 42 Mixed dropout and a momentum update](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s42/)
106. [Drill 43 Mixed CNN dimensions softmax and loss](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s43/)
107. [Drill 44 Inception concatenation and parameter count](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s44/)
108. [Drill 45 Projection shortcut](https://deep-learning-study-room.vercel.app/read/dl/mt2/section/mt2-c17-s45/)