# Questions and complete answers

Subject: Deep Learning

Exam: TEE

Reader: https://deep-learning-study-room.vercel.app/#tee/practice

Canonical: https://deep-learning-study-room.vercel.app/read/dl/tee/index/practice/

1. [Model answer: explain an artificial neuron](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s7/)
2. [Model answer: why a network needs nonlinear activation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s11/)
3. [Model answer: forward propagation, backpropagation and updating](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s16/)
4. [Model answer: batch, stochastic and mini-batch training](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c5-s5/)
5. [Model answer: momentum and Nesterov](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c5-s11/)
6. [Model answer: AdaGrad, RMSProp and Adam](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c5-s16/)
7. [Model answer: regularization and the L1–L2 difference](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c6-s2/)
8. [Model answer: generalization and early stopping](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c6-s5/)
9. [Model answer: dropout with training and inference explained](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c6-s8/)
10. [Model answer: CNN structure and parameter sharing](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c7-s11/)
11. [Model answer: shape, activations and parameters](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c7-s13/)
12. [Model answer: feature extraction and fine-tuning](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c8-s5/)
13. [Model answer: AlexNet, Inception and ResNet](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c8-s8/)
14. [Model answer: why recurrent networks use a hidden state](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c9-s2/)
15. [Model answer: backpropagation through time](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c9-s9/)
16. [Model answer: LSTM and GRU memory](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c9-s16/)
17. [MT1A Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s0/)
18. [MT1A Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s1/)
19. [MT1A Q2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s2/)
20. [MT1A Q3](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s3/)
21. [MT1A Q4](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s4/)
22. [MT1B Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s5/)
23. [MT1B Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s6/)
24. [MT1B Q2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s7/)
25. [MT1B Q3](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s8/)
26. [MT1B Q4](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s9/)
27. [F25 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s0/)
28. [F25 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s1/)
29. [F25 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s2/)
30. [F25 Q1d](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s3/)
31. [F25 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s4/)
32. [F25 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s5/)
33. [F25 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s6/)
34. [F25 Q3b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s7/)
35. [F25 Q4a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s8/)
36. [F25 Q4b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s9/)
37. [F25 Q5a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s10/)
38. [F25 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s11/)
39. [F25 Q6a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s12/)
40. [F25 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s13/)
41. [F25 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s14/)
42. [F25 Q7b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s15/)
43. [R26 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s0/)
44. [R26 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s1/)
45. [R26 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s2/)
46. [R26 Q1d](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s3/)
47. [R26 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s4/)
48. [R26 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s5/)
49. [R26 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s6/)
50. [R26 Q3b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s7/)
51. [R26 Q4a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s8/)
52. [R26 Q4b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s9/)
53. [R26 Q5a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s10/)
54. [R26 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s11/)
55. [R26 Q6a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s12/)
56. [R26 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s13/)
57. [R26 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s14/)
58. [R26 Q7b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s15/)
59. [F23 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s0/)
60. [F23 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s1/)
61. [F23 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s2/)
62. [F23 Q1d](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s3/)
63. [F23 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s4/)
64. [F23 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s5/)
65. [F23 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s6/)
66. [F23 Q3b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s7/)
67. [F23 Q4a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s8/)
68. [F23 Q4b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s9/)
69. [F23 Q5a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s10/)
70. [F23 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s11/)
71. [F23 Q6a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s12/)
72. [F23 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s13/)
73. [F23 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s14/)
74. [F23 Q7b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s15/)
75. [R24 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s0/)
76. [R24 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s1/)
77. [R24 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s2/)
78. [R24 Q1d](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s3/)
79. [R24 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s4/)
80. [R24 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s5/)
81. [R24 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s6/)
82. [R24 Q3b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s7/)
83. [R24 Q4a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s8/)
84. [R24 Q4b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s9/)
85. [R24 Q5a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s10/)
86. [R24 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s11/)
87. [R24 Q6a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s12/)
88. [R24 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s13/)
89. [R24 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s14/)
90. [R24 Q7b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s15/)
91. [F22 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s0/)
92. [F22 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s1/)
93. [F22 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s2/)
94. [F22 Q1d](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s3/)
95. [F22 Q1e](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s4/)
96. [F22 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s5/)
97. [F22 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s6/)
98. [F22 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s7/)
99. [F22 Q3b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s8/)
100. [F22 Q4a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s9/)
101. [F22 Q4b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s10/)
102. [F22 Q5a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s11/)
103. [F22 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s12/)
104. [F22 Q6a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s13/)
105. [F22 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s14/)
106. [F22 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s15/)
107. [F22 Q7b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s16/)
108. [R23 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s0/)
109. [R23 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s1/)
110. [R23 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s2/)
111. [R23 Q1d](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s3/)
112. [R23 Q1e](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s4/)
113. [R23 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s5/)
114. [R23 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s6/)
115. [R23 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s7/)
116. [R23 Q3b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s8/)
117. [R23 Q4a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s9/)
118. [R23 Q4b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s10/)
119. [R23 Q5a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s11/)
120. [R23 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s12/)
121. [R23 Q6a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s13/)
122. [R23 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s14/)
123. [R23 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s15/)
124. [R23 Q7b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s16/)
125. [Drill 1 Signs and brackets](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s1/)
126. [Drill 2 Half sum versus mean](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s2/)
127. [Drill 3 Natural log and probability](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s3/)
128. [Drill 4 Dot product and bias](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s4/)
129. [Drill 5 Matrix rows receive inputs](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s5/)
130. [Drill 6 Chain rule on a tiny loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s6/)
131. [Drill 7 Sigmoid with binary cross entropy](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s7/)
132. [Drill 8 Activation contrast](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s8/)
133. [Drill 9 Softmax and true class loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s9/)
134. [Drill 10 Sigmoid neuron gradient](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s10/)
135. [Drill 11 One perceptron learning update](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s11/)
136. [Drill 12 XOR using two hidden units](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s12/)
137. [Drill 13 Full ReLU backpropagation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s13/)
138. [Drill 14 Two output sigmoid backpropagation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s14/)
139. [Drill 15 A negative ReLU blocks this path](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s15/)
140. [Drill 16 Batch and sequential SGD](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s16/)
141. [Drill 17 Incomplete mini batch](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s17/)
142. [Drill 18 GD variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s18/)
143. [Drill 19 GD variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s19/)
144. [Drill 20 Momentum variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s20/)
145. [Drill 21 Momentum variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s21/)
146. [Drill 22 Nesterov variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s22/)
147. [Drill 23 Nesterov variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s23/)
148. [Drill 24 AdaGrad variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s24/)
149. [Drill 25 AdaGrad variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s25/)
150. [Drill 26 RMSProp variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s26/)
151. [Drill 27 RMSProp variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s27/)
152. [Drill 28 Adam variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s28/)
153. [Drill 29 Adam variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s29/)
154. [Drill 30 Regularized objective](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s30/)
155. [Drill 31 L1 update on positive and negative weights](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s31/)
156. [Drill 32 L2 update](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s32/)
157. [Drill 33 Inverted dropout](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s33/)
158. [Drill 34 Convolution with a negative coefficient](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s34/)
159. [Drill 35 Padding stride and channels](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s35/)
160. [Drill 36 Max and average pooling](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s36/)
161. [Drill 37 Complete small CNN](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s37/)
162. [Drill 38 Reverse a spatial formula](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s38/)
163. [Drill 39 Bottleneck cost with new values](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s39/)
164. [Drill 40 Residual addition](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s40/)
165. [Drill 41 Two RNN steps](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s41/)
166. [Drill 42 LSTM with a negative candidate](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s42/)
167. [Drill 43 Calculate gates before the cell](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s43/)
168. [Drill 44 GRU reset then mix](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s44/)
169. [Drill 45 BPTT shared weights](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s45/)
170. [Drill 46 Mixed convolution pool dense and loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s46/)
171. [Drill 47 Mixed backpropagation and L2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s47/)
172. [Drill 48 Mixed dropout and a momentum update](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s48/)
173. [Drill 49 Mixed CNN dimensions softmax and loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s49/)
174. [Drill 50 Three step LSTM retention and replacement](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s50/)
175. [Drill 51 Inception concatenation and parameter count](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s51/)
176. [Drill 52 Projection shortcut](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s52/)