# Numerical practice from direct to mixed Subject: Deep Learning Exam: TEE Reader: https://deep-learning-study-room.vercel.app/#tee/guide/17 Canonical: https://deep-learning-study-room.vercel.app/read/dl/tee/guide/17/ 1. [Start here](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-intro/) 2. [How to solve a mixed numerical without guessing](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s0/) 3. [Drill 1 Signs and brackets](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s1/) 4. [Drill 2 Half sum versus mean](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s2/) 5. [Drill 3 Natural log and probability](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s3/) 6. [Drill 4 Dot product and bias](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s4/) 7. [Drill 5 Matrix rows receive inputs](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s5/) 8. [Drill 6 Chain rule on a tiny loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s6/) 9. [Drill 7 Sigmoid with binary cross entropy](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s7/) 10. [Drill 8 Activation contrast](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s8/) 11. [Drill 9 Softmax and true class loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s9/) 12. [Drill 10 Sigmoid neuron gradient](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s10/) 13. [Drill 11 One perceptron learning update](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s11/) 14. [Drill 12 XOR using two hidden units](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s12/) 15. [Drill 13 Full ReLU backpropagation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s13/) 16. [Drill 14 Two output sigmoid backpropagation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s14/) 17. [Drill 15 A negative ReLU blocks this path](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s15/) 18. [Drill 16 Batch and sequential SGD](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s16/) 19. [Drill 17 Incomplete mini batch](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s17/) 20. [Drill 18 GD variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s18/) 21. [Drill 19 GD variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s19/) 22. [Drill 20 Momentum variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s20/) 23. [Drill 21 Momentum variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s21/) 24. [Drill 22 Nesterov variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s22/) 25. [Drill 23 Nesterov variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s23/) 26. [Drill 24 AdaGrad variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s24/) 27. [Drill 25 AdaGrad variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s25/) 28. [Drill 26 RMSProp variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s26/) 29. [Drill 27 RMSProp variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s27/) 30. [Drill 28 Adam variation 1](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s28/) 31. [Drill 29 Adam variation 2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s29/) 32. [Drill 30 Regularized objective](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s30/) 33. [Drill 31 L1 update on positive and negative weights](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s31/) 34. [Drill 32 L2 update](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s32/) 35. [Drill 33 Inverted dropout](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s33/) 36. [Drill 34 Convolution with a negative coefficient](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s34/) 37. [Drill 35 Padding stride and channels](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s35/) 38. [Drill 36 Max and average pooling](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s36/) 39. [Drill 37 Complete small CNN](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s37/) 40. [Drill 38 Reverse a spatial formula](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s38/) 41. [Drill 39 Bottleneck cost with new values](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s39/) 42. [Drill 40 Residual addition](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s40/) 43. [Drill 41 Two RNN steps](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s41/) 44. [Drill 42 LSTM with a negative candidate](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s42/) 45. [Drill 43 Calculate gates before the cell](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s43/) 46. [Drill 44 GRU reset then mix](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s44/) 47. [Drill 45 BPTT shared weights](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s45/) 48. [Drill 46 Mixed convolution pool dense and loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s46/) 49. [Drill 47 Mixed backpropagation and L2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s47/) 50. [Drill 48 Mixed dropout and a momentum update](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s48/) 51. [Drill 49 Mixed CNN dimensions softmax and loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s49/) 52. [Drill 50 Three step LSTM retention and replacement](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s50/) 53. [Drill 51 Inception concatenation and parameter count](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s51/) 54. [Drill 52 Projection shortcut](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s52/) 55. [Revising solved examples](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s53/)