# Neural-network foundations

Subject: Deep Learning

Exam: TEE

Reader: https://deep-learning-study-room.vercel.app/#tee/read/4

Canonical: https://deep-learning-study-room.vercel.app/read/dl/tee/chapter/4/

Technical definitions, neuron models, activations, losses, forward propagation and backpropagation. These foundations support the MT2 calculations.

1. [What does learning from data mean](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s0/)
2. [Artificial intelligence machine learning and deep learning](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s5/)
3. [Classification regression and learning types](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s2/)
4. [Training validation and test data](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s3/)
5. [Parameters and hyperparameters](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s4/)
6. [What one artificial neuron does](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s6/)
7. [Biological neurons and the McCulloch-Pitts model](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s21/)
8. [Perceptrons and the threshold](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s8/)
9. [Drill 11 One perceptron learning update](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s11/)
10. [Why XOR needs more than one perceptron](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s9/)
11. [Drill 12 XOR using two hidden units](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s12/)
12. [Activation functions and how to calculate them](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s10/)
13. [Drill 8 Activation contrast](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s8/)
14. [Choosing a loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s12/)
15. [Drill 2 Half sum versus mean](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s2/)
16. [Drill 7 Sigmoid with binary cross entropy](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s7/)
17. [Drill 9 Softmax and true class loss](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s9/)
18. [Cross-entropy for probability distributions](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s20/)
19. [Forward propagation through multiple neurons](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s13/)
20. [Your first complete training step](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s1/)
21. [Complete sigmoid training example](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s19/)
22. [Drill 10 Sigmoid neuron gradient](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s10/)
23. [Backpropagation with one hidden neuron](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s14/)
24. [More outputs and vectorized backpropagation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s15/)
25. [Drill 13 Full ReLU backpropagation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s13/)
26. [Drill 14 Two output sigmoid backpropagation](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s14/)
27. [Drill 15 A negative ReLU blocks this path](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c17-s15/)
28. [Counting parameters in a dense network](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c4-s17/)
29. [Teacher vectorized ReLU example](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s10/)
30. [Teams photos full sigmoid example](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s11/)
31. [MT1A Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s0/)
32. [MT1A Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s1/)
33. [MT1A Q2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s2/)
34. [MT1A Q3](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s3/)
35. [MT1A Q4](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s4/)
36. [MT1B Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s5/)
37. [MT1B Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s6/)
38. [MT1B Q2](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s7/)
39. [MT1B Q3](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s8/)
40. [MT1B Q4](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c10-s9/)
41. [F25 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s0/)
42. [F25 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s1/)
43. [F25 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s4/)
44. [F25 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s6/)
45. [F25 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s13/)
46. [F25 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c11-s14/)
47. [R26 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s0/)
48. [R26 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s1/)
49. [R26 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s4/)
50. [R26 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s6/)
51. [R26 Q6b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s13/)
52. [R26 Q7a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c12-s14/)
53. [F23 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s0/)
54. [F23 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s4/)
55. [F23 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s5/)
56. [F23 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s6/)
57. [F23 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c13-s11/)
58. [R24 Q1a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s0/)
59. [R24 Q1b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s1/)
60. [R24 Q2a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s4/)
61. [R24 Q3a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s6/)
62. [R24 Q4a](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c14-s8/)
63. [F22 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s2/)
64. [F22 Q1d](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s3/)
65. [F22 Q2b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s6/)
66. [F22 Q7b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c15-s16/)
67. [R23 Q1c](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s2/)
68. [R23 Q1e](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s4/)
69. [R23 Q3b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s8/)
70. [R23 Q5b](https://deep-learning-study-room.vercel.app/read/dl/tee/section/tee-c16-s12/)