Deep Learning · TEE · guide

Recurrent neural networks

  1. Complete the entire sequence chapter
  2. What makes a sequence different
  3. Model answer: why recurrent networks use a hidden state
  4. Reading recurrent memory and gates
  5. The vanilla RNN equations from scratch
  6. A complete vector RNN calculation
  7. How an RNN is trained
  8. BPTT with every arithmetic step visible
  9. Vanishing and exploding gradients
  10. Model answer: backpropagation through time
  11. LSTM a memory path with three gates
  12. Reading an LSTM equation one operation at a time
  13. LSTM complete numerical with supplied gates
  14. LSTM numerical when gates must first be calculated
  15. GRU two gates and one state
  16. Comparing the three recurrent models
  17. Model answer: LSTM and GRU memory
  18. Sequence mappings and applications
  19. Recurrent networks: the complete relationship
  20. Gate logic without memorizing a story