Intelligent Systems II · TEE · read-chapter

Unit 4 · MRP, MDP, policies and Bellman equations

Unit 4 · Markov reward process, Markov decision process, value functions, Bellman equations, applications

1. Markov reward process, return and discount
2. Bellman equation for an MRP (with a solved example)
3. Markov decision process, policies and value functions
4. Bellman expectation and optimality equations (worked)
5. Using Bellman equations: policy and value iteration
6. 10-mark answer: Bellman equation and applications of RL