# Unit 4 · Markov processes (transition matrices)

Subject: Intelligent Systems II

Exam: TEE

Reader: https://deep-learning-study-room.vercel.app/is2/#tee/read/u4-markov

Canonical: https://deep-learning-study-room.vercel.app/read/is2/tee/read-chapter/u4-markov/

Unit 4 · Markov processes · asked in every recent paper (5 and 10 marks)

1. [Markov property, transition matrix and state diagram](https://deep-learning-study-room.vercel.app/read/is2/tee/read/u4-markov--markov-chain/)
2. [Next-step and n-step distributions](https://deep-learning-study-room.vercel.app/read/is2/tee/read/u4-markov--next-step/)
3. [Steady state and long-run gain or loss](https://deep-learning-study-room.vercel.app/read/is2/tee/read/u4-markov--steady-state/)