Intelligent Systems II · TEE · read-chapter

Unit 4 · Markov processes (transition matrices)

Unit 4 · Markov processes · asked in every recent paper (5 and 10 marks)

  1. Markov property, transition matrix and state diagram
  2. Next-step and n-step distributions
  3. Steady state and long-run gain or loss