Intelligent Systems II · TEE · papers

Q6(b) Learner progression (Markov chain) [10]

Final examination · 24 Nov 2025

Actual TEE paper · 100 marks · 3 hours · Q1 compulsory + any 4 of Q2–Q7 · every answer verified (key errors flagged)

Question. Students are Beginner (B), Intermediate (I) or Advanced (A). Of Beginners, 60% remain, 30% become Intermediate, 10% go to Advanced. Of Intermediates, 20% fall back, 50% remain, 30% progress. Of Advanced, 10% drop to Intermediate, 80% remain and 10% stop (treated as remaining in A). 1. Construct the matrix. 2. Interpret retention, progression and regression. 3. Draw the diagram. 4. For [50, 30, 20], find the distribution after one day. 5. Which level has the largest steady-state share? [10 marks]

Answer

Given

All transition values are given in the full question. State order: B, I, A. Initial vector [50, 30, 20].

To find

The matrix, diagram, next-step vector and long-run comparison.

Formula and why it applies

Rows mean current state; columns mean next state. For each destination, multiply each origin amount by its transition probability, then add.

x_{next}=x_{now}P\qquad\pi=\pi P,\quad\sum_i\pi_i=1LaTeX: x_{next}=x_{now}P\qquad\pi=\pi P,\quad\sum_i\pi_i=1

Solution

Step 1. Convert every origin row to probabilities
From / ToBIA
B0.60.30.1
I0.20.50.3
A00.10.9

Each row sums to 1 because it lists all possible destinations for that origin. A percentage is divided by 100: 25%=.25.

Step 2. Interpret entries and draw the transitions

Diagonal entries are the fractions staying at their current state; off-diagonal entries are fractions moving to a different state. Each arrow uses its origin row and destination column. These fractions have different origin populations, so adding raw column probabilities does not give the number arriving.

Swipe across the diagram to read its labels ↔
Each arrow is labelled with the probability of that transition.
Diagram: Each arrow is labelled with the probability of that transition.. Labels: Daily learner movement: Beginner, Intermediate, Advanced | 0.3 | 0.1 | 0.2 | 0.3 | 0.1 | 0.6 | 0.5 | 0.9 | B | I | A
Each arrow is labelled with the probability of that transition.
Step 3. Next step: collect all contributions to B
OriginCurrent count/shareTransition to BContribution
B500.650 × 0.6 = 30
I300.230 × 0.2 = 6
A20020 × 0 = 0
B_{new}=30+6+0=36LaTeX: B_{new}=30+6+0=36
Step 4. Next step: collect all contributions to I
OriginCurrent count/shareTransition to IContribution
B500.350 × 0.3 = 15
I300.530 × 0.5 = 15
A200.120 × 0.1 = 2
I_{new}=15+15+2=32LaTeX: I_{new}=15+15+2=32
Step 5. Next step: collect all contributions to A
OriginCurrent count/shareTransition to AContribution
B500.150 × 0.1 = 5
I300.330 × 0.3 = 9
A200.920 × 0.9 = 18
A_{new}=5+9+18=32LaTeX: A_{new}=5+9+18=32
Step 6. Stationarity: balance the Beginner column
b=0.6b+0.2iLaTeX: b=0.6b+0.2i
0.4b=0.2i\quad\Rightarrow\quad i=2bLaTeX: 0.4b=0.2i\quad\Rightarrow\quad i=2b
Step 7. Balance the Advanced column
a=0.1b+0.3i+0.9aLaTeX: a=0.1b+0.3i+0.9a
0.1a=0.1b+0.3(2b)=0.7bLaTeX: 0.1a=0.1b+0.3(2b)=0.7b
a=0.7b/0.1=7bLaTeX: a=0.7b/0.1=7b
Step 8. Use the sum of shares
b+i+a=1\quad b+2b+7b=1LaTeX: b+i+a=1\quad b+2b+7b=1
10b=1\quad b=0.1\quad i=0.2\quad a=0.7LaTeX: 10b=1\quad b=0.1\quad i=0.2\quad a=0.7

Advanced is not an absorbing state: its self-transition is .9, not 1.

Step 9. Compare the stationary shares with the initial shares
StateInitial shareStationary shareChange in shareConclusion
B0.50.1-0.4Loses
I0.30.2-0.1Loses
A0.20.70.5Gains

Compare like with like: divide counts by their total before comparing with stationary probabilities. “Stationary” means one more step leaves the shares unchanged.

Final answer. Next-step vector [36.0, 32.0, 32.0]. Stationary shares ≈ [0.1, 0.2, 0.7]. B loses, I loses, A gains.