Lecture 25: Steady–State Behavior of Markov Chains (M-I-T)

• L25.1 Brief Introduction (M-I-T)
• L25.2 Lecture Overview (M-I-T)
• L25.3 Markov Chain Review (M-I-T)
• L25.4 The Probability of a Path (M-I-T)
• L25.5 Recurrent and Transient States: Review (M-I-T)
• L25.7 Steady-State Probabilities and Convergence (M-I-T)
• L25.8 A Numerical Example — Part II (M-I-T)
• L25.9 Visit Frequency Interpretation of Steady-State Probabilities (M-I-T)
• L25.10 Birth-Death Processes — Part I (M-I-T)
• L25.11 Birth-Death Processes — Part II (M-I-T)