Video details loaded
HomeMIT 6.262 Discrete Stochastic Processes, Spring 2011Lecture 7: Finite-state Markov Chains; The Matrix Approach

Lecture 7: Finite-state Markov Chains; The Matrix Approach

55:34

Up Next

Lecture 8: Markov Eigenvalues and Eigenvectors

Continue

Description: The transition matrix approach to finite-state Markov chains is developed in this lecture. The powers of the transition matrix are analyzed to understand steady-state behavior.

(Courtesy of Shan-Yuan Ho. Used with permission.)

Instructor: Shan-Yuan Ho