Lecture 9: Markov Rewards and Dynamic Programming

Name: Lecture 9: Markov Rewards and Dynamic Programming
Uploaded: 2012-06-29T19:44:57Z
Duration: 1 h 23 min 36 s
Description: Description: This lecture covers rewards for Markov chains, expected first passage time, and aggregate rewards with a final reward. The professor then moves on to discuss dynamic programming and the dynamic programming algorithm. Instructor: Prof. Robert Gallager

1:23:36

Up Next

Lecture 10: Renewals and the Strong Law of Large Numbers

Continue

Description: This lecture covers rewards for Markov chains, expected first passage time, and aggregate rewards with a final reward. The professor then moves on to discuss dynamic programming and the dynamic programming algorithm.

Instructor: Prof. Robert Gallager