Lecture 16: Markov Chains - I

OCW Scholar

« Previous | Next »

Lecture Topics

Lecture_16.jpg
  • Checkout counter example
  • Markov process definition
  • n-step transition probabilities
  • Classification of states

Lecture Activities

Recitation Problems and Recitation Help Videos

Review the recitation problems in the PDF file below and try to solve them on your own. Two of the problems have an accompanying video where a teaching assistant solves the same problem.

Recitation Help Videos

PROBLEM # PROBLEM TITLE PROBLEM SOLVED BY
1 Setting Up a Markov Chain (00:10:36) Jimmy Li
3 Markov Chain Practice 1 (00:11:41) Qing He

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

« Previous | Next »