Line 13: Line 13:
 
===Classification of States===
 
===Classification of States===
 
# [[Communication and Reducibility]]
 
# [[Communication and Reducibility]]
# [[Periodicity]]
+
# [[Periodicity of Markov Chains]]
 
# [[Recurrent State and Transient State]]
 
# [[Recurrent State and Transient State]]
  

Revision as of 01:23, 6 December 2020

Markov Chains

Yi Li and Nicholas Fang

Table of Contents

Introduction and Historic Background

Basics of a Markov Chain

  1. Transition Diagrams
  2. Transition Probability Matrix
  3. n-th Term Transition
  4. Python Demonstration

Classification of States

  1. Communication and Reducibility
  2. Periodicity of Markov Chains
  3. Recurrent State and Transient State

Alumni Liaison

Questions/answers with a recent ECE grad

Ryne Rayburn