m
Line 3: Line 3:
  
 
==Table of Contents==
 
==Table of Contents==
# [[Introduction and Historic Background]]
+
[[Introduction and Historic Background]]
 +
 
 +
===Basics of a Markov Chain===
 
# [[Transition Diagrams]]
 
# [[Transition Diagrams]]
 +
# [[Transition Probability Matrix]]
 +
# [[n-th Term Transition]]
 +
# [[Python Demonstration]]
 +
 +
===Classification of States===
 +
# [[Communication and Reducibility]]
 +
# [[Periodicity]]
 +
# [[Recurrent State and Transient State]]
 +
 +
  
 
[[Category:MA271Fall2020Walther]]
 
[[Category:MA271Fall2020Walther]]

Revision as of 23:48, 5 December 2020

Markov Chains

Yi Li and Nicholas Fang

Table of Contents

Introduction and Historic Background

Basics of a Markov Chain

  1. Transition Diagrams
  2. Transition Probability Matrix
  3. n-th Term Transition
  4. Python Demonstration

Classification of States

  1. Communication and Reducibility
  2. Periodicity
  3. Recurrent State and Transient State

Alumni Liaison

BSEE 2004, current Ph.D. student researching signal and image processing.

Landis Huffman