Line 5: Line 5:
 
[[Introduction and Historic Background]]
 
[[Introduction and Historic Background]]
  
===Basics of Markov Chains===
+
'''Basics of Markov Chains'''
 
# [[Transition Diagrams]]
 
# [[Transition Diagrams]]
 
# [[Transition Probability Matrix]]
 
# [[Transition Probability Matrix]]
Line 11: Line 11:
 
# [[Python Demonstration]]
 
# [[Python Demonstration]]
  
===Classification of States===
+
'''Classification of States'''
 
# [[Communication and Reducibility]]
 
# [[Communication and Reducibility]]
 
# [[Periodicity of Markov Chains]]
 
# [[Periodicity of Markov Chains]]

Revision as of 13:28, 6 December 2020

Markov Chains

Yi Li and Nicholas Fang

Table of Contents

Introduction and Historic Background

Basics of Markov Chains

  1. Transition Diagrams
  2. Transition Probability Matrix
  3. n-th Term Transition
  4. Python Demonstration

Classification of States

  1. Communication and Reducibility
  2. Periodicity of Markov Chains
  3. Recurrent State and Transient State

Markov Chain Theorems

Restrictions of Stationary Distribution

Applications of Markov Chains

Markov Chain References and Additional Readings

Alumni Liaison

Abstract algebra continues the conceptual developments of linear algebra, on an even grander scale.

Dr. Paul Garrett