Revision as of 03:35, 6 December 2020 by Nlfang (Talk | contribs)


=Restrictions of Stationary Distribution

In the last section, it is emphasized that steady-state vectors can be derived only with regular matrices. What if these vectors are not regular?

Consider a periodic Markov chain:

Statediagram.jpg

We can also write that in matrix form:

Transitionmatrix2.jpg

Going back to the Python program from before, when the initial state is $ [1, 0, 0] $,

Back to Markov Chains

Alumni Liaison

Correspondence Chess Grandmaster and Purdue Alumni

Prof. Dan Fleetwood