Stationary Probability Distributions of a Markov Chain

Abstract

This article shows that stationary probability distributions of a Markov chain can be classified into two classes. These classes are determined by the type of communicating classes of the chain.