3
$\begingroup$

Given a markov model with transition rate matrix $Q$, where the probability of each state at time $t$ is given by $P(t) = P(0)e^{Qt}$, where e is the matrix exponential, the steady state probabilities should be given by taking the $\lim_{t\to\infty}P(t)$.

Is this the best way, or are there alternatives, and if so, how do you solve them with those methods? If not, how does one take the limit of the matrix exponential as t goes to infinity so that you can arrive at an analytical solution.

1 Answers 1

5

Find the left eigenvector to eigenvalue 0 of $Q$ and there is your stationary $P_\infty$. Or in formulas $P_\infty Q = 0.$

  • 1
    @bmillare: From $P_\infty Q =0$, it follows that $P_{\infty} e^{Q t} = P_{\infty}$ --- exactly what you want for a stationary solution.2011-04-07