0
$\begingroup$

In a finite state Markov Chain , show that there exists $M>0$ and $0<\lambda<1$ such that for all the transient states $i$ and $j$ , we have $$p_{ij}^{(n)}\le M\lambda^n$$

I guess $\lambda$ should be something like $\max\limits_{i,j\in S}p_{ij}$ (I might be wrong) , but I have no clue abut $M$.

$S$ is set of transient states

  • 0
    I would suggest to delete $0$ from before $\lambda$. Or to insert a < sign.2017-02-15
  • 0
    @zoli Aha.. typo2017-02-15

0 Answers 0