3
$\begingroup$

Is the following statement true:

In a finite Markov chain, if $i$ is a transient state then there is at least one recurrent state $j$ such that $j$ is reachable from $i$.

2 Answers 2