Can you help me please with proof of this question:
Prove, that in finite-state Markov chain state $i$ is transient if and only if is exist state $k$ such that $i\rightarrow k$ but k $\nrightarrow i$.
Give counterexamples at case of infinite chain.
Thanks!