This is not a wikipedia question, because I cannot find it there. How does one compute the first return time of a time-homogeneous Markov chain. There are a lot of neat notions such as recurrence and expected return time, but I am not sure how one can calculate the first return time.
For simple example, if we have $p_{11} =1/3$, $p_{12}=2/3$, $p_{22}=1/6$ and $p_{21}=5/6$, then what is the first return time to state 1?