5
$\begingroup$

enter image description here

Im meant to produce the transition matrix which I've already done (in the picture) and list the communication classes. But Im not sure how to find the probability regarding the hitting times (see question). Any suggestions?

Cheers.

  • 3
    This will be helpful: http://math.stackexchange.com/questions/47627/solving-a-simple-recurrence-relation2011-11-07

2 Answers 2