This question will be a little out-of-character for me. I'm reading an evolutionary game theory book (which isn't for mathematicians), and I'm not sure of the mathematics involved.
My definition of a stochastic matrix will be a square matrix with real $\geq 0$ coordinates, such that the sum of each row is $1$.
I will call a stochastic matrix positive, if all of its coordinates are positive.
The book I'm looking at is describing finite birth-death processes. The idea is that there is a finite population $A$ and a finite population $B$ and at each step one of either $A$ or $B$ randomly dies, and one randomly multiplies. We think of this as a stochastic process with $N+1$ states, one for each of the possible number of people in $A$. ($N$ being the number of people in $A$ plus the number of people in $B$)
Let $P$ be the corresponding stochastic matrix.
The book declares the following: let $x_i$ be the probability of reaching state $N$ when starting from $i$ EVENTUALLY (in the limit of the process continuing ad infinitum). Let $\underline{x}$ denote the $x_i$'s as a vector. Then $\underline{x}=P\underline{x}$, and (and I quote) "the absorption probabilities are given by the right-hand eigenvector associated with the largest eigenvalue, which is one, because $P$ is a stochastic matrix."
My real question is: what is the right statement of the theorem this uses?
Notice that this $\underline{x}$ is just the last column of $P^{\infty}$ (the limit of $P^n$). Is the correct statement that all of the columns of $P^{\infty}$ eigenvectors for the eigenvalue $1$? Is the correct statement that all of the columns of $P^{\infty}$ are eigenvectors of some eigenvalue (which might change from column to column) with absolute value $1$ (possibly complex)?
I'm also having a hard time comparing it to the Perron-Frobenius theorem. Birth-death is not a positive stochastic process (one having a positive stochastic matrix), but whatever theorem I'm seeking should work also for those. Let $Q$ be a positive stochastic matrix. Then according to Perron-Frobenius (my understanding of which is mostly from http://people.brandeis.edu/~igusa/Math56F06/Math56a_lectures.pdf page 4, but also a little from wiki): the eigenspace of $1$ is exactly $1$-dimensional, and $1$ is the only eigenvalue with absolute value $1$. Further, there is a (unique, obviously) vector $\underline{\pi}$ such that it is in this eigenspace, and such that it has positive coordinates, and their sum is $1$. Further yet, $P^{\infty}$ has as all of its rows $\underline{\pi}$!! Further even yet, $P^t\pi=\pi$.
So... I'm confused. What is the theorem I'm seeking, and how does it make sense with Perron-Frobenius?