I've got a box with 10 balls inside, 5 reds 5 blacks. Every step i take a ball. If it is black i hold it out, if it is red i put all the blacks ball that are out and the red one inside the box. Called $X_{n}$ the number of balls that are outside the box at the n° step, prove that $X_n$ is a markov chain.
Demonstrate that is a Markov Chain
1
$\begingroup$
markov-chains
-
0Since this is homework, please edit to show what you have done so far. What part of the definition of a Markov chain are you having trouble verifying? – 2012-01-13