13
$\begingroup$

I came across a definition for a "small set" (of the state space) $A \subset \Omega$: there exists a $\delta > 0$ and a measure $\mu$ such that $p^{(k)}(x, \cdot) \geq \delta \mu (\cdot)$ for every $x \in A$. In this case, they say that $A$ has lag $k$.

I have no intuition for this and I can't find anything anywhere that explains this with some examples. Can anyone tell me what it means? Why is it important?

  • 1
    @Srivatsan as Didier wrote, such concept is indeed often used in the theory of Markov Chains, as well as petite sets which happen to be different.2011-11-26

4 Answers 4

8

This is actually an important and much used concept in the study of Markov chains. The number $\delta$ is meaningful because one assumes $\mu$ is a probability measure (and not only a measure). Then $\delta$ is used to evaluate the rate of the loss of memory of the initial state by the chain.

  • 0
    @konpsych You are entitled to your, rather peculiar, view of the situation, naturally (and your little word play about "no examples in any answer", to avoid mentioning that a book is mentioned in the comments, was duly noted). Of course, I see no reason to delete my comment.2018-02-04
5

If $A$ is "small," then the chain probabilistically regenerates/forgets its past once it enters $A$. Also, smallness has nothing to do with its measure or anything like that; there are many examples of chains with the entire state space that’s small.

Background: if a transition kernel is of the form $ p^{(1)}(x,B) = \nu(B) \quad{(*)} $ for all $x$ and $B$, then the chain elements are independent. This is because the transition doesn't depend on where it's coming from: $x$.

With a small set, we're only looking at $x \in A$. If $A$ is $k=1$ small, then $p^{(1)}(x,\cdot) \ge \delta \nu(\cdot)$ for all $x \in A$, and we can write the transition kernel as follows: \begin{align*} p^{(1)}(x,\cdot) &= \delta \nu(\cdot) + p^{(1)}(x,\cdot) -\delta \nu(\cdot)\\ &= \delta \nu(\cdot) + (1-\delta) \frac{p^{(1)}(x,\cdot) -\delta \nu(\cdot)}{1-\delta} \\ &= \delta \nu(\cdot) + (1-\delta)K(x, \cdot). \end{align*}

This is a discrete mixture, so with probability $\delta$ you're transitioning with $\nu$ and forgetting the past, and with probability $1-\delta$, you're transitioning with something that takes into account where you're coming from and not forgetting the past. The smallness property gives us the nonnegativity of $K$.

As @Did mentions, "$\delta$ is used to evaluate the rate of the loss of memory of the initial state by the chain." You can see that if $\delta = 1$, then we get equation $(*)$.

Other things: If $k > 1$, then it takes longer to forget, and if we’re talking about “petiteness” then it’s the same idea but with a random number of steps.

2

Yes you can find a lot related topic at Jeffery Rosenthal's paper, especially the "General State Markov chain and MCMC algorithm".

Another useful reference is Nummelin's paper called "MC for MCMC". This is more intuitively than Rosenthal and when I write paper about this topic this summer, I find it is really useful.

  • 0
    please refer to this paper, it discuss a lot for small set:http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=4&sqi=2&ved=0CGYQFjAD&url=http%3A%2F%2Fciteseerx.ist.psu.edu%2Fviewdoc%2Fdownload%3Fdoi%3D10.1.1.30.8109%26rep%3Drep1%26type%3Dps&ei=9NgeUO6oIaaJywGw3oCwCg&usg=AFQjCNGKL9_srAqK96CTz6r2XJrdTbbyqQ&sig2=NLpnfAmT48OgjFbR_aGUhA2012-08-05
0

Small/Petite sets are usually used to prove recurrence of a Harris chains in a general state space. For example when you have a process that has random jumps, the probability that the chain will return to a single point in state space is 0, yet it can be certain that it will return to a closed interval in that space and it remains to show that this closed interval is small/petite to complete the proof of recurrence.

In section 5.3.5 of this paper there is a construction of a measure $\mu$ that has the properties of definition. Notice that the equivalent of $k$ is a random variable that also needs to be specified.