8
$\begingroup$

Let $\zeta=\sum_{n=1}^{\infty}2^{-n}\,\omega_{n}$ , where $\omega_{n}$ are independent, $\mathbb{P}(\omega_{n}=1)=p\neq\frac{1}{2}$ . Also $\mathbb{P}(\omega_{n}=0)=1-p$ for all $n\geq1$ . I want to show that the distribution of $\zeta$ does not have a density, using Radon-Nikodym and Borel-Cantelli Lemma.

  1. Radon-Nikodym establishes a connection between probability distribution and probability density function. A probability distribution exists if and only if the probability measure is absolutely continuous with respect to the Lebesgue measure. To show that the probability measure $Pr$ is absolutely continuous with respect to the Lebesgue measure $\mu$, we need to first realize that there is a one-to-one correspondence between probability distribution functions and probability measure on the real line. Therefore, for some subset $A$ on the real line it suffices for us to show that $Pr(A)$$\geq$ $\mu(A)$, so that absolute continuity does not hold and the density does not exist.

So, writing the probability distribution of partial sum $\zeta=\sum_{n=1}^{N}2^{-n}\,\omega_{n}$ $=$ $\sum_{m=1}^{N}(1-p)^{m}p^{N-1-m}\left(\sum_{\beta\in\{_{N-1}C_{m}\}}\Pr\left(2\omega_{1}\leq(j-\beta)\right)\right)$, where $\beta$ is just a different combination in the indicies of the sum $\sum 2^{-n}$.

I suspect Borel-Cantelli should come handy here to control the infinite sum perhaps? I am a bit lost, but I would appreciate any advice. Thanks!

  • 1
    Why do you want to use Radon-Nikodym and Borel-Cantelli? This is not the usual method. (And the paragraph *Radon-Nikodym establishes a connection...* is a mystery to me.)2012-04-15
  • 0
    @ Didier- we want to deal with absolute continuity here. What would you suggest?2012-04-15
  • 0
    By the law of large numbers for i.i.d. Bernoulli random variables, each distribution of $\zeta$ for a given $p$ is singular with respect to all the others. The case $p=\frac12$ is the Lebesgue measure on $[0,1]$, hence you are done.2012-04-15
  • 0
    Didier- I tried understand what you said, but I couldn't. Can you be more specific?2012-04-16
  • 0
    I reverted your edit of the title: please do not use the title for what should have been done with a comment here!2012-04-16
  • 0
    The paragraph on the Radon-Nikodym connection makes sense to me. After all, that's the precise way in which the Cantor function (which is a valid CDF) is shown to have no PDF.2012-04-16
  • 0
    @EMS No. (But *precise* is sweet.)2013-02-28
  • 0
    @Did I'm sorry that you don't understand the paragraph. It is a very nice way of explaining absolute continuity in the context of probability distributions here. Perhaps if you explain why you don't understand it, we can work together to provide a better explanation for you.2013-02-28
  • 0
    @Did For instance, have you considered the [Wikipedia article on the Radon-Nikodym Theorem](http://en.wikipedia.org/wiki/Radon%E2%80%93Nikodym_theorem)? There it says: "... Specifically, the probability density function of a random variable is the Radon–Nikodym derivative of the induced measure with respect to some base measure (usually the Lebesgue measure for continuous random variables)."2013-02-28
  • 0
    @EMS Soooo sweet again. As regards the paragraph in the OP, I salivate at the idea of seeing *A probability distribution exists if and only if the probability measure is absolutely continuous with respect to the Lebesgue measure* explained to me (second sentence of the paragraph, the third and fourth are still more mysterious).2013-02-28
  • 0
    @Did The random variable induces a probability measure via is cumulative distribution function. This is standard in any probability theory textbook. If that measure is absolutely continuous w.r.t. the Lebesgue measure, then the random variable admits a probability density function (unfortunately often just called a 'distribution' function).2013-03-01
  • 0
    @EMS Your entire last comment is true, trivial, and (unfortunately) quite unrelated to the paragraph in the OP. Unless you have something to say related to the actual paragraph, please let me sleep.2013-03-01
  • 0
    @Did I apologize for trying to be helpful. Since you would rather win the argument than understand the paragraph, I will not bother you about it further.2013-03-01
  • 0
    @EMS Sure... :-)2013-03-01

1 Answers 1