5
$\begingroup$

Can anyone help me with this problem, I can't figure out how to solve it...

Let $X$ be a random variable which can take an infinite and countable set of values. Prove that $X$ cannot be uniformly distributed among these values.

Thanks!

  • 3
    Consider a [geometric random variable](http://en.wikipedia.org/wiki/Geometric_distribution) as a counterexample.2012-12-10
  • 2
    I think that the question is the opposite: Let $X$ be a random variable which can take an infinite and countable set of values. Prove that $X$ cannot be uniformly distributed among these values.2012-12-10
  • 2
    @madprod you're right, thank you. I translated it worng, sorry! I edited.2012-12-10

2 Answers 2

7

Let $X$ be a random variable which assumes values in a countable infinite set $Q$. We can prove there is no uniform distribution on $Q$.

Assume there exists such a uniform distribution, that is, there exists $a \geq 0$ such that $P(X=q) = a$ for every $q \in Q$.

Observe that, since $Q$ is countable, by countable additivity of $P$,

$1 = P(X \in Q) = \sum_{q \in Q}{P(X = q)} = \sum_{q \in Q}{a}$

Observe that if $a=0$, $\sum_{q \in Q}{a}=0$. Similarly, if $a>0$, $\sum_{q \in Q}{a} = \infty$. Contradiction.

  • 1
    Horga, observe that if $Q$ is infinite but non-countable, there might exist a uniform distribution on $Q$. For example, take $Q = [0,1]$. Can you see why the proof doesn't work for this case? Can you find an infinite non-countable set which admits no uniform distribution? Answering these questions might help you to understand what is really going on.2012-12-10
  • 0
    What is the difference between infinite but non-countable and countably infinite sample space?? The prove above is a complete contradiction prove for countably infinite sample space, right?2013-10-02
  • 0
    Yes. It is a contradiction proof for a countably infinite sample space. A countably infinite sample space $\Omega$ is such that there exists a bijective function between $\Omega$ and $\mathbb{N}$, the natural numbers. A non-countable infinite sample space is such that there exists no such bijective function.2014-01-30
3

If each point has probability $p\ne 0$, then there is some integer $n$ such that $np\gt 1$. So if $x_1,\dots,x_n$ are some of the distinct values taken on by $X$, the probability that $X=x_1$ or $X=x_2$ or $\dots$ or $X=x_n$ is $np$. Since $np\gt 1$, this is impossible.

On the other hand, if $p=0$, then by countable additivity the probability assigned to any subset of the values taken on by $X$ must be $0$, contradicting the fact that the sum of the probabilities over the range of $X$ must be $1$.

  • 0
    One question concerning the second part: if $p=0$: Isn't this the case for *all* continuous distributions going from minus infinity to infinity that each point must have $p=0$? This would mean that *no* such distribution could add up to $1$... Thank you for clarifying.2016-04-07
  • 2
    The question is about uniform distributions on a *countable* set. So continuous distributions are not in the game here, since a continuous distribution is defined on at least an interval. You are right that for a continuous distribution, the probability associated with any point is $0$. But the collection of points is uncountable, so the argument of the two answers do not apply.2016-04-07
  • 0
    You are right, I missed that. Thank you2016-04-07
  • 1
    You are welcome.2016-04-07