2
$\begingroup$

Related to this question. The central limit theorem proves that the distribution of the average of $n$ uniform distributions (say, on the unit interval) converges in probability to a normal distribution. I've seen the proof, and it makes sense. But conceptually, it doesn't make sense to me. The average of $n$ values in the unit interval lies again in the unit interval. So how can their be a non-zero probability that the average lies outside of the unit interval? Shouldn't it converge to a probability distribution function that is only non-zero in the unit interval?

  • 0
    Where does the central theorem say what you claim it says?2012-12-21
  • 0
    @DilipSarwate Hence the "stupid"... :p2012-12-21

1 Answers 1

2

You are confusing the law of large numbers and the central limit theorem. The law of large numbers asserts: $$ \operatorname{plim}\limits_{n \to \infty} \frac{1}{n} \left(X_1 + X_2 + \cdots + X_n\right) = \mathbb{E}(X) $$ Notice that $\mathbb{E}(X)$ is going to belong to the unit interval in accord with your intuition.

The central limit theorem states: $$ \frac{ \frac{1}{n} \left(X_1 + X_2 + \cdots + X_n\right) - \mathbb{E}(X) }{ \sqrt{ \frac{\mathbb{Var}(X)}{n}}} \operatorname{\stackrel{d}{\longrightarrow}}\limits_{n\to\infty} Z $$ where $Z$ is the standard normal random variable.

  • 0
    That's what I was looking for. It was the factor in the denominator I was missing. On Wikipedia, they phrased the same idea in a more confusing way. Thanks!2012-12-21
  • 0
    @Learner Thanks, I have corrected the names and added links.2012-12-22