11
$\begingroup$

After reading this paragraph:

A simpler version of this distinction might be more palatable: flip a coin infinitely many times. The probability that you flip heads every time is zero, but it isn't impossible (at least, it isn't more impossible than flipping a coin infinitely many times to begin with!).

From here: Is it generally accepted that if you throw a dart at a number line you will NEVER hit a rational number?

I thought to myself, why is the probability of flipping heads every time zero? If we have a perfect coin and we flip it twice we get the probability to equal this:

$\frac 12 \times \frac 12 = \frac 14$

or for four flips we get this:

$\frac 12 \times \frac 12 \times \frac 12 \times \frac 12 = \frac 1{16}$

So as we approach an infinite amount of coin flips, the probability gets smaller and smaller, but it shouldn't ever reach zero, so the probability shouldn't be zero, it should be $1/+\infty$. Does this mean that $1/+\infty$ equals zero or have I misunderstood the question?

  • 0
    You can't just haphazardly plug-in infinity to any mathematical expression, as those expressions only handles numbers. Infinity is not a number.2018-01-02

7 Answers 7

19

Some of the answers so far have claimed that it is not possible to make sense of flipping a coin infinitely many times. In mathematics, this is not true; there is a perfectly well-defined mathematical model (a probability space) of what it means to flip a coin infinitely many times. This model has the following properties:

  • It assigns a probability, which is a non-negative real number, to various sets of possible infinite sequences of coin flips. (There are technicalities and subtleties around the issue of what sets have well-defined probabilities that are not relevant to this question.)
  • This assignment $\mu$ has the property that the probability that an infinite sequence of coin flips starts with any particular sequence of coin flips of length $N$ is $\frac{1}{2^N}$.
  • This assignment $\mu$ also has the property that if $S$ is a set of sequences of coin flips and $T$ a set of sequences of coin flips which contains $S$, then $\mu(S) \le \mu(T)$. (This is a general property of measures.)

From this the probability of only flipping heads is uniquely determined: it is at most the probability of flipping $N$ heads first for every positive integer $N$ (so at most $\frac{1}{2^N}$), and it is a non-negative real. The only non-negative real with this property is $0$ by the Archimedean property of the reals. So the probability of only flipping heads must be $0$.

One can think of this argument as computing a limit via the monotone convergence theorem for sets, but it is computing something slightly more basic, namely an infimum. In any case, $\frac{1}{\infty}$ is not a probability because it is not a real number.

  • 0
    Glad you made that clear. One might get the wrong idea from the term "properties".2012-06-11
6

I think you are confusing "equal to" with the concept of the limit. In mathematics one defines the limit of a sequence to be a certain number, if the result is "closer" then any deviation from that number.

In your example, the probability of throwing heads $N$ times is $2^{-N}$. For any small deviation from zero $\epsilon$ we can find an $N$ such than $2^{-N} < \epsilon$. It is therefore correct to state:

The limit of probability of throwing heads $N$ times as $N$ goes to infinity is zero

This is often incorrectly shortened to:

The probability of flipping heads every time is zero

The reason this last statement is incorrect, is simply because the probability of flipping heads "every time" is simply undefined without first defining what you mean by "every time". This is exactly why we need the more formal definition of the limit.

  • 0
    @QiaochuYuan: absolutely. I don't doubt that your construction is a good one, and it works great for the finite case, and there is an interpretation of the infinite case such that it works there too. It's probably true that that's the only good interpretation of the infinite case. But I still think it's important to recognise that the interpretation is going on, and you're not really talking about an endless line of coins being tossed into the air. (That said, that article is lovely!)2012-06-24
3

You can't flip a coin an infinite number of times. The probability of such a sequence of coin flips always yielding 0, comes as an extrapolation from flipping the coin a finite number of times. The probability of "0" here indicates a limit not an actual frequency. I agree that such might work out better as (1/+inf), but that does NOT imply that (1/+inf)=0, since (1/+inf) is NOT a number. Which positive infinity do you mean when you write "+inf"? We could just say that such a probability equals an infinitesimal, and I doubt that any real objection to that will exist (only people who object to non-zero infinitesimals would object, I think).

  • 1
    Keisler's book, like most introductory calculus texts, doesn't explicitly introduce the extended real numbers, and instead opts to treat $+\infty$ as a formal symbol -- and it retains the same meaning as it does in standard analysis, as it should. If you read through Keisler's book, you will never see him use the symbol $+\infty$ to refer to a hyperreal number. I think that is the #1 mistake I see people make when talking about the hyperreal numbers: confusing the symbol $+\infty$ with an ordinary infinite hyperreal. (The other candidate for #1 is $0.99\ldots \neq 1$)2012-06-11
3

The answer to your question is available in this wiki page. In particular look at the section on tossing a coin.

The explanation to your question is convergence. We aren't really considering $1/\infty$ but rather the sequence $1/n$ as $n \rightarrow \infty$.

1

If you are interested in extending the number system (the real numbers, complex numbers), then you may want to think about the surreal numbers. In the real numbers we have the following statement: "The limit of $1/x$ as $x$ approaches infinity is zero". This is not the same as $1/\infty=0$, for the reasons outlined in the above answers. However, in the surreal numbers, we have many more numbers: the real numbers, various infinite cardinalities, and infinitesimal and even square roots of these. In the surreal numbers the question needs to be revised: is their an infinite number whose reciprocal is zero. The answer to this is no. The reciprocal of an infinite number is an infinitesimal.

  • 2
    However, just as for every other ordered field, there is a corresponding *extended* surreal number $+\infty$, and $1/(+\infty)=0$ in that number system.2012-06-10
1

While others have illustrated ways in which you can reason about infinite coin flips, I think I can show more directly why your reasoning is incorrect:

So as we approach an infinite amount of coin flips, the probability gets smaller and smaller, but it shouldn't ever reach zero, so the probability shouldn't be zero, it should be 1/+∞.

But just as the probability never "reaches" zero, so the denominator never "reaches" $+\infty$ (even if you come up with a firm idea of what that symbol means, and how you could reach it). All this tells you is that looking exclusively at what happens for any finite number of coin flips doesn't tell you anything for sure about what happens when you conduct an infinite number of coin flips. The infinite is altogether more exotic and strange than the finite.

Here's an illustrative example: suppose I start with the question "If I flip $N$ coins, what is the probability I get $N$ heads?" and decide I'm interested in a version of this question with $N=\infty$. Either of the following sound like sensible ways forward:

  1. If I flip infinitely many coins, what is the probability that infinitely many of them are heads?
  2. If I flip infinitely many coins, what is the probability that all of them are heads?

They're both essentially the result of thinking about $\infty$ instead of $N$. But a moment's thought shows they are completely different questions! In particular, the answer (in the usual probability model, as described by Qiaochu Yuan) is $1$ for the first question and $0$ for the second – they couldn't possibly be more different! (Notice that it is possible, say in the sequence $HTHTHT\dots$ to get $\infty$ for both the number of heads and the number of tails, while it's certainly not possible in the previous question to get both $N$ heads and $N$ tails.)

So you can't just write symbols like $+\infty$ in the place of ordinary finite numbers and expect to get a sensible result. In mathematics, infinity is used in altogether more delicate ways: although there are ways in which you can make it a number, or at least behave in number-like ways, it is certainly not the same sort of number as $2$ or $7$ or $\pi$ or $i$. So don't ask what $1/\infty$ is before first making sure that you know what $\infty$ is, and why you care about the result.

Furthermore, if you think that the probability of an infinite number of coin tosses all coming up heads is not zero, well, you are welcome to go away and toss an infinite number of coins, and when you're done come back and tell us what you got. The fact that you can't do this ought to make you think about what you really mean when you ask a question like "what happens when I toss infinitely many coins" and on what authority can you prononunce one or another answer to that question "right" or "wrong". The mathematical answers to this question, I would argue, are neither right nor wrong but merely convenient: they let you think about things in a simple and uniform way that is always consistent and is correct for every testable situation (and not incorrect for any other situation, since correctness makes no real sense there!)

0

I have an answer to this question that has nothing to do with probability, but rather has a geometric proof. It has to do with the ratio of an arc segment of a circle to the radius of the circle. If the angle in radians of an arc segment of a circle $\theta$ is held constant, then the radius of the circle $r$ increases with the length of the arc segment $s$ because $\theta = \frac{s}{r}$. So, if we hold the length of $s$ constant and we decrease the value of $\theta$, then the value of $r$ increases. Given a value of $s = 1$ and a value of $r = \infty$, then $\theta = 0$, or $0 = \frac{1}{\infty}$. If this were not true, it would be impossible to draw a straight line. Perhaps it is impossible to draw a straight line in real space/time, I am not sure yet.

  • 0
    The first part of your "geometric proof" is concerned with taking a limit as $\theta \to 0$ and consequently $r \to \infty$. Then you replace $\theta, r$ by these respective limits to get the conclusion. The proposed justification for that, saying, "if this were not true, it would be impossible to draw a straight line," seems to be a leap in logic.2017-06-08