View Single Post
  #93  
Old 07-02-2006, 07:35 PM
jason1990 jason1990 is offline
Senior Member
 
Join Date: Sep 2004
Posts: 932
Default Re: The envelope problem, and a possible solution

Here's the dubious argument from the original post that we've been debating.

[ QUOTE ]
Argument 1: It's +EV to switch. You had a 50/50 chance of picking the high or low envelope so there's a 50% chance that the other envelope is the high and a 50% chance it's the low. Therefore, EV of switch = 0.5*(+100) + 0.5*(-50) = +25.

[/ QUOTE ]
Aaron, here's some of your comments about it.

[ QUOTE ]
Aaron-
I claim the envelope paradox is a true paradox, two strong arguments that lead to opposite conclusions. Yes, people invent rigorous ways to resolve it, but only by torturing commonsense ideas of uncertainty.

[/ QUOTE ]

[ QUOTE ]
Aaron-
Before we open our envelope, call the amount inside X. We know that the other envelope has a 50% chance of holding 0.5*X and a 50% chance of holding 2*X. Its expected holding is 1.25*X ... When there's no reason to think A is better or worse than B, we assume there's a 50% chance that A is better. Then if told we have a 50% chance of losing 0.5*$X and a 50% chance of gaining $X, we calculate our expected gain is 0.25*$X. It's hard to come up with general principles that prevent us from making errors in real problems.

[/ QUOTE ]

[ QUOTE ]
Aaron-
[The Paradox] asks a common sense question that appears to have two opposing common sense answers. People layer the mathematics on to it. That's fine, but making technical assumptions to make one argument right and one wrong doesn't answer the fundamental question of the paradox.

[/ QUOTE ]

[ QUOTE ]
Aaron-
The envelope paradox is simplified to make the basic contradictions clear, which makes it easy to "resolve" with ad hoc techniques. But those techniques are not much practical help in realistic problems.

[/ QUOTE ]
So you claimed that in order to counter Argument 1, we need to layer on extraneous mathematical assumptions which are designed solely to avoid this Paradox, which are typically ignored by practicing statisticians, and which are of little help in real life problems.

I then claimed that the only assumptions we need in order to counter Argument 1 are the elementary principles of probability.

[ QUOTE ]
Jason-
<ul type="square">
[1] if A and B are events, then P(A | B) = P(A and B)/P(B),
[2] if A and B are independent events, then P(A | B) = P(A),
[3] if A and B are mutually exclusive events, then P(A or B) = P(A) + P(B),
[4] if A is an event, then 0 &lt;= P(A) &lt;= 1.[/list]As far as I can tell, if we assume these four things, then it cannot be the case that

P(Y = 2X | X = k) = 0.5

for all k.

[/ QUOTE ]
(For those who haven't been following the notation of this thread, in the quote above, the statement "P(Y=2X|X=k)=0.5 for all k" means "the probability you chose the smaller envelope, given that you found it to contain $k, is 50%, regardless of the value of k".)


[ QUOTE ]
Jason-
the only techniques we need to use in order to arrive at the "sensible" conclusions are the techniques of elementary probability, such as assumptions [1]-[4] of my previous post. These are consistent, they are certainly not ad hoc, and they are extremely helpful in a wide array of realistic problems. Are you denying this?

[/ QUOTE ]
Here are some of your replies.

[ QUOTE ]
Aaron-
I accept all four of your assumptions, and don't know anyone who does not. But how do they lead to the conclusion?

The only problem I know of with P(Y = 2X | X = k) = 0.5 for all k is that the expected value of X must be infinite. I understand there are technical complexities with dealing with distributions that allow this statement to be true, but that's not the same as proving it false. Even if you outlaw them entirely, that's only a formal resolution of the paradox, not a refutation of the force of its argument.

[/ QUOTE ]

[ QUOTE ]
Aaron-
I maintain the ways people deny the force of the always switch argument result in restrictions that are commonly ignored, and if not ignored would make statisticians useless.

[/ QUOTE ]
I then showed you, using the probability space that you yourself suggested, how those assumptions lead to the conclusion. In other words, I showed that Argument 1 violates the very foundations of probability. No ad hoc assumptions are needed. No layers of ignorable mathematics are necessary. Only the axioms of probability which are given above. I apparently showed you something you had never seen before, since you said the only counter to Argument 1 that you had ever seen involved infinite expectations. Here is part of your reply.

[ QUOTE ]
Aaron-
Jason1990 does a thorough job of showing that no consistent prior distribution on T justifies the idea that the probability of switching is always 50%.

[/ QUOTE ]
In other words, I did a thorough job of showing that the logic in Argument 1, the same logic that you repeatedly claimed could only be refuted with ad hoc assumptions, violates the four assumptions given above, which are the fundamental principles of probability theory.

[ QUOTE ]
Aaron-
However, there are consistent prior distributions that justify always switching, but they have infinite expectation for T.

[/ QUOTE ]
What??? Suddenly, this is what you've been talking about all along? Who cares if there are other ways to justify always switching besides Argument 1? We've been discussing Argument 1, and you've been making claims about Argument 1 this whole time. And all of a sudden, that's not what the Paradox is about? And then ...

[ QUOTE ]
Aaron-
I think both Jason1990 and PairThe Board have redefined the original paradox

[/ QUOTE ]
Priceless. Incidentally, I am in complete agreement with PTB, and his perspective is covered as a special case of the proof I gave you by taking T to be a constant random variable. The fact that you think he and I are talking about two different things shows me that you really don't understand what either of us are saying.

I originally thought I misunderstood you. Then I thought you were just confused. Now I think you may be intentionally trying to confuse the readers of this forum. Why else would you suddenly change your tune 85 posts into the thread?

Argument 1 logically contradicts the axioms of probability theory. That's a fact. This may violate your intuition. But so will a lot of other things in mathematics. In fact, as you probably know, so will a lot of things in "real life". If you want to maintain that Argument 1 is valid in any sense, then you must either reject the axioms of probability or be logically inconsistent. I only hope that my participation in this thread has made this clear to at least one person who would have otherwise been confused. If you wish to go beyond this simple fact and discuss additional topics such as infinite expectations, Bayesian philosophy, or baseball statistics, then have fun.
Reply With Quote