8
$\begingroup$

There are two envelopes. One contains $x$ money and the other contains $2x$ amount of money. The exact amount "$x$" is unknown to me, but I know the above. I pick one envelope and I open it. I see $y$ money in it, obviously where $y \in \{x, 2x\}$.

Now I am offered to keep or switch envelopes.

The expected value of switching is $(\frac{1}{2} \cdot 2y + \frac{1}{2} \cdot \frac{1}{2}y) = \frac{5}{4}y$. The expected value of keeping my envelope is $y$.

It seems that I should always switch envelopes. My two questions:

Is this reasoning correct?

Is it any different if I am not allowed to open the envelope and see the $y$ amount of money, and then I am given the option to switch indefinitely?

$\endgroup$
  • 2
    $\begingroup$ Related: en.wikipedia.org/wiki/Two_envelopes_problem $\endgroup$ – Herr K. Jan 8 '16 at 6:43
  • 1
    $\begingroup$ You cannot just take the expectation, you should start out with beliefs about x and update your beliefs according to Bayes' rule. Once you see y, your beliefs about which envelope you opened will have changed. $\endgroup$ – HRSE Jan 8 '16 at 7:03
  • $\begingroup$ Say x is uniformly distributed between 0 and $\infty$. Then what? $\endgroup$ – Kitsune Cavalry Jan 8 '16 at 8:02
  • $\begingroup$ @KitsuneCavalry There is no such disribution. (Please do send me a program generating such a distribution.) In fact there is no resolution which generates the pior beliefs given in your question for all values of $y$. In the link of Herr K. this is explained in en.wikipedia.org/wiki/… $\endgroup$ – Giskard Jan 8 '16 at 8:18
  • 3
    $\begingroup$ @Kitsune Cavalry The uniform distribution over the half line (or the whole line) is a well known improper prior in Bayesian statistics, see for a taste stats.stackexchange.com/a/97790/28746 or stats.stackexchange.com/a/35794/28746 $\endgroup$ – Alecos Papadopoulos Jan 9 '16 at 3:49
5
$\begingroup$

Here is an "expected utility maximization/ game theoretic" approach to the matter (with a dash of set-theoretic probability). In such a framework, the answers appear clear.

PREMISES

We are told in absolute honesty that, for $x$ a strictly positive monetary amount, the following two tickets were placed in a box : $\{A=x, B= 2x\}$ with assigned identification number $1$ and $\{A=2x, B= x\}$ with assigned identification number $0$. Then a draw from a Bernoulli $(p=0.5)$ random variable was executed, and based on the result and the event that has occurred, the amounts $x$ and $2x$ were placed in envelopes $A$ and $B$. We are not told what the value of $x$ is, or what amount went to which envelope.

First CASE: Choose an envelope with the option to switch without opening it

The first issue is how do we choose an envelope? This has to do with preferences. So assume that we are expected utility maximizers, with utility function $u()$.

We can model the probabilistic structure here by considering two dichotomous random variables, $A$ and $B$ representing the envelopes, and the amount in them. The support of each is $\{x, 2x\}$. But they are not independent. So we have to start with the joint distribution. In table form, the joint distribution, and the corresponding marginal distributions are

\begin{array}{| r | r | } \hline \text{A} \;/ \;\;\text{B} \rightarrow & x & 2x & \text {Marg A} \\ \hline \hline x & 0 & 0.5 & 0.5\\ \hline 2x & 0.5 & 0 & 0.5 \\ \hline \text{Marg B} & 0.5 & 0.5 & 1.00 \\ \hline \end{array}

This tells us that $A$ and $B$ have identical marginal distributions.

But this means that it doesn't matter how we choose envelopes, because we will always get the same expected utility,

$$0.5 \cdot u(x) + 0.5\cdot u(2x)$$

What we are facing here is a compound gamble (how to choose an envelope) over two identical gambles (each envelope). We can choose $A$ with probability $1$, $0$, or anything in-between (and complementarily for $B$). It doesn't matter. We will always get the same expected utility. Note that our attitude towards risk doesn't play a role here.

So we do choose an envelope, say $A$, and we are looking at it. What is now our expected utility? Exactly the same as prior to choosing. Picking an envelope in whatever way, does not affect the probabilities of what's inside.

We are allowed to switch. Say we do, and now we are holding envelope $B$. What is now are expected utility? Exactly the same as before.

These are the two possible states of the world for us: choose $A$ or choose $B$. Under any choice, both states of the world imply the same value to our chosen/assumed driving force (i.e. maximize expected utility).

So here, we are indifferent to switching., and in fact we could also randomize.

2nd CASE: OPENING THE ENVELOPE with the option to switch after

Assume now that we have picked $A$, opened it, and found inside the amount $y \in \{x, 2x\}$. Does this change things?

Let's see. I wonder, what is

$$P(A = x \mid A \in \{x, 2x\}) = ?$$

Well, $\{x, 2x\}$ is the sample space on which random variable $A$ is defined. Conditioning on the whole sample space, i.e. on the trivial sigma-algebra, does not affect neither the probabilities, nor the expected values. It is as though we wonder "what is the value of $A$ if we know that all possible values may have been realized?" No effective knowledge has been gained, so we are still at the original probabilistic structure.

But I also wonder, what is

$$P(B = x \mid A \in \{x, 2x\}) = ?$$

The conditioning statement, properly viewed as a sigma-algebra generated by the event $\big \{A \in \{x, 2x\}\big\}$, is the whole product sample space on which the random vector $(A,B)$ has been defined. From the table of the joint distribution above, we can see that the probability allocation of the joint is equivalent a.s to the probability allocation of the marginals (the "almost surely" qualification due to the presence of two events of measure zero). So here too we essentially condition the probabilities for $B$ on its whole sample space. It follows that our action to open the envelope did not affect the probabilistic structure for $B$ also.

Enter game theory, alongside decision making. We have opened the envelope, and we have to decide whether we will switch or not. If we don't switch we get utility $u(y)$. If we switch, then we are in the following two possible states of the world

$$y = x, u(A) = u(x) \implies u(B) = u(2x)$$ $$y = 2x, u(A) = u(2x)\implies u(B) = u(x)$$

We do not know which state actually holds, but per the above discussion, we do know that each has probability $p=0.5$ of existing.

We can model this as a game where our opponent is "nature" and where we know that nature plays with certainty a randomized strategy: with $p=0.5$ $y=x$ and with $p=0.5$, $y=2x$. But we also now that if we do not switch, our payoff is certain. So here is our game in normal form, with our payoffs:

\begin{array}{| r | r | } \hline \text{We} \;/ \;\;\text{nature} \rightarrow &y= x & y=2x \\ \hline \text{Switch} & u(2x) & u(x) \\ \hline \text{Don't Switch} & u(y) & u(y) \\ \hline \end{array}

We should resist the temptation to substitute $u(x)$ and $u(2x)$ for $u(y)$. $u(y)$ is a known and certain payoff. The payoffs for the "Switch" strategy are not actually known (since we do not know the value of $x$). So we should reverse the substitution. If $y=x$ then $u(2x) = u(2y)$, and if $y=2x$ then $u(x) = u(y/2)$. So here is our game again:

\begin{array}{| r | r | } \hline \text{We} \;/ \;\;\text{nature} \rightarrow &y= x & y=2x \\ \hline \text{Switch} & u(2y) & u(y/2) \\ \hline \text{Don't Switch} & u(y) & u(y) \\ \hline \end{array}

Now all the payoffs in the matrix are known. Is there a pure dominant strategy?

The expected payoff of strategy "Switch" is

$$E(V_S) = 0.5\cdot u(2y) + 0.5 \cdot u(y/2)$$

The expected payoff of strategy "Don't Switch" is

$$E(V_{DS}) = u(y)$$

We should switch if

$$E(V_S) > E(V_{DS}) \implies 0.5\cdot u(2y) + 0.5 \cdot u(y/2) > u(y)$$

And now, attitude towards risk becomes critical. It is not difficult to deduce that under risk-taking and risk neutral behavior, we should Switch.

As regards risk-averse behavior, I find an elegant result:

For "less concave" (strictly above) utility functions than logarithmic (say, square root), then we should still Switch.

For logarithmic utility $u(y) = \ln y$, we are indifferent between switching or not.

For "more concave" than (strictly below) logarithmic utility functions, we should not Switch.

I close with the diagram of the logarithmic case

enter image description here

Assume $y=4$. Then $y/2 =2, 2y = 8$. The line $Γ-Δ-Ε$ is the line on which the expected utility from "Switch" will lie. Since nature plays a $50-50$ strategy, it will actually be at point $\Delta$, which is the middle point of $Γ-Δ-Ε$. At that point with logarithmic utility, we get exactly the same utility from "Don't Switch", i.e. $\ln(4)$ for this numerical example.

$\endgroup$
  • $\begingroup$ Invoking "risk aversion" through a logarithmic utility function do not resolve the paradox. As noted by @HRSE, using Bayes theorem, the probabilities that the payoffs are $u(2y)$ and $u(y/2$ are not 0.5 after seeing the amount in the first envelope. This would only hold for a highly questionable uniform improper prior on $x$ (for $x>0$). If using a proper prior on $x$ (reflecting one's beliefs about $x$), the solution becomes to switch if $y$ is sufficiently small and to keep the first envelope if $y$ is sufficiently large. See jstor.org/stable/2685310. $\endgroup$ – Jarle Tufto Jan 15 '18 at 9:52
  • $\begingroup$ @JarleTufto The way I see it, the uniform prior is the correct prior, if one decides to believe the organizers of the game, when they say that the money amounts were put in the envelops following a Bernoulli draw with $p=0.5$. If one wants to be suspicious, not believe the organizers and form some other prior belief, it is of course his right, but he would have to come with some argument to convince me as to a) why the organizers are lying and b) how does he chooses the different prior he chooses. Note that my answer presupposes that we believe the organizers on the matter. $\endgroup$ – Alecos Papadopoulos Jan 15 '18 at 13:59
  • $\begingroup$ I of course agree that you are given each envelope containing amounts $X$ and $2X$ respectively with equal probabilities of 1/2. What I'm saying is that the implicit improper uniform prior on $X$ that you use, that is, $\pi(x) =1$, for all $x>0$ leads to the paradox because Bayes theorem then leads to $P(X=y|Y=y) = P(X=y/2|Y=y)=1/2$ where $y$ is the observed amount in the first envelope. Using a proper prior $\pi(x)$ instead, these conditional probabilities differ and the optimal decision depends on $y$ (and of course the utility function). $\endgroup$ – Jarle Tufto Jan 15 '18 at 14:19
  • $\begingroup$ @JarleTufto This improper prior you mention, it reflects probabilities related to what? $\endgroup$ – Alecos Papadopoulos Jan 15 '18 at 14:27
  • $\begingroup$ The amount of money in the two envelopes are $X$ and $2X$. The prior probability distribution represents your beliefs about about $X$ before opening any envelope. You're either implicitly using this particular prior or you're committing the fallacy of equating reverse conditional probabilities. $\endgroup$ – Jarle Tufto Jan 15 '18 at 16:28
0
$\begingroup$

If you open envelope E1, and see that its value is E1=Y, then it is true that the other envelope E2's value is in {E2=Y/2, E2=2Y}.

It is also true that the expected value of that envelope is (Y/2)*Pr(E2=Y/2)+(2Y)*Pr(E2=2Y).

The error is assuming that Pr(E2=Y/2) = Pr(E2=2Y) = 1/2 regardless of what Y is. A simplistic way to show this, is to assume that each envelope contains US paper money of various denominations. If Y=$1, then it is impossible for E2 to be Y/2.

A more rigorous proof is too detailed to provide here, but a summary of it is to first assume that, for any value Z, that Pr(Z/2<=E2< Z)=Pr(Z<=E2<2Z). This is essentially the same assumption as in the last paragraph, expanded to a range of values. But if this is true for any value of Z, it means Pr(Z*2^(N-1)<=E2< Z*2^(N-1)) is constant for every value of N, from -inf to inf. Since that is impossible, the assumption can't be correct.

+++++

That may have been a little confusing, so let me try an example. You are given two sets of two envelopes. In one set, they contain 10 and 20 dollars. In the other, they contain 20 and 40. You pick a set, and then open one envelope in that set to find 20. You are then offered the chance to switch to the other envelope in that set. Should you?

Yes, should switch. The expected gain by switching to the other envelope is [(20-10)+(20-40)]/2 = +5.

Note that this instance - that is, knowing that you found 20, and not 10 or 40, fits the conditions you describe in your question. So your solution works. But the experiment itself does not fit that description. If you had found 10, or if you had found 40, the probability other envelope has 20 is 100%. The expected gains are +10, and -20, respectively. And if you average the three possible gains over the probabilities you would get the three values, you get 10/4 + 5/2 - 20/4 = 0.

$\endgroup$
  • $\begingroup$ Why would I assume an envelope could not have 50 cents in it? Also the question is specifically asking about times where you don't know the possible amounts that could be in it, just the possible relative amounts, so I'm not really following this. $\endgroup$ – Kitsune Cavalry Apr 1 '16 at 14:44
  • $\begingroup$ I said it was a simplistic approach. It started with 'assume that each envelope contains US paper money.' Since you can't have 50 cents in US paper money, Pr(E2=$2|E1=$1)=1. The point is, that assuming Y/2 and 2Y are equally likely, when you don't know Y, is assuming a de facto distribution for Y that is impossible to achieve. $\endgroup$ – JeffJo Apr 1 '16 at 14:48
0
$\begingroup$

Generally the problem is unsolvable because you haven't specified the randomization procedure of the whole experiment.

But let Y be the value of the envelope you picked, and X the other envelope. The answer is then $E[X|Y=y]$ - which is a conditional expectation . However, assuming a most general distribution of Y, Y is uniformly drawn from all of $\mathbb{R}$. But then $Pr(Y=y)=0$, and by the Borel–Kolmogorov paradox the expectation is unsolvable.

$\endgroup$
  • $\begingroup$ @JeffJo, I couldn't comment under your post due to not having sufficient reputation. I added this answer because I believe it's related to your post. $\endgroup$ – John Rambo Jan 30 at 23:09

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.