2
$\begingroup$

Suppose a number of players are given $100$ points each, and repeatedly engage in a gamble having positive expected value, with the goals of being the first player to reach $100000$ points. Solving for the optimal bet size per round to balance risk of ruin and speed of point accrual is a very difficult game theory problem, so the reasonable approach seems to be to impose a heuristic constraint on the risk of ruin, and optimize speed relative to that constraint. Let's say I decide I want no more than a $2$% probability of going bankrupt before reaching the $100000$ point goal. Now I can simulate the game a large number of times to find the bet size which reaches the goal in as few rounds as possible (probably the largest bet size) without exceeding the target risk of ruin.

However, suppose I am playing the game in practice, and have accrued a point total of $1000$. The remainder of the game is functionally equivalent to a new, identical game, except that in the new game, I start with $1000$ points instead of $100$ points. In other words, the game I've been describing has an optimal substructure. It seems to me that in the new game, my desired risk of ruin constraint should still be about the same, $2$% in the example; there seems to be no fundamental reason (apart from assessing my position relative to other players, which is beyond the scope of this question) to suppose I would have a different risk tolerance in the race from $1000$ to $100000$ than in the race from $100$ to $100000$. Allowing the risk of ruin to decline too much as the game progresses is an unnecessary speed concession.

The problem is that changing my strategy as the game progresses to retarget a $2$% risk of ruin means my original strategy actually had more than a $2$% risk of ruin. My present, $1000$ point self shouldn't care about this enough to dissuade me from retargeting (the past is in the past), but my past $100$ point self foreseeing this phenomenon cares a lot. It seems that what's needed is a function which maps every possible point total between $1$ and $99999$ to a bet size, where the risk of ruin at every input is more or less constant (maybe lower at the very end of the game due to the discreteness of the problem), but it is unclear that such a function is possible, because attaining points would always reduce risk of ruin no matter what function is chosen. Is is possible to construct such a function? If not, how can I rationally play this game when I know my underlying risk of ruin preferences won't change much as the game progresses, and I will not stick to any possible strategy I create?

EDIT regarding nature of gamble, as per request in comments: Suppose that each round consists of rolling fair dice, and the profit or loss a player attains for that round is computed based on the sum of the rolls (with a positive expected value). Profit or loss are always an integer multiple of the bet size. Each set of rolls is independent and identically distributed relative to their previous rolls and other players' rolls.

Improve this question
$\endgroup$
14
  • 1
    $\begingroup$ It is a little tough to answer without a few more details (e.g., what is the nature of the gamble?), but I suspect the answer is either, "it cannot be done," or otherwise unsatisfying. For example, take the case of 99999 coins: if I lose, I'll have less than 99999 coins and a subsequent 2% chance of bankruptcy; if I win, I win the game and do not go bankrupt. This is only consistent with a 2% chance of bankruptcy today if I gamble all 99999 coins AND losing everything is possible AND has a specific probability. $\endgroup$
    – kyle
    Commented Aug 9, 2021 at 6:17
  • $\begingroup$ @kyle Indeed, I have considered this necessary edge case deviation. That is what I meant by "more or less constant (maybe lower at the very end of the game due to the discreteness of the problem)." $\endgroup$
    – user37672
    Commented Aug 9, 2021 at 15:46
  • $\begingroup$ A strategy is a complete algorithm for decision making at any possible game state. One cannot "change strategy" partway through a game - that is the strategy itself. Your strategy must dictate what to do at every possible game state, otherwise it's not a strategy. For arbitrary games, I don't see any expectation that risk of ruin should be able to remain constant - one can imagine a game where victory is inevitable after a certain point total, in which risk of ruin goes to 0 after some point. $\endgroup$
    – Nuclear Hoagie
    Commented Aug 12, 2021 at 20:42
  • $\begingroup$ @NuclearHoagie I am using "strategy" in the same way you have defined it, which I suspect may point to the heart of the paradox. To "change strategy" would be to have a complete algorithm prescribing an action from every game state (call this Strategy A), but to set it aside and create a new complete algorithm prescribing an action from every game state (Strategy B). I think your point is that this behavior is functionally equivalent to a single strategy whose actions are identical to A when the player would follow A, and B when the player would follow B, which I fully appreciate is true. $\endgroup$
    – user37672
    Commented Aug 12, 2021 at 21:42
  • $\begingroup$ I used the model of "changing strategy" merely for clarity in understanding the paradox, which is that a player with constant risk preferences seemingly cannot rationally commit to a strategy in which risk monotonically decreases as their point total increases. At some point (possibly at the start), risk will either be too high or too low, and the player will scrap the strategy. But if all possible strategies have this feature, then it seems the player cannot rationally play the game according to any strategy, which is clearly false. $\endgroup$
    – user37672
    Commented Aug 12, 2021 at 21:45

1 Answer 1

Reset to default
2
$\begingroup$

There are several problems with your game that you are not considering, the first of which is that the risk of ruin is irrelevant. The game is a race. Your question is roughly equivalent to concerning yourself with your horse falling and dying in the race but with an objective to win the race. The death of the horse is not the only way to lose. Ruin is not the only way to lose.

In controlling the risk of ruin, you may guarantee that you lose the race. You have two additional problems as well.

Because ruin is impossible in the real numbers, the game must have one unit as the smallest indivisible amount. Now let us imagine that the payoff for some combination is 1.01:1, and you bet 1 unit. You can only be paid 1 unit.

Your third problem is that this is a race being run by a random number generator. If this were a game of skill instead of chance, then answers might be quite a bit different.

The winner will be the actor that succeeds only through randomness the most. It is possible to maximize the return over infinite repetition of the game, but not in any one instance.

It is true that you could make a Kelly Bet for the first round, but what if one other actor doubles their money and you halve yours? The two parties should even out as time goes to infinity, but this is a race to a finite goal. This is a stopping time problem. If the leader is four times closer than the last place person, does either change their strategy? This is an all-or-nothing game. It does not matter how close you got if you were not the first across the line.

Ruin, in this framework, is just one way not to cross the finish line.

If you were sincerely considering this game, then you would have a terrible decision tree because it needs to include the potential outcomes of every actor. Your utility here is $c,c>0$ if you win and $0$ if you lose. This is not a game with a payoff for win, place or show. There is no participation trophy either.

Nonetheless, ruin avoidance should only accidentally be a strategy because it would happen to be optimal to keep you from losing.

Improve this answer
$\endgroup$
2
  • $\begingroup$ While ruin is categorically analogous to the horse dying, I think it differs enough by degree to be very relevant. In practice, ruin will be the most likely terminal state if I wager too much, while being beaten to 100000 points will be the most likely terminal state if I wager too little. All payouts are integer multiples of the wager size, so rounding isn't a problem (I will update the question with this information). The third concern is correct, and I accept that solving the problem I framed does not solve the game, but it is a much more tractable problem, and should still be useful $\endgroup$
    – user37672
    Commented Aug 15, 2021 at 18:00
  • $\begingroup$ during game play at least some of the time (such as near the start of the game when no one has a commanding lead and point totals are low). $\endgroup$
    – user37672
    Commented Aug 15, 2021 at 18:01

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.