Two Plus Two Newer Archives

Two Plus Two Newer Archives (http://archives1.twoplustwo.com/index.php)
-   Poker Theory (http://archives1.twoplustwo.com/forumdisplay.php?f=17)
-   -   "What decision do I make now?" : Math will not get you there (http://archives1.twoplustwo.com/showthread.php?t=135808)

Cyrus 06-11-2006 04:07 PM

\"What decision do I make now?\" : Math will not get you there
 
I'm reposting here the arguments made by Utah, in another forum of this website and on an unrelated subject originally. I'm not sure what Utah is trying to say exactly except that he -and his poker team- are after optimal play in each and every situation, irrespective of past results. And aren't we all? But I wish Utah would elaborate a bit, because which data exactly matter in his analysis and which data don't is not too clear.

Here is Utah, in own words, paraphrased only in one or two points in order to eliminate some irrelevant topical matters from the original thread.


I don't know how to measure results objectively. How does one do that? In reality, it is next to impossible to truly do [that] with anything of any complexity.

[Poker Tracker and StatKing] do nothing for the player and they will not help you improve your game. I created a much better tool that takes a completely different approach.

Let's take a simple stat - preflop aggressiveness. Let's say that I raised preflop 20% of the time. Is that good or bad? Which situations did I raise when I shouldn't have? When didn't I raise when I should have? You can't get the answers from such a stupid stat. Worse, you can't get the answers even if I provided a ton more info. It is the wrong approach.

Again, this isn't me just mouthing off on a silly message board. My team has something like 20,000 hours working on this very problem. Of course, our approach works precisely because it doesn't relay on measuring your game objectively. In fact, we don't care about the user's past play and we don't provide any of the b.s. historical product features - eg., hand playback, hand downloads, comparison charts, etc. They are not needed for a player to slaughter a table.

Mathematics will absolutely not get you there. We tried in our original effort and it failed miserably.

The question of winning or losing is never asked as it is an unimportant question. The program does not track winning/losing. The program simply cares about one thing - what decision do I make now? It is all about specificity. Certain things happened before the action came to me, certain things will happen based on whatever action I take, and now I'm holding specific cards. That is all I care about. At the moment of decision I couldn't care less about my historical results as they mean nothing (other than how other players perceive me). Knowing I historically raised 20% preflop means nothings. The fact that I am a winning or losing player means nothing. The knowledge is not actionable. I have a decision to make and all I care about is making the best decision at that moment. Everything that doesn't help me make that decision is just worthless noise.

You just can't measure things objectively and even if you could it is usually of little value. This doesn't mean that results never matter. Rather, it is a softer fuzzier analysis.

It is easy to talk about objective measures in poker but people can't back up the argument with even an objective review of a simple problem. That is the folly of "objective measures".

Utah 06-11-2006 09:05 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
Hi Cryus,

Okay, that is a lot of slicing and dicing of my comments so I am not sure exactly how to respond as there are a lot of ways to look at this issue [img]/images/graemlins/smile.gif[/img] Therefore, I will take an initial stab and please direct me if I am not answering your question.

Lets start from a most fundamental scenario - It is the preflop. You are on the button with A,8o and it is folded to the cutoff who raises. What is your play. You can call, raise, or fold.

Now, in this situation all you care about is if you should call, raise, or fold. You dont care about anything that doesnt help you determine which of the 3 options you should take. Everything in poker boils down to a decision and any information that isnt actionable is worthless.

Therefore, in the above scenario you dont care about the following:
1) Your historical win/loss
2) How often you raise preflop (other than how it affects other player's perception of you)
3) How often you call preflop
4) Any objective measure of your game

The reason is that these things cannot help you in your decision. Thus, looking at your overall historical results, i.e., objective measures, cannot really help you. Lets say that you call preflop more than the average winning player. So what? Do you start calling less then? If so, in what situations?

It is all quite silly to think that stats will help you.

Now, lets take the other player. You do care a lot about his historical play as it gives you an indication of what he holds and how he will play. BUT, what do you really know about the other player?

Lets say you are using one of these lameass stat products. It tells you that he raises preflop 30% of the time. Well, that may be a touch useful. But, that stat tells you little about what he is doing at the moment. Now, it would be very useful to know that the player raises 50% of the time in the cutoff when it folds to him and there is a certain player profile seated in button, sb, bb. but, how are you to know this player with this degree of percision? And, even if you did, how would analyze how he is going to play on the flop and beyond in certain situations? And even if you knew that you still have no idea what hands he will play the 50% of the time he raises. If you have 10,000 hands on a player you may at most have a couple of hands from this situation that made it to the showdown. Even then, you are stuck with the deviation in cards dealt. Finally, what if the player varies his play?

What you have is a bit of mess dont you. So, what players do is use intuition and starting hand charts and what not to guide them through the game. But, these are very broad strokes.

Math cannot solve this. If someone disagrees please tell me how.

Certainly, game theory can help you if you have the proper input (which you usually dont). BUT, you are pretty much screwed with game theory if you are talking more than a few players with more than 1 or 2 rounds left. for example, there are 3^169 UTG stategies a player can employ. Now, assume there is only 2 players. There are 3^169 player 2 strategies. Matlab and such can at max calculate a 1000x1000 sparsely populated matrix. The preflop matrix of 3^169 x 3^169, if calculated with the fastest computer in the world starting at the big bang, would be something like .000000000000000000000000000000001% complete by now.

Now, throw into the mix that there are 100,000s of players at a table and you rarely see the same players or have decent hand workups on them.

There is simply no way these little stat programs will hep.

There is a much better way but I will keep the IP protected for now. However, I will answer questions if I can without giving anything away.

Martin456 06-11-2006 09:23 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
Can you give us a hint?

raisins 06-11-2006 10:07 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
Hi Utah,

I followed this over from the Politics thread. For a long time I've found these questions to be some of the most vexing to answer. Math does give you an answer, but it is dependent entirely on the assumptions you make about multiple variables and most of the time they are completely made up.

I also remember an old post of Tom Weideman's on RGP noting that the ability to predict an opponents' actions on future rounds was a vastly underrated skill.

If I was working on this type of software project, here is how I would go about soving it. First I would datamine the game. Then I would fit the data into profiles. Determining what made a profile would be subjective and would be dependent on the ability and intuition of the developer. I would build collections of lines with the assumption that players who take the same line in a given situation would resemble each other in a different one. If this worked out you would know not only how often a PF raiser who was 3-bet PF and then check called the flop folded the turn versus check raising but also the likelihood of having the opportunity to check raise the river knowing the opponent intends to bet rather than take a free showdown when the overcard or fluch card rivers.

Probably the most important variable to focus on in creating the profiles would be not just the betting patterns but the flop textures that accompanied the patterns. If this or something close to it is what you did, congratulations, it must have been quite difficult.

However, I am a bit skeptical. The assumption that players who play one situation the same will also play other situations the same is necessary but I'm not convinced it is reliable. If it is, then I would think this would work best at low stakes games with opponents who at the most think about the hand you might have but they are not thinking about what you think they might have. In other words, the more of a thinking player they are the less patterned their decisions are going to be and the more attention they will be playing to you and their responses will be more spontaneous and irregular. Has your program been of benefit to you at levels where there are some tough players like 10/20 SH limit? I would also suspect that this approach would be of less value at NL where opponents will change up their lines depending on what they and their opponents have been doing in the recent past or what they suspect about their opponents mood. Have you used your program at NL? If not, do you think your subjective analysis would work there?

I've been paying some attention to your discussion of the software the past few months and I'm glad you chose to discuss your thinking about it a little bit. If nothing else, it was interesting to think about.

If you can respond to any of the areas I brought up while maintaining some dicretion about your work I am interested in hearing your thoughts.

regards,

raisins

Andrew Prock 06-11-2006 11:48 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
I think you guys are confusing two very different things. While PokerTracker might be a useful tool, it is not the beginning or ending of "math". Math is very relevant to solving these sort of problems. On the other hand, PokerTracker numbers might not be that useful.

- Andrew

ACPlayer 06-12-2006 01:00 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
I think you guys are confusing two very different things. While PokerTracker might be a useful tool, it is not the beginning or ending of "math". Math is very relevant to solving these sort of problems. On the other hand, PokerTracker numbers might not be that useful.

- Andrew

[/ QUOTE ]

On that we can agree. The decision cited by Utah still comes down to a decision on what is the action that leads to the best possible gain (or at least it should). However, clearly your personal win rate, has nothing to do with the decision. If you have an objective measure for the persons raising standards (I know players who raise the same UTG and CO) then use it, if you dont have it, develop it (or anyother measure that floats your boat).

Similarly, if his system is really better than what he was using in the past then this better be based on some actual hard data rather than just his opinion, if he wants to convince others that he is right. Otherwise it would be like most in the card room who reply "I am doing OK" when asked how they did -- meaning the wife has not left him yet.

Cyrus 06-12-2006 04:30 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
I think we are fundamentally confused here. [img]/images/graemlins/smile.gif[/img]

There are two things: One is your conditional expectation, meaning what to do in the specific situation in front of you. In other words, you are seeking to maximize the chance P of your winning in A when givent the conditions B, aka Pw(A|B). The other thing is the historical overview of your performance.

The two are not the same thing - and I would categorically agree that the second kind of analysis would help you little in the first endeavor.

[ QUOTE ]
Lets start from a most fundamental scenario - It is the preflop. You are on the button with A8o and it is folded to the cutoff who raises. What is your play? You can call, raise, or fold.

Now, in this situation all you care about is if you should call, raise, or fold. You dont care about anything that doesnt help you determine which of the 3 options you should take. Everything in poker boils down to a decision and any information that isnt actionable is worthless.

Therefore, in the above scenario you dont care about the following:
1) Your historical win/loss
2) How often you raise preflop (other than how it affects other player's perception of you)
3) How often you call preflop
4) Any objective measure of your game.

[/ QUOTE ] I agree.

(But I can't help noticing that you just referred, in #4 above, to "the objective measure of my game". [img]/images/graemlins/smile.gif[/img] Didn't you just write that "We just can't measure things objectively" ??)

These "little stat trackers" such as PT or StatKing only inform you how you have been doing in the past, overall. To give an elementary example: If you have been playing in a wide variety of medium limit hold'em games for a significant amount of rounds, but nothing of the extreme kind, i.e. no games with mostly excellent players nor games with mostly bad players, and your little stat tracker tells you that you have been involved in something like 50% of the pots - then, brother, the next time you are faced with A8o that lit'l stat means nothing for sure, but when that game is over and you head home, you better sit down and do a serious re-evaluation of your whole game, because more probably than not you have a leak. Of the loose kind. You probable need to tighten the screws, some.

(Notice how cleverly I slipped the words "screw" and "loose" in our dialogue. [img]/images/graemlins/smile.gif[/img])

[ QUOTE ]
What players do is use intuition and starting hand charts and what not to guide them through the game. But, these are very broad strokes. Math cannot solve this. If someone disagrees please tell me how.

[/ QUOTE ] When I wrote above that the 50% participation in flops is probably excessive, that is not based on intuition or any "broad stroke". Under the conditions I formulated for your record (many games, good games, nothing excessive, limits) you most probably have negative EV by seeing half the flops. And this is not intuitive.

Now, I have no idea how to put together a poker bot but in the scenario you gave (A8o on the button, folded to CO who raises), there are very specific parameters that can be entered and be helpful in the assessment of the situation, i.e. searching for the what-to-do. Such as, the perception of other players abt your playing style (which, please note, takes into account your stats in that game, tracked via a ...little stat tracker); the other players' style (ditto), if possible over a longer timeframe than just that particular game; the mathematical expectation of an A8o aganist random hands to the river (derived from sims); the size of the pot already; etc etc.

But I can't help thinking that we started this whole thing on a big misunderstanding.

--Cyrus

Utah 06-12-2006 08:41 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
I dont think there is a misunderstanding......

[ QUOTE ]
I think we are fundamentally confused here.

There are two things: One is your conditional expectation, meaning what to do in the specific situation in front of you. In other words, you are seeking to maximize the chance P of your winning in A when givent the conditions B, aka Pw(A|B). The other thing is the historical overview of your performance.

The two are not the same thing - and I would categorically agree that the second kind of analysis would help you little in the first endeavor.

[/ QUOTE ]

All you EVER care about as a player is Pw(A/B). It leads to specific decisions. So, you are exactly making my point - historical overview cannot help you [img]/images/graemlins/smile.gif[/img] So, why ever do it?

[ QUOTE ]
there are very specific parameters that can be entered and be helpful in the assessment of the situation

[/ QUOTE ]Please give an example. Those factors are wickedly hard to figure out in the online world. And, even if you could figure them out, there is no formula you can plug them into mathematically to derive the solution, expect for maybe a 2 or 3 player game on the river.

Utah 06-12-2006 08:46 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
Math is very relevant to solving these sort of problems.

[/ QUOTE ]Yes. What I mean is that the whole problem can not be solved directly by math. Certainly, things like calculating pot odds, implied odds, % chance of being called, etc. are very important.

Utah 06-12-2006 09:09 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
On that we can agree. The decision cited by Utah still comes down to a decision on what is the action that leads to the best possible gain (or at least it should). However, clearly your personal win rate, has nothing to do with the decision.

[/ QUOTE ]Exactly my point. If it doesnt help you then it is just noise. As a player I only care about maximizing each Pw(A/B). Thus, I never ever need win/loss stats.

[ QUOTE ]
Similarly, if his system is really better than what he was using in the past then this better be based on some actual hard data rather than just his opinion, if he wants to convince others that he is right.

[/ QUOTE ]I already convinced others I was right and raised a lot of investor funds awhile back to build it [img]/images/graemlins/smile.gif[/img]

The original discussion on the other thread wasnt meant as a, "I have invented something better" discussion. I also didnt say data couldnt be used. Rather, I said it couldnt be solved mathematically. The info is fuzzy so we use lots and lots of neural nets instead. Now, that is nothing totally new in itself. However, we use them in a unique way and we dont suffer from some of the limitations that other net approaches suffer from.

kazana 06-12-2006 11:44 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
historical overview cannot help you [img]/images/graemlins/smile.gif[/img] So, why ever do it?

[/ QUOTE ]
I don't know about the other players here, but I've never made any maths-based decision that rely on my historical data as input.

Nevertheless, my historical data helps me a lot to find faulty patterns in my play. So, if I realize that cold-calling with 72o didn't serve me well, it may well have an impact on my decisions at the table.
I wouldn't claim that this decision is based on maths, though.

I don't quite get your point. It's as if you're comparing apples to... well... high heels or something like that.

Andrew Prock 06-12-2006 12:38 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
I'm a bit confused by your terminology here. If neural nets aren't math, then what are they?

DrakeDerek 06-12-2006 01:41 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
I agree that historical data is very useful. Kinda like video taping your golf swing..... doesn't help you during the swing, but afterwards you may see something or get advice about something wrong. Without understanding the past, we are doomed to repeat it.

Utah 06-12-2006 07:24 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
I'm a bit confused by your terminology here. If neural nets aren't math, then what are they?

[/ QUOTE ]I would say that they are AI.

Utah 06-12-2006 07:25 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
We tried profiles to start but they were a disaster. You cant really profile someone well and they dont always play the same. If I recall, we tried doing some cluster analysis or something but we gave up.

Andrew Prock 06-12-2006 09:06 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
What makes you think that AI isn't math?

- Andrew

Utah 06-12-2006 09:19 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
It is a silly question of semantics. Please feel free to think of it as math if you prefer [img]/images/graemlins/smile.gif[/img]

Siegmund 06-12-2006 09:36 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
It's been almost exactly a year now since I saw a post from Utah, when he was first starting this project of his. I have been curious, off and on since then, whether it ever got off the ground or not. Nice to hear it's still going and has produced, well, something, even if we can't see just what.

I am, of course, a bit disturbed by the "math will not get you there" phrasing. I would word it more like this: given your knowledge about the cards and your opponents, there is a straightforward mathematical solution - calculate EVs, pick the best one. The problem is that the kind of knowledge we gain by watching an opponent (especially one who doesn't go to showdown) is difficult to represent in the kind of equation you saw in high school.

I am burning with curiosity about how you train a neural net without feeding it historical information, though. Updating the weights on nodes is not fundamentally different from updating any other statistic based on observations as they come in...

LuckyTxGuy 06-13-2006 01:45 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
First off let me say that this thread leaves me pretty confused! [img]/images/graemlins/crazy.gif[/img] Utah, I understand that you are developing a new product (software?) that cannot be exposed yet. However, can you give us any idea of if and when this new product might be released for sale or viewing to the public?

Utah 06-13-2006 09:30 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
First off let me say that this thread leaves me pretty confused! Utah, I understand that you are developing a new product (software?) that cannot be exposed yet. However, can you give us any idea of if and when this new product might be released for sale or viewing to the public?

[/ QUOTE ]Do know yet. The product is finished for the most part and it can be fully used in gameplay now. I am meeting with the development and investors in about 2 weeks to determine next steps.

Utah 06-13-2006 09:37 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
I am burning with curiosity about how you train a neural net without feeding it historical information, though.

[/ QUOTE ]You cant. One of the biggest problems with nets is that you often need lots of data. What makes you think that we dont train it with historical data? What if we have all the data or can get all the data from every hand played online at any site. What if we could train the nets in realtime and what if we could run those nets in realtime firing at the rate of 65,000 nets in 1/500 of a second. That would make the software slightly more powerful than pokertracker [img]/images/graemlins/smile.gif[/img]

toms2866 06-13-2006 11:10 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
The AI approach is extremely interesting. How would you compare your approach to Poki? Specialized math-based bots like Vexbot have proven to be extremely good hu - are you focusing on fr, sh, sng, multi-table tourneys? Limit, pl or nl?

gutte169 06-13-2006 11:41 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
This sounds like silly sematic stuff. Neural nets, AI, genetic programming, etc...they are usually referred to as a branch of computer science or mathematics. What they really are is just game theory and logic. You have information, you weigh your alternatives, and you select the best decision. Your brain does this while you play, and it can definetly be done by a computer program. It should be clear that software is able to win, and will become even more so in the coming years. Maybe I'm missing what is 'new' here.

Utah 06-13-2006 01:23 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
I remember being very scared by Poki when we were first raising funds as there was no reason to build something if it has already been built. Since we were backed by very serious money we even thought of trying to buy them, partner with them, or license from them.

However, after further analysis it became apparent that Poki suffers from 2 huge design flaws/limitations (cant say what they are). I was sure we could build something better so we simply decided to ignore them and move on. I am sure Poki is very good. However, I am sure that if you put Poki vs us against unsuspecting players we would seriously outperform them.

I know nothing of vexbot. Also, we are not a bot. We went down that path at one point and we have the schematics to build it. However, we wanted to create something commerically available and we didnt want to cross ethical lines.

The problem is that what we have now is way to powerful for public sale. So, we are a bit stuck at the moment. We might dumb it down significantly as to make it acceptable to the poker community - but of course that isnt very fun to do [img]/images/graemlins/smile.gif[/img]

LuckyTxGuy 06-13-2006 01:32 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
Thanks for the info. I guess there is one thing that sort of leaves me puzzled...ok it all leaves me puzzled.lol But if this application is as phenomenal as it sounds, what happens if a full table of players are using it at the same time? There is only one winner in every hand. If everyone at a table was using it, would it then negate it's usefullness? (If that makes sense)

Utah 06-13-2006 01:33 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
This sounds like silly sematic stuff. Neural nets, AI, genetic programming, etc...they are usually referred to as a branch of computer science or mathematics. What they really are is just game theory and logic. You have information, you weigh your alternatives, and you select the best decision. Your brain does this while you play, and it can definetly be done by a computer program. It should be clear that software is able to win, and will become even more so in the coming years. Maybe I'm missing what is 'new' here.

[/ QUOTE ]The original question was around objective measurements of performance. I essentially argued that they were worthless because they cant be measured effectively and even if they could they dont help you make decisions. Someone brought up pokertracker as a tool that helps you with objective measurements to help your game. I argued that it doesnt and that I built something else percisely for that reason. Then the conversation kind of imploded [img]/images/graemlins/smile.gif[/img]

Andrew Prock 06-13-2006 07:35 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
It is a silly question of semantics. Please feel free to think of it as math if you prefer [img]/images/graemlins/smile.gif[/img]

[/ QUOTE ]

I guess that makes this thread rather silly then. Just because you don't want to admit that artificial intelligence is applied mathematics, that doesn't make it so.

Have fun with your software. Does it violate the T&C of any major cardrooms?

- Andrew

toms2866 06-13-2006 08:06 PM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
I know nothing of vexbot

[/ QUOTE ]
Vexbot and Sparbot are packaged with Poki in Poker Academy.

Siegmund 06-14-2006 03:11 AM

Re: \"What decision do I make now?\" : Math will not get you there
 
[ QUOTE ]
[ QUOTE ]
I am burning with curiosity about how you train a neural net without feeding it historical information, though.

[/ QUOTE ]You cant. One of the biggest problems with nets is that you often need lots of data. What makes you think that we dont train it with historical data?

[/ QUOTE ]

I was quite sure you did. I was being a smartass - in reference to the comment that "you don't care about historical win/loss" when, in a sense, that is the ONLY thing a neural net cares about, since the network learns by strengthening the connections that lead to winning predictions and weakening the ones that lead to losing ones. (If you watched many tables, extending the idea of "winning" to be correctly guessing what should have been done at tables you only observed.)

Anyway, will be interested to see what comes of it, as well as interested in the more general question of whether a neural network method will outperform other methods attacking poker problems.

Cyrus 06-15-2006 09:29 AM

All For Nothing - And Nothing For All
 
Utah: [ QUOTE ]
One of the biggest problems with nets is that you often need lots of data. What makes you think that we dont train it with historical data?

[/ QUOTE ]
Andrew Prock :[ QUOTE ]
I guess that makes this thread rather silly then.

[/ QUOTE ]

emilyisqueen 06-15-2006 12:07 PM

Re: All For Nothing - And Nothing For All
 
The Poker Rock says:

If you have A8o on the button, you fold to that raise.

Then when he raises later and you have AA on the button, you can layeth the smacketh down on him.

The Poker Rock agrees with Utah's roody poo theory about historical data being meaningless. The Millions (and Millions) of The Poker Rock's fans know you have to make your decisions in the now, regardless of past play.

Utah 06-15-2006 06:13 PM

Re: All For Nothing - And Nothing For All
 
[ QUOTE ]


utah:

Quote:
One of the biggest problems with nets is that you often need lots of data. What makes you think that we dont train it with historical data?


Andrew Prock :

Quote:
I guess that makes this thread rather silly then.

[/ QUOTE ]

I dont get your post at all????? Are you suggesting that my statements contradict each other? If so, you are wrong
[img]/images/graemlins/wink.gif[/img]

Cyrus 06-16-2006 11:12 AM

Teapot storm all-clear
 
[ QUOTE ]
I dont get your post at all????? Are you suggesting that my statements contradict each other?

[/ QUOTE ]Dear Utah,

I had high hopes for this thread. I was expecting some non-math, revelatory method of getting the answer to the poker player's question What I Do Now, as you put it. Instead, I understand that it's all a matter of confusing the nomenclature!

You claimed that the math or our past history won't help us there but your method involves, among other things, how the other players perceive us (=past history) and neural networking (=math).

Still, it's been educational, honestly.

Take care.

--Cyrus

Utah 06-16-2006 06:12 PM

Re: Teapot storm all-clear
 
[ QUOTE ]
You claimed that the math or our past history won't help us there but your method involves, among other things, how the other players perceive us (=past history) and neural networking (=math).

[/ QUOTE ]

I think this is a tricky conversation and we are still not on the same page. The conversation is really suited for a round table discussion and not an internet forum. Let me see if I can summarize and clarify. A problem can be one of 2 things:

1) a problem with a knowable solution. e.g., 2 player game with one round and known factors.
2) a problem without a knowable solution. e.g., which 3^169 UTG preflop strategies do I choose?

For type 1, I dont need to historically measure my game as the problem can be solved directly. I only need to know the game and the factors. For example, if I need to solve 1567+1656 I can do so directly. No objective measures of my past work in math are neccessary. I dont need to know about the times I calculated correctly or incorrectly. I simply solve the problem in the here and now.

For type 2, there are no answers. Thus, there can be no true objective measurements because what can you measure against. All the hands ever played in the history of poker cannot solve the simple problem I laid out above. So, I cannot ever definitively say, it was correct to raise 10,10 in a particular hand. So, we solve with broad based rules and fuzzy logic. But, again, we are solving in the here and now and not with objective measurements.

To the question of neural nets. Well, the math question is a bit silly and completely unimportant. However, please realize that we are not solving the problem with the neural nets. Rather, we are simply providing information. There is simply no math+technology that exists today that can solve the simple UTG problem that I showed above. That is what I meant by math not being able to get you there.

Today, I presented the latest version of the software to a partner and one of our investors/advisors. We spent 2 hours passionately discussing the issues above.

It is not a question on nomenclature. It is a question of approach. btw - both the partner and investor were blown away by what they saw. They were in awe.

Here is the first slide of the presentation. It is simple but effective for discussing the problem. Nothing else matters.

The player before you just bet $100. There is $650 in the pot and one player to act behind you.

Do you: Check / Raise / Fold?

If you call you may be throwing away $100. If you fail to raise you could be throwing away $100. Fold and you may be throwing away $650

Andrew Prock 06-17-2006 06:08 PM

Re: Teapot storm all-clear
 
[ QUOTE ]
There is simply no math+technology that exists today that can solve the simple UTG problem that I showed above. That is what I meant by math not being able to get you there.

[/ QUOTE ]

This all depends on exactly what you mean by "solve". On a practical level, you can use applied mathematics to solve the problem. The quality of the solution with depend on the model that you use, the validity of your assumptions, and the method of solution.

Will it be univerally applicable? No. No mathematical solution ever is. In fact, when you compare any mathematical solution to real world problems you'll find out that the solutions only ever serve as an approximation to the true answer.

The real world is messy like that.

But applied mathematics is perfect for generating approximate solutions to these sorts of problems, and those solutions tend to be very useful.

- Andrew

Utah 06-17-2006 10:43 PM

Re: Teapot storm all-clear
 
Hi Andrew,

I agree with almost everything you said and you said much better part of what I was trying to say. The real world is very messy.

The only comment I would add is that I think there are poker problems that are next to impossible to solve with any real accuracy even with applied mathematics and approximation techniques.

toms2866 06-18-2006 12:10 AM

Re: Teapot storm all-clear
 
I'm curious to what degree your software's method incorporates traditional poker math alongside the AI approach. It seems that certain poker math could be used to bound potential AI decisions or to provide inputs to the AI model. For example, the "conditions" being fed to the AI model might include immediate pot odds, all-in equities, maximum implied odds, etc. An example of bounding AI decisions might include targeting bluffing frequency so that the prob of bluffing is equal to the pot odds offered to opponents.

cliff 06-18-2006 01:26 AM

Re: Teapot storm all-clear
 
FWIW,

I have been around a lot of investor backed startup companies in my career, and every one has a pitch from its CEO that sounds just like this. Differentiate yourself strongly from all competitors, stay vague on your approach with a few colorful talking points, etc. I guess the positive side is that a very few of them actually deliver at the end of the day so we will see.

Utah 06-18-2006 02:10 AM

Re: Teapot storm all-clear
 
You are exactly right on the approach. However, you crash any current math program on the market. The best you can do is a 1000x1000 sparse matrix. That isnt very big.

Utah 06-18-2006 02:25 AM

Re: Teapot storm all-clear
 
[ QUOTE ]
FWIW,

I have been around a lot of investor backed startup companies in my career, and every one has a pitch from its CEO that sounds just like this. Differentiate yourself strongly from all competitors, stay vague on your approach with a few colorful talking points, etc. I guess the positive side is that a very few of them actually deliver at the end of the day so we will see.

[/ QUOTE ]The product is essentially done and there is not more work left on the poker aspects. However, we are not home free and we could fall down on the other things that are needed to take this to market (if we take it to market as opposed to using for private team play. note:no collusion). We have focused on poker so much that we didnt think of the other things. One of our advisors asked us a lot of questions we did not have answers to.


All times are GMT -4. The time now is 03:50 PM.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.