Two Plus Two Newer Archives  

Go Back   Two Plus Two Newer Archives > General Gambling > Probability
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 09-04-2007, 04:31 AM
BIG NIGE BIG NIGE is offline
Senior Member
 
Join Date: May 2007
Location: -EV
Posts: 310
Default Using confidence intervals to determine winrate with low sample size?

Does anyone know what the formula is for determining the minimum expected winrate for a specific level of confidence (eg, 90% or 95%), given a sample size and actual winrate? I learned this in statistics class a few years ago but have since forgotten it. Do I need to know the standard deviation? For example, suppose I have a sample size of 8, and an actual winrate of 135.2% ROI. With 90% confidence, what is my minimum expected winrate? This is for one-table, 9-player $22 SNGs on Pokerstars, so if SD is necessary to know then just use a typical one. Thanks to anyone who can help.
Reply With Quote
  #2  
Old 09-04-2007, 05:11 AM
TotalScience TotalScience is offline
Senior Member
 
Join Date: Jul 2005
Posts: 130
Default Re: Using confidence intervals to determine winrate with low sample si

I'd say ballpark you have atleast 100% ROI.....though really, are you serious about 8 sample size or just using it for an example?
Reply With Quote
  #3  
Old 09-04-2007, 05:32 AM
BIG NIGE BIG NIGE is offline
Senior Member
 
Join Date: May 2007
Location: -EV
Posts: 310
Default Re: Using confidence intervals to determine winrate with low sample si

Serious. I have four wins, one 2nd, and three losses. And I'd like to find out what the formula is, so that I can calculate my minimum winrate with X% in the future.
Reply With Quote
  #4  
Old 09-04-2007, 07:16 AM
pzhon pzhon is offline
Senior Member
 
Join Date: Mar 2004
Posts: 4,515
Default Re: Using confidence intervals to determine winrate with low sample size?

The typical standard deviation is about 1.7 buy-ins, or 170%. After n SNGs, the standard error (standard deviation of your observed ROI) is about 170%/sqrt(n). A rough 95% confidence interval for large n is the observed result +- 2 * standard error.

When you use a small sample, a normal approximation may not be accurate, particularly at the tails of the distribution. For n=8, you should expect the normal approximation to be poor, although the SNG distribution is not very wild, so this only causes a small problem.

A larger issue is whether you were planning to test your results after exactly 8 tournaments, or not. It is much more likely for your true ROI to be 2 standard deviations below your observed ROI at some point than at the end of a prespecified interval. If you stopped because the results look flattering, this introduces a bias.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -4. The time now is 12:05 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.