These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

Out of Pod Experience

 
  • Topic is locked indefinitely.
 

(As Promised) Why Statistics Are Pseudoscience

Author
Jeyson Vicious
The Scope
Gallente Federation
#61 - 2012-08-06 02:35:14 UTC
1 - According to quantum theory probability exists for sure.

2 - In a coin flip randomness is not the same as the numerous values you can't account for when a person does it.

3 - you must have never been in a casino. I have seen roulette wheels land an amazingly long streak of red or black wins. They post the results for the reason you mention. I have personally lost a chunk of change before because I thought surely it won't be red an 10th time...
Whang'Lo
Cosmically Irrelevant
#62 - 2012-08-06 06:19:08 UTC
Quote:
The so-called "law of averages" is a misconception, a logical fallacy, closely related to the gambler's fallacy.



This is actually pretty easy to prove, with a simple computer program. This was one of the very first things I ever
programmed ages ago.

So you write a program that randomly generates the numbers 1-10. Then you just add a simple counter for every time
it hits one of the numbers.

If you let it run for a few minutes, you will see that after awhile the counts for each number hit will average out. So it
pretty much hits all the numbers equally over time. There are spikes here and there but they don't last long.

This is my understanding of the law of averages.



Also don't forget LUCK. Pretty well documented.




[u]A Paranoid is just someone with all the facts - William Burroughs[/u]

Eternum Praetorian
Doomheim
#63 - 2012-08-06 11:36:22 UTC
Xenuria wrote:

So thats it then? You are just going to ignore the fact that you are wrong and your argument is built on fallacy?

The only way a coin toss could be 50/50 is if it was in a vacuum, 2 dimensional and without any markings on either side to unbalance it. So even if you amended your original post to account for this lapse in reasoning you would still only be talking about hypothetical coins and not actual coins. What you think you are referencing is a "fair coin" but once again a "fair coin" is not something that can exist in reality.

Seriously, Get on my level bro. I know **** squat about math but I still know enough to realize that your a terrible troll at his best.




They are talking about hypothetical coins. Ugh

Bro...

[center]The EVE Gateway Blog[/center] [center]One Of EVE Online's Ultimate Resources[/center]

Xenuria
#64 - 2012-08-06 15:17:55 UTC
Eternum Praetorian wrote:
Xenuria wrote:

So thats it then? You are just going to ignore the fact that you are wrong and your argument is built on fallacy?

The only way a coin toss could be 50/50 is if it was in a vacuum, 2 dimensional and without any markings on either side to unbalance it. So even if you amended your original post to account for this lapse in reasoning you would still only be talking about hypothetical coins and not actual coins. What you think you are referencing is a "fair coin" but once again a "fair coin" is not something that can exist in reality.

Seriously, Get on my level bro. I know **** squat about math but I still know enough to realize that your a terrible troll at his best.




They are talking about hypothetical coins. Ugh

Bro...


So you admit that none of what you have said can actually apply to the real world? Ok then by all means carry on.
dexington
Caldari Provisions
Caldari State
#65 - 2012-08-06 15:24:29 UTC
Eternum Praetorian wrote:
I am sitting here with nothing to do but ponder this question. I took a coin and I flipped it 70 times. I got a streak of 7 heads in a row after only 70 flips and I got a streak of 5 tails in a row after only 43 flips. Here is the interesting part (and the question I would like to ask)


The odds of getting 7 heads in a row is 1:128 (so I got it in half the time then the math says that I should)
The odds of getting 5 tails in a row is 1:32 ( so it took 2.6 times as long as the math says I should)

So are both statements not false in this experiment?


Only a fool would base a statistical experiment on a set of data this limited. Had you flipped the coin only once, and gotten heads, you could say that the coin has a proven 100% chance of flipping heads. You assume that events happens in a pattern that guarantee you get 4 flips of 5 tails in the time it takes to flip 7 heads, the only thing that is safe to assume is that you are 4 times more likely to flip 5 tails them 7 heads.

This so reminds me of playing wow, where people a dumb enough to believe that if creature has 5% chance of dropping the item you need, you have 100% chance of getting the item after killing it 20 times.

I'm a relatively respectable citizen. Multiple felon perhaps, but certainly not dangerous.

Xenuria
#66 - 2012-08-06 15:25:47 UTC
dexington wrote:
Eternum Praetorian wrote:
I am sitting here with nothing to do but ponder this question. I took a coin and I flipped it 70 times. I got a streak of 7 heads in a row after only 70 flips and I got a streak of 5 tails in a row after only 43 flips. Here is the interesting part (and the question I would like to ask)


The odds of getting 7 heads in a row is 1:128 (so I got it in half the time then the math says that I should)
The odds of getting 5 tails in a row is 1:32 ( so it took 2.6 times as long as the math says I should)

So are both statements not false in this experiment?


Only a fool would base a statistical experiment on a set of data this limited. Had you flipped the coin only once, and gotten heads, you could say that the coin has a proven 100% chance of flipping heads. You assume that events happens in a pattern that guarantee you get 4 flips of 5 tails in the time it takes to flip 7 heads, the only thing that is safe to assume is that you are 4 times more likely to flip 5 tails them 7 heads.

This so reminds me of playing wow, where people a dumb enough to believe that if creature has 5% chance of dropping the item you need, you have 100% chance of getting the item after killing it 20 times.


I am 90% certain at this point that the OP is trolling.
FloppieTheBanjoClown
Arcana Imperii Ltd.
#67 - 2012-08-06 16:09:23 UTC
The OP claims that the odds of a coin toss are determined by previous coin tosses.

This is easily refuted. By his logic, flipping four coins in sequences has a one in 16 chance of landing all heads. Therefore when you've flipped three heads in a row, only one time in sixteen will that fourth flip yield heads. The other fifteen will result in tails.

As the odds of getting three heads in a row is one in eight, if I did 128 (8*16) coin tosses, I should get only one sequence of four heads. To the random bit generator!

The follow is 64 bytes. That's 128 sets of 4. I will assume each set of 4 is independent of the others in order to keep this simple. I have bolded all the sequences of "1111".

Quote:

00100010 00001110 00101010 10101010 01111010 01010110 00011001 00010001
00001011 11110111 11011111 11000110 10111011 00110110 10010111 10111010
10001100 10001010 00111010 00010101 10001110 01000011 01100100 01000101
11100010 11110110 11011111 11001101 01111010 01101101 01101110 11010110
00011100 01001110 01110001 00111010 11010010 01100111 00100101 00011011
01111101 00101111 11011111 01011001 00010100 01010101 01010010 01100110
01000001 00100101 10100010 00110110 00100010 00011001 01100010 01111100
01001001 11100100 01100000 01111000 11100011 10111101 10010111 00010000


Now the claims of the OP indicate he expects that for every "1111" there should be fifteen "1110". The reality of the sample above shows that they are actually evenly distributed.

Another interesting point: There were two separate runs of seven.

Founding member of the Belligerent Undesirables movement.

FloppieTheBanjoClown
Arcana Imperii Ltd.
#68 - 2012-08-06 16:18:48 UTC  |  Edited by: FloppieTheBanjoClown
Picking out a post to best demonstrate the flaw in logic.

Eternum Praetorian wrote:
At the end of the experiment, although each coin had a fixed 50:50 chance of falling either heads or tales, relativistic ally the odds were against his desired outcome by a factor of 4095:4096. The more flips the observer does the more unlikely his desired outcome becomes from a relative perspective,

The static probability does not change.


As in my previous post, let's condense this into something more testable.

The odds of me flipping two coins and getting heads on both is 1:4. For the sake of clarity, here are all possible outcomes:

00
01
10
11

What you're saying is that if I'm hoping to land heads twice, once the first coin lands on heads, I have a 75% chance that the second coin will land on tails?

Try it. Try it a hundred times. That's only two hundred coin tosses. Your whole argument falls on its face in the SIMPLEST of tests.

You've done a great job trolling. I fell for it for a while, then played along because I haven't had a good argument in forever. Now you're just stuck in a loop, saying the same thing over and over again.

Founding member of the Belligerent Undesirables movement.

Xenuria
#69 - 2012-08-06 17:32:48 UTC
9/10

You got plenty of people to bite.
Eternum Praetorian
Doomheim
#70 - 2012-08-06 21:01:12 UTC  |  Edited by: Eternum Praetorian
FloppieTheBanjoClown wrote:
The OP claims that the odds of a coin toss are determined by previous coin tosses..


No but I see how you could come to that conclusion. I should have just talked about regression to the mean and left it at that.

[center]The EVE Gateway Blog[/center] [center]One Of EVE Online's Ultimate Resources[/center]

Eternum Praetorian
Doomheim
#71 - 2012-08-06 21:02:37 UTC
Xenuria wrote:
Eternum Praetorian wrote:
Xenuria wrote:

So thats it then? You are just going to ignore the fact that you are wrong and your argument is built on fallacy?

The only way a coin toss could be 50/50 is if it was in a vacuum, 2 dimensional and without any markings on either side to unbalance it. So even if you amended your original post to account for this lapse in reasoning you would still only be talking about hypothetical coins and not actual coins. What you think you are referencing is a "fair coin" but once again a "fair coin" is not something that can exist in reality.

Seriously, Get on my level bro. I know **** squat about math but I still know enough to realize that your a terrible troll at his best.




They are talking about hypothetical coins. Ugh

Bro...


So you admit that none of what you have said can actually apply to the real world? Ok then by all means carry on.



I didn't make it up. People who hold PHDs come up with this crap not me.

[center]The EVE Gateway Blog[/center] [center]One Of EVE Online's Ultimate Resources[/center]

FloppieTheBanjoClown
Arcana Imperii Ltd.
#72 - 2012-08-06 21:15:48 UTC
Eternum Praetorian wrote:
FloppieTheBanjoClown wrote:
The OP claims that the odds of a coin toss are determined by previous coin tosses..


No but I see how you could come to that conclusion.

Yeah. Because you said it.

Founding member of the Belligerent Undesirables movement.

Surfin's PlunderBunny
Sebiestor Tribe
Minmatar Republic
#73 - 2012-08-06 21:19:32 UTC
Eternum Praetorian wrote:
Xenuria wrote:
Eternum Praetorian wrote:
Xenuria wrote:

So thats it then? You are just going to ignore the fact that you are wrong and your argument is built on fallacy?

The only way a coin toss could be 50/50 is if it was in a vacuum, 2 dimensional and without any markings on either side to unbalance it. So even if you amended your original post to account for this lapse in reasoning you would still only be talking about hypothetical coins and not actual coins. What you think you are referencing is a "fair coin" but once again a "fair coin" is not something that can exist in reality.

Seriously, Get on my level bro. I know **** squat about math but I still know enough to realize that your a terrible troll at his best.




They are talking about hypothetical coins. Ugh

Bro...


So you admit that none of what you have said can actually apply to the real world? Ok then by all means carry on.



I didn't make it up. People who hold PHDs come up with this crap not me.


Ph.D* Blink

"Little ginger moron" ~David Hasselhoff 

Want to see what Surf is training or how little isk Surf has?  http://eveboard.com/pilot/Surfin%27s_PlunderBunny

Eternum Praetorian
Doomheim
#74 - 2012-08-06 21:23:01 UTC  |  Edited by: Eternum Praetorian
FloppieTheBanjoClown wrote:
Eternum Praetorian wrote:
FloppieTheBanjoClown wrote:
The OP claims that the odds of a coin toss are determined by previous coin tosses..


No but I see how you could come to that conclusion.

Yeah. Because you said it.



No you just failed to read it correctly. But that is ok. I mean if anything I failed to properly explain my case and I admit to impropper word usage with regards to my debate with Akita. But I defiantly did not say that the odds of any given coin toss is determined by the previous one.

[center]The EVE Gateway Blog[/center] [center]One Of EVE Online's Ultimate Resources[/center]

Eternum Praetorian
Doomheim
#75 - 2012-08-06 21:34:38 UTC
Surfin's PlunderBunny wrote:


Ph.D* Blink



I believe that PhD is also accepted. In forum speak who knows what is socially acceptable.

[center]The EVE Gateway Blog[/center] [center]One Of EVE Online's Ultimate Resources[/center]

Eternum Praetorian
Doomheim
#76 - 2012-08-06 21:36:17 UTC
P.S.


Since this thread is still going can someone explain to me the meaning of "regression to the mean"


And why you think that it has nothing to do with how a sequence of heads and tails will play out over the course of large strings? I think this is what I was referring to as consecutive probability but I just didn’t know it.

[center]The EVE Gateway Blog[/center] [center]One Of EVE Online's Ultimate Resources[/center]

Akita T
Caldari Navy Volunteer Task Force
#77 - 2012-08-06 22:15:18 UTC  |  Edited by: Akita T
Eternum Praetorian wrote:
Believe it or not... you may have convinced me. My word usage has been incorrect. Sad
What do you do in RL if you don't mind me asking?

Computer science and industrial automation engineer by training, switched a few jobs since I graduated from the university a decade ago, from IT&telecom liason for the Romanian national power company, technical writer and equipment coder for Mitsubishi, then electrical power station design (mostly the automation part) to most recently game designer (the economy part mostly) for a web-based MMO.


Eternum Praetorian wrote:
So here is a question
I am sitting here with nothing to do but ponder this question. I took a coin and I flipped it 70 times. I got a streak of 7 heads in a row after only 70 flips and I got a streak of 5 tails in a row after only 43 flips. Here is the interesting part (and the question I would like to ask)
The odds of getting 7 heads in a row is 1:128 (so I got it in half the time then the math says that I should)
The odds of getting 5 tails in a row is 1:32 ( so it took 2.6 times as long as the math says I should)
So are both statements not false in this experiment?

The odds of getting 7 heads in a row if you throw it 7 times is 1:128 (0.78125%).
But the odds of throwing at least 7 heads in a row if you throw it 8 times is actually 3:256 (1.171875%), because you have 3 out of 256 possible combinations where at lest successive 7 heads pop up (7h+1t, 1t+7h, 8h).
The odds of throwing at least 7 heads in a row if you throw a coin 9 times is actually 8:512 (1.5625%) because the combos that include 7h or more in a row are 7h+t+t, 7h+t+h, t+7h+t, h+t+7h, t+t+7h, 8h+t, t+8h, and 9h.
The more coins you throw, the number of combinations that include 7 heads in a row divided by the number of total possible combinations of that many throws grows too.

There's nothing there telling you making an insanely improbable throw series is actually impossible, even with a small number of total throws, it only tells you how likely or unlikely it is to get it.
The math only tells you how many throws you need to make to have a good chance of actually getting that many throws in a row.
That chance is not very easy to calculate EXACTLY, however it is much easier to APPROXIMATE.

For instance, take the example of 7 heads across 70 throws.
If we wanted to compute the ACTUAL chance to get 7 heads in a row in 70 throws, we'd have to count all the possible combinations which include at least 7 heads in a 70-throw series and divide that by the total possible combinations (2^70=1,180,591,620,717,411,303,424), but that's pretty damn painful to accurately calculate.
I'm pretty sure there are some decent methods for actually calculating that without actually counting everything, but I'm not really in the mood for exact calculations of that magnitude yet.

For the most conservative inaccurate estimate, we APPROXIMATE that with 10 separate sets of 7 throws (it is an approximation AGAINST the actual chances to throw 7 heads because we discard the possibilities of things like 4h at the end of one set followed by 3h at the start of the very next set, so in reality, the result we'll get is LOWER than the actual chance if we would have considered all the possibilities).
Each of that separate set has a 1:128 chance to get what you want. So there's a 127:128 chance to NOT get what you want. With 10 separate sets, that's a (127/128)^10~=92% chance to NOT get what you want, so a ~8% chance to GET what you want.
As previously mentioned, in reality, the chance to actually get those 7 heads in 70 throws is actually noticeably higher than 8%, because we only considered completely disjointed sets.
Using THIS type of approximation, we would conclude that we'd be having only a ~1.55% chance to get 7 heads in a row out of 14 throws, when we already know that we already get a ~1.56% chance of that happening from as little as 9 throws.

Another inaccurate (and usually more generous than the reality) approximation would be to consider 64 possible sets of 7 heads (starting from position 1-7 to positions 64-70) each with 1:128 chance of happening, leading to a ~60.5% chance to NOT get what you want, and a ~39.5% chance to get at least 7 heads in a row out of just 70 throws. This is obviously incorrect (since we take into account overlapping sets), but it will be used to gather an upper cap for our estimates.
Using THIS type of approximation would lead us to believe that out of 9 throws (3 sets) we would get as much as a ~2.3% chance of 7 heads in a row, when we know in reality it should only be ~1.56%.

So what we can quickly tell from those approximations ?
That that the chance to get 7 heads in a row out of only 70 throws is noticeably higher than 8% but somewhat lower than 39%.
In other words, not extremely likely, but quite plausible.


Quote:
The odds of getting the unique sequence of 70 that I randomly flipped is 1:1,180,591,621,000,000,000,000 which seems really weird to me since any set that I randomly flipped would have the exact same odds. Thus making the whole thing meaningless outside of academic exercises. Can someone make sense of this? Because I thought this was connecting in my mind but now not so much. Are you just making allowances for these kind of uncertainties because statistics is "close enough" enough of the time?

Yes, that EXACT sequence you flipped has infinitesimal odds of happening (out of all possible combinations of length 70), but it obviously DID happen, because you just got it Blink
By repeating 70 throws, your chance to get whatever sequence is also tiny, but again, it just happened.
Things that seem highly improbable "at second sight" happen every time, it's nothing unusual Lol
The point however is that getting the EXACT SAME sequence both times, now THAT is something that's nearly impossible.
Akita T
Caldari Navy Volunteer Task Force
#78 - 2012-08-06 22:19:55 UTC
Whang'Lo wrote:
Quote:
The so-called "law of averages" is a misconception, a logical fallacy, closely related to the gambler's fallacy.

This is actually pretty easy to prove, with a simple computer program. This was one of the very first things I ever
programmed ages ago.
So you write a program that randomly generates the numbers 1-10. Then you just add a simple counter for every time
it hits one of the numbers.
If you let it run for a few minutes, you will see that after awhile the counts for each number hit will average out. So it
pretty much hits all the numbers equally over time. There are spikes here and there but they don't last long.
This is my understanding of the law of averages.
Also don't forget LUCK. Pretty well documented.

The counts for each number will "average out" in the sense that the highest difference between the most common and the least common DIVIDED BY EITHER ONE OF THEM will be very small - and that's the "law of large numbers", which is accurate.

However, you can not guaranteed that at any time either of the ones that's slightly higher than the other will stay where it is while one of those that's smaller will get an extra hit - and the mistaken conception that it SHOULD USUALLY OR EVEN ALWAYS happen (when it obviously doesn't happen all that often at all) is "the law of averages", which is inaccurate.
Akita T
Caldari Navy Volunteer Task Force
#79 - 2012-08-06 22:31:35 UTC  |  Edited by: Akita T
Eternum Praetorian wrote:
can someone explain to me the meaning of "regression to the mean"


When you take a single sample, that sample can be ANYWHERE in the sample set.
Depending on the type of distribution of the variable being sampled (linear distribution, normal distribution a.k.a. bell curve, or any other type of distribution), that sample has certain chances of being closer to either of the extremes and other chances of being closer to the average.
In time, the more samples you take, the closer the average of the samples will get to the average of all the actual possible values that exist in that particular distribution.

Take for instance a linear distribution between 0 and 1.
Your first sample has an equal chance of being anywhere between 0 and 1, an equal chance for it to be 0.01457 or 0.97175 or even exactly 0.50000.

Now, if your FIRST sample was close to the extreme, like, say, under 0.1 or over 0.9 (total probability of being lower than 0.1 or over 0.9 being only 20%), your next sample has a much higher chance to be closer to the average (80% chance to get something between 0.1 and 0.9).

If your FIRST sample was somewhere closer to the average, like, say, between 0.4 and 0.6 (total probability to be between 0.4 and 0.6 being 20%), the chance of your next sample being farther away from the average is much higher (since the chance of getting something lower than 0.4 or higher than 0.6 is 80%).

It's only when you combine many independent samples that the average of your samples will tend to get closer and closer to 0.5
It won't always get closer to 0.5, but it USUALLY will.

...

Of course, this also applies to a small subset of samples out of a much larger series too.
And it has other applications too.

Like, say, for instance, you hold a lottery, where you have 100 pieces of paper with numbers 1 through 100 written on them.
Now, have 100 people pick the pieces of paper, one for each. Obviously, SOMEBODY will get the pieces marked 91 through 100, and the average value of all pulled lots is 50.5, while the average value for those guys is 95.5.
Now, put all the papers back, kick out all the people who got 90 or lower, and have those "lucky winners" of pieces between 91 and 100 draw one piece of paper each.
There's absolutely no guarantee these "lucky people" actually manage to get high numbers this time, and the expected average value pulled by them is still 50.5, not 95.5 like before. They might get lucky and get the same or a higher average, but it's much more likely they'll get an average much lower than their previous average, and closer to the actual possible average.
Now, pull back those unlucky people who got numbers between 1 and 10 in the first drawing (average of 5.5) and have them draw 10 lots out of all numbers. This time they will almost certainly be far more lucky than before.

There are plenty of other applications of this.
Eternum Praetorian
Doomheim
#80 - 2012-08-06 22:43:18 UTC  |  Edited by: Eternum Praetorian
Quote:
And why you think that it has nothing to do with how a sequence of heads and tails will play out over the course of large strings? I think this is what I was referring to as consecutive probability but I just didn’t know it.



As in... somehow effect how long of a string of heads, tails or any repeating sequence you will realistically achieve given pure randomness (without ever changing the static probability of each coin flip)


How does this idea not effect getting 100 heads in 100 flips--however many times in a row? It must have something to do with the fact that such things are never seen. No?

[center]The EVE Gateway Blog[/center] [center]One Of EVE Online's Ultimate Resources[/center]