These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
Previous page12
 

Do We Need More than Databases to Determine Balance?

First post
Author
bigman111222
Dead's Prostitutes
The Initiative.
#21 - 2015-03-10 08:25:15 UTC
Serene Repose wrote:
Statisticians use statistics much like a drunk uses a lamp post; more for propping themselves up than for illumination.



This is an amazing comment

It's often thought the most common lie is statistics.
Thebriwan
LUX Uls Xystus
#22 - 2015-03-10 08:37:36 UTC
Kuga wrote:
Has the excessive usage of databases been clouding the judgement of those responsible for making decisions to the point where issues are being overlooked or eschewed in favour of balancing spreadsheets?


Simple answer: No.

The problem is not the data or the statistics.
The problem lies in the question what the "community" feels. - This is something that can not be quantified.

For one thing it is NEVER "The Community (tm)". Because you will find always someone who disagrees.
Sometimes it is the majority. But mostly it's a loud and visible minority that wants this or that change, or not.

To conclude: I think the actual approach from the devs is the right one: Fact and numbers. Not feelings.
Scipio Artelius
Weaponised Vegemite
Flying Dangerous
#23 - 2015-03-10 08:54:42 UTC  |  Edited by: Scipio Artelius
Thebriwan wrote:
To conclude: I think the actual approach from the devs is the right one: Fact and numbers. Not feelings.

To a degree I agree with you. Objective data is the basis of good decision making for a great number of things.

However, this is a game that we as players invest in emotionally in many respects. So while the feeling of an individual should give way to data, the feeling of the community as a whole is important data also.

Opinion polls are an important thing for this very reason. The data produced helps quantify feelings and is extremely important in forming policy, in measuring success and identifying areas where better communication is needed.

At the end of the day, CCP can use whatever data they want, but individually we all use our emotions to decide how much we invest in something. It's silly to ignore that when implementing change (or choosing not to change).
Falin Whalen
Federal Navy Academy
Gallente Federation
#24 - 2015-03-10 13:33:05 UTC
There are three "lies," in the world: Lies, Damn lies, and Statistics.

"it's only because of their stupidity that they're able to be so sure of themselves." The Trial - Franz Kafka 

Vyl Vit
#25 - 2015-03-10 13:44:33 UTC
Take a lemming population, for instance. Just because simply everybody is doing something,
doesn't mean it's a good thing.

Paradise is like where you are right now, only much, much better.

Daerrol
Republic University
Minmatar Republic
#26 - 2015-03-10 13:45:27 UTC
Yes we do need data. Yes it must be the right data. The right data may be unnaccessible.

the wrong data can hurt more than no data, but I don't think CCP is using the flat out wrong data. (IE: Using Industrial Activity to balance Lasers)

I think it's worth mentioning in the new age that is comming, the one without 1000 man super cap fleets and multiple sov fights happening at once, combined with the slow but hopefully steady nerfs to T3 (Both Cruiser and Destroyer) the batlteship MAY seen a new role. We should wait for that to all come into effect, let it go a few months for metas to develop, then evaluate the position of the oft loved BS. I imagine a Napoc fleet sitting on a TCU will be be plenty hard for those pesky Tengus to deal with in contests. The 250km range on the Entosis however... that's another issue all together.
Kiandoshia
Pator Tech School
Minmatar Republic
#27 - 2015-03-10 13:52:54 UTC
Sibyyl wrote:

The only alternative to databases is checking for fate in chicken bones or consulting your totem animal. The right metrics need to be considered but not using metrics at all (like you seem to be suggesting) will lead to even more catastrophic game changes.

If you mean "experience", we need enough data to drown out the anecdote factor that is so popular in politics and law.



The OP isn't saying to ignore data but to look for more data that will tell you more than just numbers.
Plain and simple numbers really don't tell 'the whole story' a lot of times. There are tons of other factors that should be looked at when attempting to balance anything.

If all the want to to is look at numbers and go from there, CCP has to start giving us a meta rather than letting us figure one out every time.
Sibyyl
Garoun Investment Bank
Gallente Federation
#28 - 2015-03-10 14:45:03 UTC

Kiandoshia wrote:

The OP isn't saying to ignore data but to look for more data that will tell you more than just numbers.
Plain and simple numbers really don't tell 'the whole story' a lot of times. There are tons of other factors that should be looked at when attempting to balance anything.

If all the want to to is look at numbers and go from there, CCP has to start giving us a meta rather than letting us figure one out every time.


Ki, I don't think CCP should ever design to "overall community sentiment" that OP wants. The vocal minority always ends up skewing things too far.


Kuga wrote:
Overall community sentiment should play a substantial role in decision making and help guide developers to issues where their database information alone may be inadequate.


Joffy Aulx-Gao for CSM. Fix links and OGB. Ban stabs from plexes. Fulfill karmic justice.

2Sonas1Cup
#29 - 2015-03-10 15:02:21 UTC
If I was CCP I would balance the game VERY easy.

Heres what I would do:

Pick 10 people,

4 the most active in pvp and FC leaders in the major null allainces with capitals experience
(1 goons, 1 PL, 1 russian, 1 black legion)

2 of the same quality of people but from highsec
(1 rvb (mangala?), 1 code (james?))

1 person of the same quality from K space

1 person of the same quality from industry)


Invite them over for a week to iceland with everything paid, sit dow together with the balance devs get it done.

I guarantee you the mix and discussion and conclusion from these people on what to balance would be perfect.

BoBoZoBo
MGroup9
#30 - 2015-03-10 15:06:00 UTC  |  Edited by: BoBoZoBo
Yes. We also need good analysis to go along with it. The problem with too much data is that it becomes not only a crutch, but a cage. CCP needs to take a bit of a step back, they can't see the forrest through the trees; or even the damn tree through the leaves.

Primary Test Subject • SmackTalker Elite

Sibyyl
Garoun Investment Bank
Gallente Federation
#31 - 2015-03-10 15:06:07 UTC

Design by null committee. No thanks.

Joffy Aulx-Gao for CSM. Fix links and OGB. Ban stabs from plexes. Fulfill karmic justice.

Lykouleon
Noble Sentiments
Second Empire.
#32 - 2015-03-10 17:59:45 UTC
87% of statistical analysis are actually interpreted wrong by the people that take them.

63% of all studies that relied heavily on statistics were later to be found to be fatally flawed in some way.

73% of statistics are made up on the fly anyway.

Lykouleon > CYNO ME CLOSER so I can hit them with my sword

2Sonas1Cup
#33 - 2015-03-10 19:17:57 UTC
Lykouleon wrote:
87% of statistical analysis are actually interpreted wrong by the people that take them.

63% of all studies that relied heavily on statistics were later to be found to be fatally flawed in some way.

73% of statistics are made up on the fly anyway.


Which proves you are statistically 72.3337870% precisely wrong, and your statistics have a 67% chances of being 99% incorrect.
ISD Ezwal
ISD Community Communications Liaisons
ISD Alliance
#34 - 2015-03-10 23:33:59 UTC
Kiandoshia wrote:
Someone lock this quickly.
As I see no reason to comply to this request, I'm afraid I will have to say no to that.

ISD Ezwal Community Communication Liaisons (CCLs)

Slavealt
Sheep Can Hear A Zipper From A Mile Away
#35 - 2015-03-11 05:25:00 UTC
CCP has failed hard at this for as long as I can remember. They constantly pull some graph or number out, while excluding tons of other factors, and buff/nerf/do nothing based on this. It usually results in OP staying OP for ridiculous lengths of time, or garbage staying garbage for the same time. It is really annoying, especially in cases where it is very clear that the number they're using is flawed.
Glathull
Warlock Assassins
#36 - 2015-03-11 07:47:47 UTC
One of the things I consistently like about the data CCP chooses to show us is exactly how little it's been doctored up. We have some basically pretty raw numbers, some means here and there, and some rolling means.

These kinds of numbers are not the numbers people generally choose to display when they have an agenda. This is grade-school type stuff. There is nothing going on here that I would call even remotely obfuscatory.

If anything, I would like to see CCP doing more (or perhaps I should say showing more to us) of things that are perhaps a bit more advanced. I'd like to see a factor analysis around some of the variables mentioned in the OP to see if there are latent causes behind the raw data that could explain some of the variance, for example. I'd like to see some regressions to understand how much of the changes in the numbers can be explained by natural cyclic variability, and how much of the change is actually related to mechanics changes.

But in any case, there are a couple of things you have to take into account. When people are using statistics to hoodwink you, you have to consider
1) the level of certainty claimed by the alleged perpetrator, and
2) the obscurity of the mechanism used to arrive at the supporting data.

If someone comes to you and says they know for absolute certain that x and y are true (where x and y are totally contrary to intuition), and you can tell it's all true because of this new method of analysis that they just made up for this one purpose: guess what! You're getting lied to!!!

If, on the other hand, people use very straightforward methods to arrive at some conclusion that's relatively weak, well . . . there's little room for duplicity there.

CCP's use of numbers is closer to the latter case, in my opinion.

First off, I don't think it matters at all what statistical methods they are using when their claims are so weak.

All of anything that they ever say amounts to: "When we look at these numbers, we feel good about them. When we look at these other numbers, we don't feel so good about those." In seven years of EvE, I can't remember a dev blog that really made a stronger claim based on "the numbers."

So I have to wonder, if no one is claiming any particular truth, where is the lie that these alleged statistics are telling?

CCP has always struck me as a company with a philosophy-first approach to design that sometimes looks to the numbers to make sure they are not completely out there. It has never struck me as a data-driven company at all. And I don't mean that in a negative way at all. Facebook and Zynga are data-driven companies. They are companies that tweak every aspect of every interaction to maximize addictiveness based on behavioral psychological data. Blizzard is somewhere between what I see as two extremes with EvE and things like Dwarf Fortress on one end of the spectrum and Farmville and Candy Crush Saga on the other end.

Sibyyl has already made what was going to be my second point far more eloquently than I was going to, so I'll leave that alone.

OP sounded an awful lot to me like he was saying, "CCP, I want you to ignore the numbers I don't like and design the game around what I feel."

But I will make a third point. CCP does already do a certain amount of what the OP most charitably could have meant. CCP appears, from my point of view, to design the game around

a) a large, reasonably consistent philosophy,
b) a strong desire to troll, and
c) some numbers here and there to serve as big-picture guideposts.

If that's not what the OP is asking for in terms of "extra-database-ical-ishy" data, then I can't imagine what reasonable thing is. I just think the OP doesn't like the consequences of CCP's design philosophy or the way that CCP loves to troll and is using the weakest possible intellectual approach to criticize Fozzie and Rise because when you throw around hardcore words like database, you can't be wrong. Right?

I honestly feel like I just read fifty shades of dumb. --CCP Falcon

Rain6637
GoonWaffe
Goonswarm Federation
#37 - 2015-03-11 09:56:59 UTC  |  Edited by: Rain6637
The problem I think EVE devs have is using statistics to alter the game, and then using statistics to validate those changes. So basically, they're not balancing a game, they're balancing statistics.

You gain a sense of a thing when you use it in context (of the game). In contrast, statistics are disconnected from their context.

I think this is why devs are out of touch. Because lack of context. i.e. do they even play, etc.
Previous page12