These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
 

The Infrastructure of EVE Online

First post
Author
Xenuria
#21 - 2013-01-28 00:37:06 UTC
Pohbis wrote:
Xenuria wrote:
[quote=Ai Shun]If the infrastructure can now use more than one CPU and there is still a problem then what is the next bottleneck?
The bottleneck is that one system, or a group of systems, can only use one CPU.

They can not use multiple CPUs. So while you can spread different systems on multiple CPUs, the max one system can ever get, is one CPU.

Since CPUs have reached a wall in terms clockspeeds and are instead increasing the amount of cores, it is becoming increasingly difficult to actually upgrade the amount of CPU cycles a single system can have access to.


I may be mistaken but the dev blog I read indicated that more than one CPU can now be used. Meaning the CPU isn't the bottleneck because you could just group a bunch of them together to supplement a system.
Ai Shun
#22 - 2013-01-28 00:41:08 UTC  |  Edited by: Ai Shun
Xenuria wrote:
So let me get this straight, your argument is that I am a bad CSM candidate because I am trying to better understand eve? You also seem to be making the case that the infrastructure is good enough and should not be improved upon.


From my perspective?

I would expect a CSM candidate to be informed enough to answer these questions for themselves. To potentially even read the information presented to them, assimilate the information and comprehend that so that I could be comfortable in knowing they would represent me intelligently and with solid knowledge backing them up; that they would be able to research and find answers and help guide this game forwards.

Otherwise, what value does a member of the CSM add when somebody else does everything for them?

You have been given a fair bit of information to read and you've basically glossed over it because nobody provided you with a simple, three word summary.

The information already presented to you multiple times says quite plainly - the problem is not hardware; it is software and they are working on it. But it is a fair part of the core of a massive system and there is a large volume of work that needs to be both well designed and tested before just changing a line of code. And over time they make more and more improvements :)
Pohbis
Neo T.E.C.H.
#23 - 2013-01-28 00:43:47 UTC
Xenuria wrote:
If that is accurate than the infrastructure IS out of date and CAN/SHOULD be upgraded.
I think the max for current server solutions from IBM is 3.6Ghz, not counting the super-awesome-only-used-on-wallstreet kinda stuff.

The current ones on TQ are 3.3Ghz. I'd rather not have CCP upgrade the entire cluster for a mere 300Mhz increase.
Doctor Ungabungas
Doomheim
#24 - 2013-01-28 00:45:45 UTC
You aren't asking anything CCP don't already ask at every capacity planning meeting they have.
Rebecha Pucontis
Doomheim
#25 - 2013-01-28 00:46:22 UTC  |  Edited by: Rebecha Pucontis
I think CCP should focus on rebuilding the whole game from the ground up. Scrap all the existing code, just reuse the art assets, and then completely recode the game. If this game is to last another ten years then its the only way.
Pohbis
Neo T.E.C.H.
#26 - 2013-01-28 00:48:44 UTC
Xenuria wrote:
I may be mistaken but the dev blog I read indicated that more than one CPU can now be used. Meaning the CPU isn't the bottleneck because you could just group a bunch of them together to supplement a system.
Do you have a link?

They can off-load things like chat and characters to a different CPU. But Destiny, the physics engine, can only run on one CPU.
Xenuria
#27 - 2013-01-28 00:49:41 UTC
Ai Shun wrote:
Xenuria wrote:
So let me get this straight, your argument is that I am a bad CSM candidate because I am trying to better understand eve? You also seem to be making the case that the infrastructure is good enough and should not be improved upon.


From my perspective?

I would expect a CSM candidate to be informed enough to answer these questions for themselves. To potentially even read the information presented to them, assimilate the information and comprehend that so that I could be comfortable in knowing they would represent me intelligently and with solid knowledge backing them up; that they would be able to research and find answers and help guide this game forwards.

Otherwise, what value does a member of the CSM add when somebody else does everything for them?

You have been given a fair bit of information to read and you've basically glossed over it because nobody provided you with a simple, three word summary.

The information already presented to you multiple times says quite plainly - the problem is not hardware; it is software and they are working on it. But it is a fair part of the core of a massive system and there is a large volume of work that needs to be both well designed and tested before just changing a line of code. And over time they make more and more improvements :)


I realize you probably think you are making a valid point or presenting a meaningful argument but in reality all you are doing is discouraging learning. When you personally target and attack me for being a bad candidate for not knowing something and in the SAME POST criticize me for asking for help in understanding or learning said thing you come across as a huge hypocrite.
James Amril-Kesh
Viziam
Amarr Empire
#28 - 2013-01-28 00:51:11 UTC  |  Edited by: James Amril-Kesh
Xenuria wrote:
I realize you probably think you are making a valid point or presenting a meaningful argument but in reality all you are doing is discouraging learning. When you personally target and attack me for being a bad candidate for not knowing something and in the SAME POST criticize me for asking for help in understanding or learning said thing you come across as a huge hypocrite.

Uh no, he's criticizing you for being unable to gather and summarize information yourself and instead asking others to do the hard work for you. Rightly so.
And as much of a polymath savant hero as you seem to think you are I doubt you have anywhere near the level of expertise on server architecture that CCP has working for them, nor the level of understanding required to make that work with the game software (not the client, the software that the server is running).

I don't have that either, granted, but that's why you don't see me making sweeping statements about what CCP needs to do better or offering my brilliant ideas on how to tackle their toughest problems.

Enjoying the rain today? ;)

Ai Shun
#29 - 2013-01-28 00:53:46 UTC  |  Edited by: Ai Shun
Xenuria wrote:
I realize you probably think you are making a valid point or presenting a meaningful argument but in reality all you are doing is discouraging learning. When you personally target and attack me for being a bad candidate for not knowing something and in the SAME POST criticize me for asking for help in understanding or learning said thing you come across as a huge hypocrite.


There is a vast difference between:

"I have found X, y and Z. When comparing that against A, B and C I have come to the conclusion that F and G are likely and H is extremely unlikely. I want to go to CCP to find more information, but thought I'd ask here first before I present something that may be incorrect"

and

"System is messed up. Tell me what it is so I can tell you how to fix it. No, that's not right. No, that's not right either. No, that's not right either. No, you're not answering my question"

It is not a personal attack when I tell you what I prefer in a candidate and that you don't meet those requirements for me. I am sorry if you feel so, but this is EVE. I'll speak my mind and do so politely so learn the core tenet of the game. HTFU.
Xenuria
#30 - 2013-01-28 00:55:28 UTC  |  Edited by: Xenuria
James Amril-Kesh wrote:
Xenuria wrote:
I realize you probably think you are making a valid point or presenting a meaningful argument but in reality all you are doing is discouraging learning. When you personally target and attack me for being a bad candidate for not knowing something and in the SAME POST criticize me for asking for help in understanding or learning said thing you come across as a huge hypocrite.

Uh no, he's criticizing you for being unable to gather and summarize information yourself and instead asking others to do the hard work for you. Rightly so.



Seriously man you are not helping. You are feeding and encouraging this kind of behavior by agreeing with it or stating you support it. If you honestly consider linking something in a post as "Hard Work" then I don't think I have the ability to reason with you.

I really wish people saved their confrontational attitude for scenarios when it is appropriate. Rebuking me because I am making an effort to better understand something is counter intuitive and really against the code of conduct. If you dislike or disapprove of the fact I am asking for help in understand something arguably complex then keep it too yourself OR explain it better and show how smart you are.
Miss DSA
Doomheim
#31 - 2013-01-28 00:58:23 UTC
Rebecha Pucontis wrote:
I think CCP should focus on rebuilding the whole game from the ground up. Scrap all the existing code, just reuse the art assets, and then completely recode the game. If this game is to last another ten years then its the only way.
Worst idea ever.
Pohbis
Neo T.E.C.H.
#32 - 2013-01-28 01:00:53 UTC
Xenuria wrote:
Seriously man you are not helping. You are feeding and encouraging this kind of behavior by agreeing with it or stating you support it. If you honestly consider linking something in a post as "Hard Work" then I don't think I have the ability to reason with you.
I don't think he is talking about the act of linking the stuff.

More, the knowledge of EVE in order to know where to look for said info, actually going and digging it up and the ability to recognize the most likely relevant pieces.

You know, the whole :effort: part.
James Amril-Kesh
Viziam
Amarr Empire
#33 - 2013-01-28 01:01:45 UTC
Xenuria wrote:
James Amril-Kesh wrote:
Xenuria wrote:
I realize you probably think you are making a valid point or presenting a meaningful argument but in reality all you are doing is discouraging learning. When you personally target and attack me for being a bad candidate for not knowing something and in the SAME POST criticize me for asking for help in understanding or learning said thing you come across as a huge hypocrite.

Uh no, he's criticizing you for being unable to gather and summarize information yourself and instead asking others to do the hard work for you. Rightly so.



Seriously man you are not helping. You are feeding and encouraging this kind of behavior by agreeing with it or stating you support it. If you honestly consider linking something in a post as "Hard Work" then I don't think I have the ability to reason with you.

I really wish people saved their confrontational attitude for scenarios when it is appropriate. Rebuking me because I am making an effort to better understand something is counter intuitive and really against the code of conduct. If you dislike or disapprove of the fact I am asking for help in understand something arguably complex then keep it too yourself OR explain it better and show how smart you are.

I think you're missing the point. Asking other people to present you with information you can easily find yourself is not admirable behavior, especially from one who wants to be a player representative to CCP.

Enjoying the rain today? ;)

Nicolo da'Vicenza
Viziam
Amarr Empire
#34 - 2013-01-28 01:03:56 UTC  |  Edited by: Nicolo da'Vicenza
Xenuria wrote:
Nicolo da'Vicenza wrote:
eve's servers are bleeding edge supercomputers afaik


Yes and as great as a concept that is I still want to know specifics. I want to learn to the extent that I can make an informed statement about what I think should be done.

let me guess, you're going to google 'high performance hardware' and make a bunch of threads comparing stats involving 'hertz' and 'flops' and yelling about how CCP should buy Y instead of using X?
Gillia Winddancer
Aliastra
Gallente Federation
#35 - 2013-01-28 01:05:59 UTC
James Amril-Kesh wrote:
Xenuria wrote:
James Amril-Kesh wrote:
Xenuria wrote:
I realize you probably think you are making a valid point or presenting a meaningful argument but in reality all you are doing is discouraging learning. When you personally target and attack me for being a bad candidate for not knowing something and in the SAME POST criticize me for asking for help in understanding or learning said thing you come across as a huge hypocrite.

Uh no, he's criticizing you for being unable to gather and summarize information yourself and instead asking others to do the hard work for you. Rightly so.



Seriously man you are not helping. You are feeding and encouraging this kind of behavior by agreeing with it or stating you support it. If you honestly consider linking something in a post as "Hard Work" then I don't think I have the ability to reason with you.

I really wish people saved their confrontational attitude for scenarios when it is appropriate. Rebuking me because I am making an effort to better understand something is counter intuitive and really against the code of conduct. If you dislike or disapprove of the fact I am asking for help in understand something arguably complex then keep it too yourself OR explain it better and show how smart you are.

I think you're missing the point. Asking other people to present you with information you can easily find yourself is not admirable behavior, especially from one who wants to be a player representative to CCP.


Well, that would make me a really horrible representative should I by some sick twist of fate ever become one. I tend to have moments (too many) when I get extremely lazy and bored. And I guess that I am also really horrible at taking any kind of critique without heating up too much. And I may even have a bad habit at looking down on people should they meet certain criteria in my books.


So...care to vote for me plz? Twisted
Lors Dornick
Kallisti Industries
#36 - 2013-01-28 01:09:10 UTC  |  Edited by: Lors Dornick
Xenuria wrote:


I may be mistaken but the dev blog I read indicated that more than one CPU can now be used. Meaning the CPU isn't the bottleneck because you could just group a bunch of them together to supplement a system.


I'm afraid that you are mistaken.

Certain operations can be offloaded to other systems/cores, but the core of each node is still locked to one cpu.

Those nodes cannot be made smaller than one solar system (yet) and they cannot be shifted between servers without reloading the node (and kicking everyone off) (yet).

There are some magic that can be done to limit the problems, and there appear to some very clever people actively applying just such magic.

Achieving anything more than what Gridlock can give us will require quite a deep recode deep down in EvE's ancient code base.

All this has been discussed several times, with good input from the Devs in question.

Freely available for anyone with an interest in system architecture and performance.

CCP Greyscale: As to starbases, we agree it's pretty terrible, but we don't want to delay the entire release just for this one factor.

Xenuria
#37 - 2013-01-28 01:10:33 UTC
I don't think this thread is going to get very far with all the trolls and flames. It really is sad and depressing that when somebody asks a question or requests help in understanding something, you people dogpile on me and play up anything and everything I have done wrong in your eyes.

I mean really, come on now. Don't you have something better to do than :BadPost: and attack me? I think I should apologize too. I am so VERY sorry for causing you what I can only imagine is extreme discomfort and frustration over the mere concept of me trying to better my understanding of eve.

I asked some questions and so far NONE of the linked articles and Dev Posts answered any of them. If it were as simple as searching through dev posts or using google I would not have made a thread about it. You can throw your mindless hate at me all you want but the fact remains I am here trying to learn something and you are being nasty because of it.
Miss DSA
Doomheim
#38 - 2013-01-28 01:15:04 UTC
Xenuria wrote:
It really is sad and depressing that when somebody asks a question or requests help in understanding something, you people dogpile on me and play up anything and everything I have done wrong in your eyes.
When did providing exactly the information you're asking for and telling you how to find more become "dogpiling"?! Ugh
Xenuria
#39 - 2013-01-28 01:18:17 UTC
Miss DSA wrote:
Xenuria wrote:
It really is sad and depressing that when somebody asks a question or requests help in understanding something, you people dogpile on me and play up anything and everything I have done wrong in your eyes.
When did providing exactly the information you're asking for and telling you how to find more become "dogpiling"?! Ugh


I am specifically talking about the people who are attacking me because I made this thread, not the people trying to provide information.
mechtech
Ice Liberation Army
#40 - 2013-01-28 01:21:18 UTC  |  Edited by: mechtech
The Database is on a RAMSAN, which is a storage device made up entirely of RAM. It's thousands of times faster than enterprise hard drives, and much faster than SSDs.

The spaceship simulation is single threaded, due to the fact that the core of the game was coded back before dual cores existed. Some functions like market processing are offloaded to separate clusters, but the actual processing of pew-pew is done on a single core. That's just the nature of the architecture, and there is a very slim chance of this ever changing. MMOs just don't scale well to multiple cores because every entity on screen is accessing the same dataset and needs to be synced.

They have in house thin clients that can simulate 1000 player fleet battles at will, and they have reporting tools that break down the latency of each stage of each server tick with fine granularity.

The server hardware, as far as I know, is getting a bit old. CPUs used are 3.3GhZ wolfdales. It's about time for a CPU upgrade, but unfortunately new CPUs are not increasing single threaded performance much at all, so it's not as urgent as it may seem. It's likely just not the right time for CCP to move to new hardware yet, both because of financial reasons (DUST will kill CCP financials if it tanks, but will give them breathing room if it takes off) and because the hardware landscape might not quite be where they want it to be yet. At the moment, each new generation of Intel CPU gives about a 10-15% boost to single threaded performance, clock for clock. That's just not a lot. AMD has dropped completely off the radar when it comes to single threaded performance.

CCP does experiment with new hardware. TQ-SOL-099 or "Frankenserver" is used to host the biggest fleet battles and Jita. It's an Intel Xeon X5698 (hex core with 4 cores disabled, running at 4.4GhZ and meant for high frequency trading) with 2100mhz DDR3 and 2x offloaded NICs. This is a test system that is not suitable for a rollout into a datacenter. When this level of performance is available in mainline server chips, it's likely CCP will feel the urge to do a full scale rollout.