These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

Player Features and Ideas Discussion

 
  • Topic is locked indefinitely.
 

CCP, did you ever think about VMWare?

Author
ChaseX
The Executives
#1 - 2013-02-07 11:54:17 UTC
Hi there,

I just read the stuff about the big battle in lowsec some days ago and I wonder if CCP has ever thought about a migration of their nodes into a VMWare. I know this is easier said than done because it would be a rather large project and I know nothing about all the problems that could occur with CCP internal structure but the huge plus would be: scalability.

At work we use huge VMWare farms (several hundred CPUs, few TB of RAM, and tens of TB or storage) for different customers and the one thing that comes to mind is the live-migration feature. You can just move a VM or even edit it to have better specs (RAM, CPUs, ...) to fullfil the current needs. Wouldn't this fit perfectly to handle situation like the battle of Asakai?

Just curious what a dev says to this and where my logic fails (I am sure it isn't that "simple").

Cheers
Marionaitte
Perkone
Caldari State
#2 - 2013-02-07 12:04:02 UTC
ChaseX wrote:
Hi there,

Just curious where my logic fails

Cheers


Maybe in accounting.
Whitehound
#3 - 2013-02-07 12:05:53 UTC
It is not the software, which is too small, it is the hardware.

Besides, battles need to be looked at from a game play perspective. Having 2300 players in a system and >50% of the damage is done by smartbombs, because it is all just one big blob is not going to be fun for long.

It needs new game elements to drive the fights apart and to delay reinforcements if only by a small amount.

I am thinking cyno disruption bubbles...

Loss is meaningful. Therefore is the loss of meaning likewise meaningful. It is the source of all trolling.

ChaseX
The Executives
#4 - 2013-02-07 12:08:48 UTC  |  Edited by: ChaseX
Marionaitte wrote:
ChaseX wrote:
Hi there,

Just curious where my logic fails

Cheers


Maybe in accounting.


Yeah possible that the VMWare license is pretty expensive, to be honst I don't actually know that cause I just use it. Blink

Whitehound wrote:
It is not the software, which is too small, it is the hardware.

Besides, battles need to be looked at from a game play perspective. Having 2300 players in a system and >50% of the damage is done by smartbombs, because it is all just one big blob is not going to be fun for long.

It needs new game elements to drive the fights apart and to delay reinforcements if only by a small amount.

I am thinking cyno disruption bubbles...


Totally agree with this. Just was curious about the technical side.
rodyas
Tie Fighters Inc
#5 - 2013-02-07 12:09:05 UTC
Those farms could be nice, for their hamsters to run free in periodically.

Signature removed for inappropriate language - CCP Eterne

Chribba
Otherworld Enterprises
Otherworld Empire
#6 - 2013-02-07 12:11:52 UTC
While virtualization is very nice, it also do add one extra layer on performance, especially if there is custom built servers for specific purposes. I'm sure CCP is evaluating the use of virtualizing things they can and the impact it may have.

As for the license costs, that wouldn't be too bad in the big picture.

/c

★★★ Secure 3rd party service ★★★

Visit my in-game channel 'Holy Veldspar'

Twitter @ChribbaVeldspar

ChaseX
The Executives
#7 - 2013-02-07 12:13:46 UTC  |  Edited by: ChaseX
Chribba wrote:
While virtualization is very nice, it also do add one extra layer on performance, especially if there is custom built servers for specific purposes. I'm sure CCP is evaluating the use of virtualizing things they can and the impact it may have.

As for the license costs, that wouldn't be too bad in the big picture.

/c


Yeah but VM has evolved in the last years and it has a very small cut off for the virtualization itself. I still like the thought that solar system nodes could grow in capacity that is taken off of low-traffic systems in case of oops jumping Titans.
Karak Terrel
Foundation for CODE and THE NEW ORDER
#8 - 2013-02-07 13:14:08 UTC
ChaseX wrote:

Yeah possible that the VMWare license is pretty expensive, to be honst I don't actually know that cause I just use it. Blink

There is always KVM that can do the same without license costs if that is the problem.

My guess is: One does not simply change the underlying infrastructure of a running gamecluster.

But i'm sure they are exploring that option and they will introduce it as soon as they think it won't obliterate our shiny internet spaceship world.

It would be very interesting to read maybe a devblog about this stuff and what the challenges are in this case.
Whitehound
#9 - 2013-02-07 13:40:05 UTC
Karak Terrel wrote:
My guess is: One does not simply change the underlying infrastructure of a running gamecluster.

It will be pretty much this. ^^

VMs are nice when you are using 3rd-party products or the software is being developed out of house, but why rely on VMs when you can write your own server software and make multiple machines appear as one server?!

Besides, VMs let you divide a single server into multiple servers, whereas EVE needs multiple servers to appear as one.

Loss is meaningful. Therefore is the loss of meaning likewise meaningful. It is the source of all trolling.

Hammer Borne
Doomheim
#10 - 2013-02-07 13:50:40 UTC
Based on what I know of the EVE codebase, I highly doubt virtualization would help. Virtualization favors distributed and randomized loads. When 500 ships land on one grid, they likely need all the horsepower they can muster for a small number of threads.

Virtualization is done on servers to reduce maintenance costs, not improve performance of individual nodes.

Virtualization is done on desktops to group underutilized systems, and to reduce maintenance costs, not to improve performance of individual nodes.

Sure, VMWare and Citrix will tell you it will increase performance, but I have yet to see a business case that proved it in reality. In most cases, it saved money but end users are not happier.
kodohumper
Spectre Fleet Ltd.
Spectre Fleet Alliance
#11 - 2013-02-07 13:56:29 UTC
Whitehound wrote:
Karak Terrel wrote:
My guess is: One does not simply change the underlying infrastructure of a running gamecluster.

It will be pretty much this. ^^

VMs are nice when you are using 3rd-party products or the software is being developed out of house, but why rely on VMs when you can write your own server software and make multiple machines appear as one server?!

Besides, VMs let you divide a single server into multiple servers, whereas EVE needs multiple servers to appear as one.


Pretty sure that they technicaly could migrate the whole thing to a virtual cluster. The server software probably would not care if it's an actual physical machine or a virtualized insance.

But you're spot on with pointing out that it's not a trivial task to migrate the whole infrastructure. I'm guessing that it comes down to :
- cost of new hardware
- cost of licenses for VM
- time and effort that they are better of spending on core development of features

For the most part the current setup works well for the workloads they have and changing it is of marginal benefit since by itself it wont raise the subscriber count. It would help with cutomer retention though.





kodohumper
Spectre Fleet Ltd.
Spectre Fleet Alliance
#12 - 2013-02-07 14:00:33 UTC
Hammer Borne wrote:
Based on what I know of the EVE codebase, I highly doubt virtualization would help. Virtualization favors distributed and randomized loads. When 500 ships land on one grid, they likely need all the horsepower they can muster for a small number of threads.

Virtualization is done on servers to reduce maintenance costs, not improve performance of individual nodes.

Virtualization is done on desktops to group underutilized systems, and to reduce maintenance costs, not to improve performance of individual nodes.

Sure, VMWare and Citrix will tell you it will increase performance, but I have yet to see a business case that proved it in reality. In most cases, it saved money but end users are not happier.



He was suggesting that it would help them with dynamic resource allocation when a node is overloaded by being able to beef it up on the fly. By adjusting the amount of CPU shares/memory shares that the shard that is geting hammered gets.
Omendor
Friends Of Harassment
#13 - 2013-02-07 14:33:06 UTC  |  Edited by: Omendor
Hammer Borne wrote:
.... In most cases, it saved money but end users are not happier.
Hopefully CCP hasen't read this yet and never will. They may rethink their point and soon show us a PR-Story about their shiny new paravirtualized cluster nodes Ugh

But tbh, they already did, back when they showed their cluster to be moved to Windows HPC
Rroff
Antagonistic Tendencies
#14 - 2013-02-07 14:36:06 UTC  |  Edited by: Rroff
kodohumper wrote:

He was suggesting that it would help them with dynamic resource allocation when a node is overloaded by being able to beef it up on the fly. By adjusting the amount of CPU shares/memory shares that the shard that is geting hammered gets.



Yeah a lot of the current issues are due to the limitations currently in place on dynamically reinforcing a node when things kick off unexpectedly.

A lot better solution in the long run would be (and probably something CCP has ongoing) profiling these fights to see what the big performance hits are and where those can be adjusted. Its quite common for instance to have things in the initial implementation of a design that are processed synchronously in realtime that down the road you can adjust so they are less time sensitive and processing on them can be deferred, etc.
Omendor
Friends Of Harassment
#15 - 2013-02-07 14:38:49 UTC
But is this really still a topic? That spontaneous fight in lowsec was still impressive IMHO. There are currently far more important problems to tackle IMHO: starbases & overall PITA deeply hidden in old features/code!
Kirluin
#16 - 2013-02-07 14:53:35 UTC  |  Edited by: Kirluin
going to a vm architecture could theoretically be of some benefit given my understanding of how the eve cluster works. it would allow live migration of systems off a "hot" node without interrupting user connections. Eve can already do this, but it boots users off in the process forcing them to reconnect. it would also allow lots of idle systems/nodes to be collapsed onto less hardware, and moved around as needed.

since the guts of eve are single threaded however, this would probably not help the "3,000 users logged onto one system/grid". if anything even the small vm overhead hit would make that case worse. ironically the case you want to optimize most.

you'd have to weigh the benefits of being able to seamlessly move everyone else off a server vs the overhead of running in a vm. You CAN run high performance stuff in vmware by dedicating cpu/ram to your vms (its a setting that grants the virtual machine it's own cpu not shared with anyone else). I run some heavy duty exchange and SQL servers like this with great success (the benefits far outweigh the performance hit for my applications).

however i'm guessing that ccp has really smart folks that looked at this already and decided it's not worthwhile for this setup. "Just boot users off when you migrate/reimburse for disconnect losses" works for free. Their time might be better spent figuring out how to live migrate a stackless python process directly, if they cant multithread a system.

it's a tough problem. kind of like trying to upgrade your single engine stunt plane into a quad engine jet aircraft. While flying. With 57,000 screaming passengers onboard.
ChaseX
The Executives
#17 - 2013-02-07 16:36:15 UTC
Omendor wrote:
But is this really still a topic? That spontaneous fight in lowsec was still impressive IMHO. There are currently far more important problems to tackle IMHO: starbases & overall PITA deeply hidden in old features/code!


Totally agree. Was just curious on that topic. What was mentioned before is that such huge fights are not fun in the current state of things also known as blobs. If the fight would have some sort of dynamic in the system that would open up several hot spots and options it would be better and maybe even easier to handle due to different grids.
Buzzy Warstl
Quantum Flux Foundry
#18 - 2013-02-07 16:58:49 UTC
VMWare isn't the be-all and end-all of virtualization (there are perfectly reasonable free virtualization options, so licensing isn't the problem).

What would make more sense for this application isn't server virtualization, but moving towards an actor model so that people can interact directly in space without needing to be on the same CPU. Blizzard is on the list of Akka users, so I suspect they are already moving in that direction, and I would be shocked if CCP isn't also looking at how to get the same effect on their Python-based server platform.

http://www.mud.co.uk/richard/hcds.htm Richard Bartle: Players who suit MUDs