These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
 

CCP SERVER ENGINEERS ARE IN TEST

First post
Author
Previous Topic Next Topic
Phee Phi PhoPhum
Science and Trade Institute
Caldari State
#501 - 2013-07-04 23:52:51 UTC
CCP Phantom wrote:

Every live remap of a system, and this remap is no exception, works in such a way that all players in the system are disconnected and all ships are removed from space. The usual player logoff mechanics with all associated timers are just not relevant during downtime or live remaps.

Please also note that further information is currently being compiled to give you a more detailed overview.


Sounds like its time to re-enginner this. Put it on the list. At the top.


ps. informative reply Phantom. Thanks.
Ayures
Perkone
Caldari State
#502 - 2013-07-04 23:52:54 UTC
Dheeradj Nurgle wrote:
CFC Capital fleet gets saved by a boo boo 3 or 4 times, TEST grumbles and gets on with their lives.

TEST Capital fleet gets saved by a boo boo, and the SA Furries and their pets go on a Posting CTA.
Duncan McClain
Jolly Codgers
Get Off My Lawn
#503 - 2013-07-04 23:52:55 UTC
Captain Thunk wrote:
PL was about to jump in and DESTROY the goon fleet.

I'm pretty unhappy with what could be Goon engineers taking drastic action to save their Goon Brosefs.

Try not to get too mad about this Test guys, we'll get 'em next time!



Wow, that is some serious spin
Delta Jax
The Scope
Gallente Federation
#504 - 2013-07-04 23:53:06 UTC
Edward Pierce wrote:
CCP 2013 wrote:
Can't tell the difference between a Q and a Z.

A 2000 person fleet fight is ruined because your software engineers don't know how to use a keyboard? This is actually quite amusing. You guys run a game with over 500,000 subscribers, but you can't make sure you're moving the right node.



You sound pretty mad, perhaps you should get a job as a system engineer, schitz easy right?

Twitter :  @DeltaJax
Alavaria Fera
GoonWaffe
#505 - 2013-07-04 23:53:11 UTC
Sophaya Fortelleren wrote:
I would likely be very mad at this if I was in the CFC, but as I'm not... LOLOLOLOLOLOL QQ CFC, QQ Goons, YEAAAAAAAAH BOIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII!

Hell yeah!! TEST will never fall ! TEST Alliance, Cannot Be Ignored.

Montoltio foretold the fall of the goons, forward to VFK !!

Triggered by: Wars of Sovless Agression, Bending the Knee, Twisting the Knife, Eating Sov Wheaties, Bombless Bombers, Fizzlesov, Interceptor Fleets, Running Away, GhostTime Vuln, Renters, Bombs, Bubbles ?
Tector
The Scope
Gallente Federation
#506 - 2013-07-04 23:53:19 UTC
Disastro wrote:
Thanks ccp for helping us not finish off the Bubbled Test capitals. We didnt want those capital kills anyway. You dudes are pro. Keep doing what you are doing. Awesome job. To err is human after all....


To err repeatedly is CCP.
Daktar Jaxs
Sniggerdly
Pandemic Legion
#507 - 2013-07-04 23:54:04 UTC
When you are employed to do a job making a mistake major mistake isn't a oh whoops, messed up there, carry on guys. I am frankly stunned at CCP's attitude to this.
Alavaria Fera
GoonWaffe
#508 - 2013-07-04 23:54:09 UTC
SmilingVagrant wrote:
CCP Phantom wrote:
Shamata wrote:
CCP you just ****** one of the largets fleet battels in eve history... THANKS!

In the attempt to improve the overall fight quality and node stability in the Z9PP system at 22:41 UTC by moving away all non-critical services from this node, our engineers unfortuntely made a mistake and actually moved the critical system from the current server node instead of moving all other systems. As result every pilot in this system lost connection to the node and therefore to Tranquility.

The system Z9PP is online and accessible again now.

It is extremely unfortunate to make such a mistake and we apologize deeply for disrupting one of the truly epic battles in the history of EVE; especially since this battle already raged on for several hours and was still heating up for more! We are very sorry about this incident and will make sure that such mistakes won't happen again.

As a Systems Administrator myself I know the best time to perform maintenance on a server is when it is at it's peak usage by the clients. Hell not a day goes by that I don't just randomly "Tweak" SQL performance during our busiest part of the day. Sure sometimes everything comes screaming to a halt, but let me tell you bud, that one day I can eak 1% extra performance out of the cluster and ~no one notices~ ... that **** goes on my resume.

You're too good for CCP.

You don't mess up.

Triggered by: Wars of Sovless Agression, Bending the Knee, Twisting the Knife, Eating Sov Wheaties, Bombless Bombers, Fizzlesov, Interceptor Fleets, Running Away, GhostTime Vuln, Renters, Bombs, Bubbles ?
Alavaria Fera
GoonWaffe
#509 - 2013-07-04 23:54:52 UTC
Tector wrote:
Disastro wrote:
Thanks ccp for helping us not finish off the Bubbled Test capitals. We didnt want those capital kills anyway. You dudes are pro. Keep doing what you are doing. Awesome job. To err is human after all....

To err repeatedly is CCP.

It's called staying the course. Sometimes you just gotta :condi:

Triggered by: Wars of Sovless Agression, Bending the Knee, Twisting the Knife, Eating Sov Wheaties, Bombless Bombers, Fizzlesov, Interceptor Fleets, Running Away, GhostTime Vuln, Renters, Bombs, Bubbles ?
WhiteHalo117
Amok.
Goonswarm Federation
#510 - 2013-07-04 23:55:14 UTC
You all drink way to much cool aid.
Alavaria Fera
GoonWaffe
#511 - 2013-07-04 23:55:29 UTC
Duncan McClain wrote:
Captain Thunk wrote:
PL was about to jump in and DESTROY the goon fleet.

I'm pretty unhappy with what could be Goon engineers taking drastic action to save their Goon Brosefs.

Try not to get too mad about this Test guys, we'll get 'em next time!

Wow, that is some serious spin

TEST had us right where they wanted us, their gambit of the carriers was about to pay off.

Grr goons, we'll murder you dead next time !!

Triggered by: Wars of Sovless Agression, Bending the Knee, Twisting the Knife, Eating Sov Wheaties, Bombless Bombers, Fizzlesov, Interceptor Fleets, Running Away, GhostTime Vuln, Renters, Bombs, Bubbles ?
Ayures
Perkone
Caldari State
#512 - 2013-07-04 23:55:54 UTC
Daktar Jaxs wrote:
When you are employed to do a job making a mistake major mistake isn't a oh whoops, messed up there, carry on guys. I am frankly stunned at CCP's attitude to this.


You guys are just upset that a node crash happened in our favor instead of yours for once.
Arrendis
TK Corp
#513 - 2013-07-04 23:55:54 UTC
CCP Phantom wrote:

The command to remap everything other than Z9PP-H from the current server node was mis-entered. Instead of moving everything else than Z9PP-H, the command was given to move everything else than Q9PP-H.


Was this on a dvorak keyboard? because Q and Z aren't exactly an easy typo on a QWERTY.

PURGE DVORAKS. Lol
Jack Tronic
borkedLabs
#514 - 2013-07-04 23:55:56 UTC
Schadenfraud wrote:
CCP Phantom wrote:
GRIEV3R wrote:
In spite of all the idiots sperging on this thread, I have one honest question: Why weren't the tackled capital ships still there when we logged back in?

They were in warp disruption bubbles with agro timers. According to everything I know about logoff mechanics, they should not have moved anywhere, regardless of server crashes, characters log offs, or any amount of tinfoil.

I'm willing to accept that it was a simple mistake and there was no foul play, but only if you can give us a solid explanation for why the carriers disappeared from the field, in contradiction to well-established logoff mechanics.


Please explain CCP.


While I am not an engineer or server administrator I can give a brief overview: a live remap disconnects all players in the system and removes all ships from space similar to a downtime.

The command to remap everything other than Z9PP-H from the current server node was mis-entered. Instead of moving everything else than Z9PP-H, the command was given to move everything else than Q9PP-H. Therefore Z9PP-H (and everything else on the current node) was remapped with the fatal consequences we see now.

Every live remap of a system, and this remap is no exception, works in such a way that all players in the system are disconnected and all ships are removed from space. The usual player logoff mechanics with all associated timers are just not relevant during downtime or live remaps.

Please also note that further information is currently being compiled to give you a more detailed overview.



Why does this system require typed in system names instead of a physical drop box for what systems are on whichever node you are balancing out?


A majority of all server administration is done via command line pretty much world wide. GUIs waste system resources, and just limit what you can do. Not to mention it's rather hard to automate repititve tasks. Many tasks are automated through scripts.
StryP1
University of Caille
Gallente Federation
#515 - 2013-07-04 23:56:16 UTC
MyBoy friday wrote:
I'm not going to get on the CCP is Test argument, although it sounds very suspicious at this point.
I just don't care about that.

However, it seems quite reasonable to ask the question, when will CCP begin firing or reassigning their employees who are not capable of doing their jobs?
This is a huge customer service issue.
You expect players to:

1. pay for the service
2. risk their earned in-game assets in order to generate content in the game according to the structure that CCP alone has devised.
3. attract new players/subscribers

And yet, you seem incapable of properly vetting employees to insure that they posses the skills to support a simple service.
This was not an act of God, or serendipity. It was an act committed by a CCP employee, accidental or not, which caused tangible losses to it's customers. There is NO other industry where compensation would not be immediately granted to the customer.

Just saying.

Maybe some time on a mop will sharpen your sysadmin's skills.


This.
Leask
Caldari Provisions
Caldari State
#516 - 2013-07-04 23:56:45 UTC
CCP aims to make massive battles like this one the center of their game, but when they happen there is always a problem (human error being a huge one) that leads to its early conclusion.

How many fights have been ruined by such occurrences? I think we can all name a few, and all of them lead to mistrust, accusations and rage. Your increasing inability to sustain such events does not inspire the confidence required to initiate such epic player created content. Regardless of Goon benefit or Test benefit these occurrence are numerous and continue to be answered with simple apologies.

Some ounce of proof that CCP is making an effort to fix such problems from happening again would be much better then feeding us meaningless statements like "sorry, but it won't happen again!"
Mohr Cowbell
KarmaFleet University
#517 - 2013-07-04 23:56:46 UTC
Zeph1rus wrote:

Q9PP-H obviously doesn't exist. Why do your tools allow you to exclude non-existant systems. Do you even bother with syntax checks on your admin commands? Maybe even a Y/N prompt might have saved your stupid asses.


Stay classy, GSF.
Visione
Ministry of War
Amarr Empire
#518 - 2013-07-04 23:56:54 UTC
Daktar Jaxs wrote:
When you are employed to do a job making a mistake major mistake isn't a oh whoops, messed up there, carry on guys. I am frankly stunned at CCP's attitude to this.


it happend like freacking 15 minutes ago, PR might not even been called out of bed yet. so just wait before you make a comment like that, wouldn't suprise me if they come with a public statement/news ****
Alavaria Fera
GoonWaffe
#519 - 2013-07-04 23:57:03 UTC
Daktar Jaxs wrote:
When you are employed to do a job making a mistake major mistake isn't a oh whoops, messed up there, carry on guys. I am frankly stunned at CCP's attitude to this.

:condi:

I got too brave drinking ham, lost... my discretion ...

Triggered by: Wars of Sovless Agression, Bending the Knee, Twisting the Knife, Eating Sov Wheaties, Bombless Bombers, Fizzlesov, Interceptor Fleets, Running Away, GhostTime Vuln, Renters, Bombs, Bubbles ?
Delta Jax
The Scope
Gallente Federation
#520 - 2013-07-04 23:57:05 UTC
Alavaria Fera wrote:
SmilingVagrant wrote:
CCP Phantom wrote:
Shamata wrote:
CCP you just ****** one of the largets fleet battels in eve history... THANKS!

In the attempt to improve the overall fight quality and node stability in the Z9PP system at 22:41 UTC by moving away all non-critical services from this node, our engineers unfortuntely made a mistake and actually moved the critical system from the current server node instead of moving all other systems. As result every pilot in this system lost connection to the node and therefore to Tranquility.

The system Z9PP is online and accessible again now.

It is extremely unfortunate to make such a mistake and we apologize deeply for disrupting one of the truly epic battles in the history of EVE; especially since this battle already raged on for several hours and was still heating up for more! We are very sorry about this incident and will make sure that such mistakes won't happen again.

As a Systems Administrator myself I know the best time to perform maintenance on a server is when it is at it's peak usage by the clients. Hell not a day goes by that I don't just randomly "Tweak" SQL performance during our busiest part of the day. Sure sometimes everything comes screaming to a halt, but let me tell you bud, that one day I can eak 1% extra performance out of the cluster and ~no one notices~ ... that **** goes on my resume.

You're too good for CCP.

You don't mess up.



I don't think a lot of people actually grasp what they were doing, it isn't tweaking a database. It's like VMotion'ing a server when it's host gets overloaded, 99.999% of the time it goes fine.

Twitter :  @DeltaJax