These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
 

Unexpected Dowtime Update - Tranquility Is Back Online

First post
Author
seth Hendar
I love you miners
#161 - 2013-06-03 13:18:47 UTC
Capt Tenguru10 wrote:
There will be compensation for this 100%. We lost game time and in some cases sp from not have a que filled. Also some players might have lost ships. All of these issues are not the fault of the player. And while not CCP fault per se, we were not giving any warning about emergency shut down or given any chances to fill que or dock ships, so with that said you can bet on getting 100 k sp

don't worry, ship lost due to this will probably get replaced by ccp, just petition it, and allow them time to handle this, cause they will have many many of those to handle, and no doubt they will.

regarding compensation, i don't think it being required, but knowing CCP, they will probably do something anyway, so stop bitching at em, let em have some rest for now, they deserve it.


i don't hesitate to yell at em when it is, imao, deserved (bugs and stuff), but here, there is NO REASON at all to show anything but support at their efforts handling this
THC Trader
Doomheim
#162 - 2013-06-03 13:19:07 UTC
Aprudena Gist wrote:
why would you do daily downtime ~50 minutes after you just go the server up?


Because daily downtime is used to update the servers. Given that they had to work out other issues, they most likely didn't update the servers before daily dt. On top of that they probably brought them up an hour before downtime to make sure everything was ok, so they could fix any issues that arose during normal downtime.
Sassi Levan
Flotilla Co.
#163 - 2013-06-03 13:19:32 UTC
Would be nice to get 24 hrs reimbursed, but nothing else is required really. They didn't DDOS themselves. So thank you CCP for fixing this as fast as you can, I am sure you did your best. Hope that I can play tonight and I am ready for tomorrow. I wish everyone a solid roll-out of Odyssey.
Lady Areola Fappington
#164 - 2013-06-03 13:20:49 UTC  |  Edited by: Lady Areola Fappington
CCP, I appreciate your hard work and concern for data security during the DDoS, and I'm happy you took the time required to make things right. Working during the weekend sucks.

I'm one of the many who did lose training time during the outage. I neither expect, nor demand any sort of reimbursement or compensation, since I know what happened is fully out of your control. I'll take full responsibility for my queue running out.

On that note, should you decide to offer any sort of "compensation" for the downtime, I'll accept it in spirit of a gift, with many thanks and more appreciation.

Good luck on the upcoming Odyssey roll-out, and I hope you guys get to take a well-deserved vacation after things have settled out.

7.2 CAN I AVOID PVP COMPLETELY? No; there are no systems or locations in New Eden where PvP may be completely avoided. --Eve New Player Guide

Kaiden krios
Mangueireiros
#165 - 2013-06-03 13:20:53 UTC
When I saw instability in the game on sunday the first thing I did was put a skill that takes a few days, predicting that something else could happen. Actually did not expect the problem to be solved as fast knowing it is a ddos.

So there was only one problem, my dear Vindicator spent the night in the street and was a bit cold, she's a bit upset Lol

Thanks CCP for your hard work Blink
SN50049177 1
Re-Hab
#166 - 2013-06-03 13:22:40 UTC  |  Edited by: SN50049177 1
Also... Been playing Eve for a while now... And it's actually pretty stable and reliable most of the time (not including patches, but then again some hickups are to be expected if you change a lot of code), more so then other MMO's I've played. This is actually the first really long unexpected downtime I've experienced with Eve so far (not counting patch problems)

So in general I would like to say CCP keep up the good work, and thanks for sacrificing your weekend to get it fixed. Wish you all the best of luck in deploying the patch
Nerath Naaris
Pink Winged Unicorns for Peace Love and Anarchy
#167 - 2013-06-03 13:23:03 UTC
Sassi Levan wrote:
They didn't DDOS themselves.


Well....

Je suis Paris // Köln // Brüssel // Orlando // Nice // Würzburg, München, Ansbach // Saint-Étienne-du-Rouvray

Je suis Berlin // Fort Lauderdale // London // St. Petersburg // Stockholm

Je suis [?]

Equinox Starborn
Ministry of War
Amarr Empire
#168 - 2013-06-03 13:24:11 UTC  |  Edited by: Equinox Starborn
I am having a REAL big problem with DC's today.

I logg in, after about 5 seconds i loose Connection again.

Anyone else have this issues?

/eq
baltec1
Bat Country
Pandemic Horde
#169 - 2013-06-03 13:24:37 UTC
Moretic wrote:



how do you know it wasnt their fauilt?
They say it wasnt their fault but thats what they say, it can just as well been a ccp worker who lost his/her brain.
in the end we are paying for a service, which was not accessible.


Why would they ddos themselves?

You self entitalment types need to just go away, CCP pulled an all nighter dredging through the entire game line by line on a weekend.

The only gift I want is the name of whoever did this. CCP dont owe us anything.
Decimus Barca
Clubs and Diamonds
#170 - 2013-06-03 13:26:58 UTC
Well I am a new player to Eve.

I have played a few MMOs in my time but i have to say. I have NEVER seen a company handle something like this the way you guys did. You not only gave up your weekend and busted your behinds all night to get it back up and running you did something that until now i have not seen a company have the balls to do.

Despite the trolling and QQing to just open it back up you told them NO. Alot of companys would have just given in to the crazy feedback and put out an unsafe or over all bad product. But you did the right thing despite the fact some of your players would be butt hurt you waited until it was safe for all of us.

This to me is a huge reason to continue to play your game...

I guess this is just a long drawn out thank you!

Great work guys!
Popsikle
Caffeine Commodities Company
#171 - 2013-06-03 13:27:04 UTC  |  Edited by: Popsikle
Phobos Eversor wrote:
Quote:
We apologize for any inconvenience that this extended downtime has caused.


You... you what?

You stayed up all night for us. You gave up your weekend for us. You updated twitter every 3 hours for us. Your coffee pot valiantly died in the line of duty for us.

You don't need to apologize to us; You need a nap, a raise, and a new coffee pot.

Thanks for the hard work.


While I do appreciate CCP and normally support them (fanboi) this situation was completely avoidable. They took all of the servers down because there was a patchable exploit in their infrastructure. The keyword in that last sentence is patchable. We (collectively) pay them lots of money, and this sort of flaw in the platform should have been identified before its too late. Yes, I know some exploits are 0-day and such, but since they patched it it had to be an exploit that was on someones radar. Suggesting someone gets a raise because of this is the opposite of what should happen tbh. Someone should get a yelling at and possible termination for not being on top of security.

That said they did not stay up for us, they stayed up because its their job. They could not work around the clock to get the servers patched and expect the userbase to keep paying them. Now CCP isn't a giant machine, and I am sure a lot of the people were sympathetic with us because they do also play the game, but even if they weren't i'm sure it was an "ALL HANDS ON DECK" call from above. I know I have been in situations similar where sure, I want to make things available to customers because it sucks for everyone things are down but everyone is working on the problem because that's what they get paid to do.

I really do appreciate the information on why they took everything down instead of the bs line about this being a DDoS attack. That is what agitated me most yesterday was that they were blatantly lying to everyone about what happened. Glad to see they came clean about the issue today!

I do also agree with the decision to shut everything down to figure out what the hell happened and get it fixed in how every long it takes before bringing it back online. That was very responsible of them, and I appreciate them protecting my information ;)
Omega Tron
Edge Dancers
Pan-Intergalatic Business Community
#172 - 2013-06-03 13:29:37 UTC
CCP Falcon wrote:
As of 10:15 UTC today, Tranquility is back on line after an unexpected overnight downtime.

Our engineers have worked overnight to resolve the cause of the downtime, and we are currently monitoring the cluster to ensure that the issues which caused the situation are fully resolved.

We apologize for any inconvenience that this extended downtime has caused.

You can read more about what caused the problem in a statement from our Chief Operating Officer here.



Thank you for taking your time and verifying that everything was still intact and safe.

And now that I am back to getting my EVE fix all is good again.

CCP's sand box is EVE Online.  The sand is owned by CCP.  We pay them a monthly fee to throw the sand at each other.  That is all that is here, so move along. Nothing more to be seen.

THC Trader
Doomheim
#173 - 2013-06-03 13:31:05 UTC
baltec1 wrote:
Moretic wrote:



how do you know it wasnt their fauilt?
They say it wasnt their fault but thats what they say, it can just as well been a ccp worker who lost his/her brain.
in the end we are paying for a service, which was not accessible.


Why would they ddos themselves?

You self entitalment types need to just go away, CCP pulled an all nighter dredging through the entire game line by line on a weekend.

The only gift I want is the name of whoever did this. CCP dont owe us anything.

This a million times. I'm the first to call CCP on their bullshit. I think the launcher is a useless piece of garbage that provided a bunch of drawbacks, and broke something that worked perfectly fine before, adding not a single benefit. But this weekend's events were not CCP's fault for one. On top of that, they handled things exceptionally. I heard DDoS, and I was expecting a week of downtime or more, because a DDoS can be VERY hard to mitigate. This is the time to give CCP some well deserved praise, not undeserved hate.
baltec1
Bat Country
Pandemic Horde
#174 - 2013-06-03 13:31:58 UTC
Popsikle wrote:


While I do appreciate CCP and normally support them (fanboi) this situation was completely avoidable. They took all of the servers down because there was a patchable exploit in their infrastructure.


It is impossible to lock all the back doors. Just last week China stole several top secret designs from the US military.

If an organisation with a trillian $ budget cant stop these things from happening then what chance does a small icelandic gaming company have?

Just be glad they fixed it.
Adam1337
Lauren Abbey Industries
#175 - 2013-06-03 13:33:16 UTC
Knowing that the update is due to roll out tomorrow, I would like to suggest every player puts in a nice long skill to train...


Twisted
Ace Uoweme
Republic Military School
Minmatar Republic
#176 - 2013-06-03 13:33:33 UTC
SN50049177 1 wrote:
I don't want an extra day or anything, just that my carefully planned skilltraining is going to work out as I planned it.


Especially when your toons training queued stopped for hours during/after/inbetween the shutdown, when trying to beat the deadline for June 4th. Was suppose to finish 40 days of training at 1am on the 4th, now it pretty darn close to the server shutdown, and barely enough to insert/train the remaining skill which has to wait for the other skill to finish.

If it wasn't for the expansion deadline it wouldn't be much of a problem. But this forced using up remaps to beat the clock, and the clock stopped even. :(

_"In a world of universal deceit, telling the truth is a revolutionary act." _ ~George Orwell

THC Trader
Doomheim
#177 - 2013-06-03 13:35:06 UTC
Popsikle wrote:
Phobos Eversor wrote:
Quote:
We apologize for any inconvenience that this extended downtime has caused.


You... you what?

You stayed up all night for us. You gave up your weekend for us. You updated twitter every 3 hours for us. Your coffee pot valiantly died in the line of duty for us.

You don't need to apologize to us; You need a nap, a raise, and a new coffee pot.

Thanks for the hard work.


While I do appreciate CCP and normally support them (fanboi) this situation was completely avoidable. They took all of the servers down because there was a patchable exploit in their infrastructure. The keyword in that last sentence is patchable. We (collectively) pay them lots of money, and this sort of flaw in the platform should have been identified before its too late. Yes, I know some exploits are 0-day and such, but since they patched it it had to be an exploit that was on someones radar. Suggesting someone gets a raise because of this is the opposite of what should happen tbh. Someone should get a yelling at and possible termination for not being on top of security.

That said they did not stay up for us, they stayed up because its their job. They could not work around the clock to get the servers patched and expect the userbase to keep paying them. Now CCP isn't a giant machine, and I am sure a lot of the people were sympathetic with us because they do also play the game, but even if they weren't i'm sure it was an "ALL HANDS ON DECK" call from above. I know I have been in situations similar where sure, I want to make things available to customers because it sucks for everyone things are down but everyone is working on the problem because that's what they get paid to do.

I really do appreciate the information on why they took everything down instead of the bs line about this being a DDoS attack. That is what agitated me most yesterday was that they were blatantly lying to everyone about what happened. Glad to see they came clean about the issue today!

I do also agree with the decision to shut everything down to figure out what the hell happened and get it fixed in how every long it takes before bringing it back online. That was very responsible of them, and I appreciate them protecting my information ;)

You're ********. It was definitely a DDoS attack. The attack took advantage of a (until now) unknown vulnerability in their servers. They took the servers down to evaluate the situation, and make sure customer data had not been compromised, while also working on a patch to remove the vulnerability. CCP handled the situation very well, and you're a jackass for claiming otherwise. Go back to WoW with your entitlement attitude. See what happens when your 2000 man WoW server gets DDoSed. Bet it's down for a month.
Equinox Starborn
Ministry of War
Amarr Empire
#178 - 2013-06-03 13:36:21 UTC
Is there anyone else that have serious problems with DC's?

I can logg into the launcher.
I can enter the game.
I can stay in game for 2-5 seconds Before getting "Socket closed".


Anyone else?
Adam1337
Lauren Abbey Industries
#179 - 2013-06-03 13:37:24 UTC
baltec1 wrote:
Popsikle wrote:


While I do appreciate CCP and normally support them (fanboi) this situation was completely avoidable. They took all of the servers down because there was a patchable exploit in their infrastructure.


It is impossible to lock all the back doors. Just last week China stole several top secret designs from the US military.

If an organisation with a trillian $ budget cant stop these things from happening then what chance does a small icelandic gaming company have?

Just be glad they fixed it.



With the greatest of respect, CCP team are highly trained competent team of skilled software and hardware engineers, they should stand a better chance at protecting there networks than the poorly trained low skill operatives employed by a government.


Starden Arnolles
Center for Advanced Studies
Gallente Federation
#180 - 2013-06-03 13:38:43 UTC
Karle Tabot wrote:
Do not know much about the DDOS, but it seems Eve Online was maliciously targeted. Hopefully that person, or more likely group, will be found and prosecuted. I assume all the offtime was necessary to protect everyone's accounts, etc. So I do not blame CCP. No doubt this has caused it a great deal of extra work and expense, as well as causing many of its customers lost time, isk, skill training, etc.

Although it would be wrong in my opinion to blame CCP, this came at a particularly bad time for its customers. I think doing something to compensate customers is very good PR in a time when it would be particularly appreciated. So I read with appreciation that CCP is indeed planning on that.



I agree with this. There was no fault or blame to CCP, and they no doubt had serious extra work, cost, expense and irritation. I see many posters who fully understand that.

They have no legal obligation as far as I know to do anything. They got it fixed, they apologized (not necessary, but nice), and they posted already they were going to do something to compensate players. I think that a nice touch and a quality move.

Makes the best out of a bad situation all around, and to repeat (for the mentally challenged), even though CCP has no blame, no fault and no legal obligation.