These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
 

Unscheduled Downtime Extension – July 15, 2015

First post First post First post
Author
Previous Topic Next Topic
Lagranzh
000 Russian Academy 000
000 Russian Concern 000
#961 - 2015-07-15 15:21:32 UTC
Hello, there! Probably you need to hire team of talented DevOps from Russia to prevent such situations?

Write me here or privately to discuss the thing, if this is acceptable for you..
fl0pski
I HAVE FEELINGS TOO YOU KNOW
#962 - 2015-07-15 15:21:34 UTC
Spyra Gryra wrote:
Jack Danefield wrote:
Bodewhin Schwarz wrote:
Jesus, when did the eve community turn into a bunch of idiots begging for free **** just because the server is down for a few hours....


Actually I was about to write a post describing how this community handles this sort of thing way better then say, world of warcraft's...

Oh well.



No you weren't.

The Eve community is not special or more intelligent than any other. I'm not sure why people keep perpetuating that myth.

I was hoping it would be more adult though.
Spyra Gryra
Cartamundi
#963 - 2015-07-15 15:21:36 UTC
Ecolo wrote:
Azunai Celestus wrote:
ok guys and gals it's official, ccp tech are now rocking backward and forward under their desks with a bottle of vodka, phoning microsoft help desk Lol

To me it just sounds like fun Shocked

Ah well good luck i need to get back to the weeding of the garden.


Sound like a good plan(t) to kill some time, I'll also smoke some weed in the garden!!

Ty 4 the tip



You are a pretty cool guy, man.
eodestroyer beast
Deep Core Mining Inc.
Caldari State
#964 - 2015-07-15 15:21:44 UTC
get ready guys. 10 minutes until they update us and say they are still working on it. =P
Xenia Ilchenka
Rockz corp
#965 - 2015-07-15 15:21:51 UTC
Drathel wrote:
Xenia Ilchenka wrote:
Bodewhin Schwarz wrote:
Jesus, when did the eve community turn into a bunch of idiots begging for free **** just because the server is down for a few hours....


Its not free. It costs money. Give me money back, or give me free sht


My calculations say that you're in need of a $0.10245901 refund for the five hours of extended downtime. Would you like this back on your credit card?



Start writing the check.
Gimme Sake
State War Academy
Caldari State
#966 - 2015-07-15 15:21:52 UTC
Auron Orlenard wrote:
Hit it with the NerfBAT, if all fails use the BanHammer.


And if it ain't broken yet, dank fix it!

"Never not blob!" ~ Plato
Jarsoom Blade
Blade's Legion
#967 - 2015-07-15 15:21:54 UTC
I vote for unleashing CCP Guard into the server room. He is the only one with the proper respectable height qualifications to wriggle in between the cables to see what's wrong. Save us, CCP Guard! #releasethekraken

"Two things I've learned lately. One: don't get jammed. And two: stationary ships don't react well to 1400's" - John Rourke, Clear Skies 2
Lemon Verbena
Aliastra
Gallente Federation
#968 - 2015-07-15 15:21:55 UTC
Liam Oliphants wrote:
Omer Tivianne wrote:
CCP Falcon wrote:
[img]http://i.imgur.com/2P4UoRb.gif[/img]

Hey guys,

As you’re all aware, Tranquility is still offline after today’s scheduled daily downtime.

This is due to an issue with a code deployment today while patching for a few fixes in EVE Online. The issue caused the cluster to fail to start up correctly, and as such, Tranquility is currently unavailable for play for both EVE and DUST.

Our operations and development team are working on this issue as we speak, and we’re hoping to have Tranquility back online for you guys as soon as possible.

Right now, we don’t have an ETA for when the cluster will be back online and accepting connections, but we’ll keep you updated in this thread.

Cheers,

- F

UPDATES:

13:00 UTC - AFTER SEVERAL FAILED STARTUPS, WE ARE CURRENTLY INVESTIGATING A STARTUP ISSUE
13:30 UTC - INVESTIGATION IS STILL ONGOING - NO FURTHER ETA ON UPTIME FOR TRANQUILITY
13:37 UTC - STARTUP FAILED AGAIN - INVESTIGATION IS ONGOING
14:00 UTC - INVESTIGATION IS STILL ONGOING
14:30 UTC - WE ARE CURRENTLY IN THE PROCESS OF REBOOTING AFTER FAULTFINDING AND CHANGES
15:00 UTC - FURTHER ATTEMPTS TO START UP HAVE FAILED - INVESTIGATION IS ONGOING



why dont you just delete the code you inserted today, check it, and then fix it, and then put it back in



Are you suggesting they turn it off and back on again? I think this should be a new rule to the drinking game.


Agreed!

A New Voice for a New Eden
Arden Bastilla
Center for Advanced Studies
Gallente Federation
#969 - 2015-07-15 15:21:57 UTC
Being a sys admin myself I know how things go. I don't know if most of you realize the complexity that goes into the cluster that they use. This isn't just a couple of servers working together. This is some real complex equipment.

Multi-blade chasis with servers having RAM in the Tera Bytes, Storage Area Networks having probably at least two if not three controllers with the same for the hdds that probably number in the hundreds to host everything. THen you have to have the core switch/router infrastructure that supports a high enough bandwidth to process all of the transactions internally and externally that happen. I'm sure just the Databases alone are probably on some massive Oracle server or three to even manage everything.

In a system like this saying that it doesn't "Startup" is like finding a needle in the proverbial lake, and the needle is made of clear glass and doesn't have to be at the bottom.

I'm sure CCP tried all the usual suspects first to get a quick restore and when that failed they are having to methodically not let their heads spin off their shoulders and go through each system involved and check it.

*cheers* good luck and I will now head back to my spreadsheets in space companion game.
Umbari Kado
THE RABID RABBITS
#970 - 2015-07-15 15:22:02 UTC
Helzrazor Merkur wrote:
Umbari Kado wrote:
Helzrazor Merkur wrote:
Umbari Kado wrote:
OK, time to provide some food for thought:

Suppose there is an ant at each vertex of a triangle and the three ants simultaneously crawl along a side to the next vertex. The probability that no two ants will encounter one another is 2/8, since the only two cases in which no encounter occurs are when the ants all go left (clockwise) -- LLL -- or all go right (counterclockwise) -- RRR. In the six other cases -- RRL, RLR, RLL, LLR, LRL, and LRR -- there will be an encounter.

Now - what is the probability of no encounter for dodecahedron ?






Also: If a chicken and a half can lay an egg and a half in a day and a half, how long would it take a one legged monkey to kick all the seeds out of a dill pickle?


That was a serious question :) From Titan test...


I know. But mine is easier.


Nope...it is pretty easy :)
SHADOWWALKER shadows
Covert Intent
G H O S T S
#971 - 2015-07-15 15:22:04 UTC
since half of eve is hear atm, can I get 1mil from all you, I promise ill double your isk javascript:insertsmiley('Twisted','/Images/Emoticons/ccp_twisted.png')javascript:insertsmiley('Twisted','/Images/Emoticons/ccp_twisted.png')javascript:insertsmiley('Twisted','/Images/Emoticons/ccp_twisted.png')javascript:insertsmiley('Twisted','/Images/Emoticons/ccp_twisted.png')
Cervantis Storm
Only Fleets
Brute Force Solutions
#972 - 2015-07-15 15:22:07 UTC
Quickly, everyone not complaining about the guys complaining about complaining about free stuff, complain about them. No free sp for anybody, update your queues for more then 24 hours plz, and get out of your seat, mow your lawns, or get more beer, or even buy more cheesy poofs, servers have been down for over a day in the past,,,,,,,,,,,,,, from ddos, ccp, please feed the hamsters.
Goin Off
Manson Family
Advent of Fate
#973 - 2015-07-15 15:22:07 UTC
OMG EVE is broken ShockedShockedShocked So much for my roamRollRollRoll

Not worried though they have their top tier working on it BlinkBlink

I have an IdeaIdea how bout test before deploy LolLol
Chuck Berlet
School of Applied Knowledge
Caldari State
#974 - 2015-07-15 15:22:18 UTC
Kalfar Chillar wrote:
So, who here is sitting with a bag of popcorn?


These whippersnappers have got their feathers in a bunch over the old downtime lengths. Ha! *shakes cane*
Pandion Knight Rinah
Space Warriors Alliance
#975 - 2015-07-15 15:22:23 UTC
My Mama said this would happen!Oops
Steijn
Quay Industries
#976 - 2015-07-15 15:22:44 UTC
Sexy Cakes wrote:
As a misanthrope who is stuck at work all day during this....

I'm enjoying this thoroughly.


dont gloat too much, it probably still wont be up when you get home.
DerpimusPrime Aihaken
Free Tank Test
#977 - 2015-07-15 15:22:50 UTC
Stop hiring interns.
Kazi Kugisa
Roving Guns Inc.
Pandemic Legion
#978 - 2015-07-15 15:22:52 UTC
CCP is hard at work reloading the legacy code into the server:
https://www.youtube.com/watch?v=LcwxW2ne-UU
Bob Donovitch
The Iron Bank and Trust
#979 - 2015-07-15 15:23:04 UTC  |  Edited by: Bob Donovitch
Agent Unknown wrote:
Motre wrote:
fl0pski wrote:
Agent Unknown wrote:
Misha Tokila wrote:
Well, after an amazing uptime record, even with all the updates, something like this was bound to happen. So who can we blame for not feeding the hamster? Now, in all seriousness, assuming that the operating system that is running on the cluster is a form of Unix, is the problem that the hardware will not boot to the OS or is the problem that the EvE Online server program fails to start?

Another, more interesting question is that how is CCP going to compensate us for not being able to play the game?

ISK, SP, or Game Time? I prefer skill points. But then again, that's not my call to make.



There was no way to anticipate the servers having a tantrum


No? How about testing a patch before you apply it?



Uh. How? You do know how big TQ is right? It's almost a supercomputer in its own right. They would need a second TQ to test a patch deployment to ensure it goes cleanly. They have servers to test internally, and I am sure they do, but the moment you start applying it to TQ(with all of its bits, pieces, data and unholy cores) who knows what could happen.

This still isn't as bad as it used to be when they didn't have patch deployments figured out.


You're making it more complex than need be.... all they need do is upgrade from a 286 with 256MB of RAM to a new 386 with 512MB of Ram. Problem solved!

This. The complexity of TQ is what gives uncertainty to the patching process. The process may go fine on the test environments including Singularity/Duality where players have been playtesting the patches for month(s), but sometimes the gremlins don't come out until you expose it to production. I'm sure every programmer in this thread can relate to stuff breaking the moment it hits production and the subsequent scramble to fix it.

And to the people saying "rollback": I'm sure they already tried this, but no one knows the infrastructure so a cascading failure would've done the damage even after a rollback.


You're making it more complex than need be.... all they need do is upgrade from a 286 with 256MB of RAM to a new 386 with 512MB of Ram. Problem solved!
madhatta18
Viziam
Amarr Empire
#980 - 2015-07-15 15:23:08 UTC
does anyone know the stardate that was used when bill gates and microsoft bought out the programming rights to eve patches and up dates ANYONE