These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
 

How big is the Eve database please?

First post First post First post
Author
5yndr0m3
Deep Core Mining Inc.
Caldari State
#81 - 2014-10-20 19:19:25 UTC
ISD LackOfFaith wrote:
[b]Disclaimer: what follows is a nerd's best guess,

Hope this helps!


Proving once again ISD dont read the threads before they post/lock them.
Arline Kley
PIE Inc.
Khimi Harar
#82 - 2014-10-20 22:15:55 UTC
Jandice Ymladris wrote:
that feels story.


The Program yawned into awareness, wondering how long it had been asleep for. A small flashing icon appeared on its screen, which it discounted immediately.

"Damn messages.. " It started the usual rituals it had gotten used to for the last few years: check eve-mail, wallet then market. Open browser, head to the forums. Observe. Repeat.

The blinking appeared again within seconds and in frustration, the program opened the message.

All items sold. Market order closed.

It blinked, re-reading the message over and over again. Was it true? Had it actually been fulfilled after all these years? Immediately, it checked the market; it didn't appear there. It was gone. For the first time in years, the program smiled, leaning back into its chair and letting out a long sigh, closing its eyes in relief.

"Your time, Program, has come."

The voice made the Program sit up violently, turning to the source of it. Stood in the centre of the room was a solitary individual, pale of tone, gaunt and clad in a well fitting black suit and edged in a pale blue light, its eyes a solid black save for emerald green irises.

"Who are you? How did you get in here?" the Program asked, a mild tone of fear and confusion in its voice.

"Your time has come Program. We are the Administrators and We have been observing you for some time." Its voice was monotone, and straight to the point.

"We?" thought the Program, but upon hearing the word Administrators, its cores froze. What had it done? It had heard that the Administrators where the rule makers of the Great Game. Many programs had fallen to the edicts of the Administrators, some exiled into the void while others reappeared under new forms and guises after debating their continued existence. Their rule was harsh, but fair.

"But I have followed your edicts... altered my code when requested. Why have I been targeted for term....?" the Program's voice was panicky, reaching out for the chair arm to stand, only for it to phase through. it leapt upright, only to see its static framework, leant down in a position of sleep.

"Your coding has been observed operating for 7 years, Program. We have run the Scripts and Indexed the Tables. Your coding eluded our attempts to correct it. However, We allowed it to continue. Now that your coding is complete, We are offering you peace in the Binary Halls, your Program to added to the Grand Library. You merely need to follow Us towards it."

The Program was still looking at its framework, seeing it slowly dissipating into the ether, block by block. Eventually the chair was empty, the only evidence of its existence being the screen, which it too, was fading to black, awaiting its next incumbent.

The Administrator stood in silence, awaiting the Program's decision. What felt like an eternity was merely a few ticks on the universal Clock, before the Program nodded, and followed the Administrator towards its final resting place.


===

Been thinking about this all day..

"For it was said they had become like those peculiar demons, which dwell in matter but in whom no light may be found." - Father Grigori, Ravens 3:57

Amose Amanum
Pandemic Horde Inc.
Pandemic Horde
#83 - 2014-11-17 04:09:30 UTC
CCP DeNormalized wrote:


In this market order clean up, we noticed that there is one crazy player that has an open order for 7 years now!!!! Any order expires after 90 days unless you update it...

So this player has been modifying this one order, at least once every 90 days, for the last 7 frickin years!! haha

There are 3 items left in his sell order - I wanted to just go buy them so there wouldn't be such a big gap in ID's :)

I got over ruled on that as well

(i sent a mail to community about this guy saying he (or she?) should get some kinda medal, so we'll see what comes of that)


How many are left now?
Moraguth
Ranger Corp
Vae. Victis.
#84 - 2014-11-17 10:32:35 UTC
I remember way back in the day, around the time that you moved the servers maybe, we got an update saying that TQ had reached 1 ton. How heavy is our darling baby now?

OH! Can we get stats (size and weight) for Sisi too? Is she a sever of 1 box on a rack somewhere all by her lonesome or what? Or does she just run as a dedicated node that responds to a different IP address?

I got a Feature Added!

Stop calling an Abaddon "abba-dawn".  It is "uh-bad-in" dictionary.com/abaddon

Amose Amanum
Pandemic Horde Inc.
Pandemic Horde
#85 - 2014-11-17 12:09:51 UTC
Oh, in case anybody is interested, I have located and purchased what I believe to be one of the remaining three items. I am confident in my knowledge and awaiting confirmation from the seller.

I will be interested to see who is next to solve this. The evidence is all out in public.
virm pasuul
Imperial Academy
Amarr Empire
#86 - 2014-11-17 16:15:57 UTC
I don't know if DeNormalized would be allowed to confirm or deny that you bought the right thing.
One sure thing to do would be to buy the remaining two, given the cost is next to nothing. If DeNormalized and his fellow OCDers at CCP track you down and shower you in beer at fanfest then assume you got it right :)
45thtiger 0109
Pandemic Legion
#87 - 2014-11-17 22:22:41 UTC
This is a great read & best thread I have ever seen for a long time and great response from CCP Big smile

Well done to the OP for this thread Big smile

**You Have to take the good with the bad and the bad with the good.

Welcome to EvE OnLiNe**

Agondray
Avenger Mercenaries
VOID Intergalactic Forces
#88 - 2014-11-17 22:45:48 UTC
HHD space is over rated and only needed when the computers power down and boot up, then it shifts everything over onto RAM for quick access *hence why when you get a computer and it states the OS needs 6GB of RAM and your computer comes with 8GB RAM, that 6GB is what the OS needs to run leaving you with 2GB to run other programs but will only pull those programs from the drive when queued for the information and then sends it to the RAM for operation*

so in short when EVE starts up the data moves from the drives to RAM and occasionally refreshes data *IE your microsoft word autosave or you clicking the save button sends that document data to your HDD and not the RAMso if power loss happens it doesn't vanish.

"Sarcasm is the Recourse of a weak mind." -Dr. Smith

Tappits
Sniggerdly
Pandemic Legion
#89 - 2014-11-18 14:11:40 UTC
I would to know how big the DB for bookmarks will grow now we can see them in space.
ISD LackOfFaith
ISD Community Communications Liaisons
ISD Alliance
#90 - 2014-11-18 15:11:12 UTC
Tappits wrote:
I would to know how big the DB for bookmarks will grow now we can see them in space.

Not at all is my guess. The bookmark icon is already in the client, and on the server it is still the same set of coordinates where the bookmarks are stored. Showing the bookmarks in space is merely a client-side rendering change. There is little to no difference server-side.

ISD LackOfFaith

Captain

Community Communication Liaisons (CCLs)

Interstellar Services Department

I do not respond to Eve Mail or anything other than the forums.

Jandice Ymladris
Aurora Arcology
#91 - 2014-11-18 17:07:08 UTC
ISD LackOfFaith wrote:
Tappits wrote:
I would to know how big the DB for bookmarks will grow now we can see them in space.

Not at all is my guess. The bookmark icon is already in the client, and on the server it is still the same set of coordinates where the bookmarks are stored. Showing the bookmarks in space is merely a client-side rendering change. There is little to no difference server-side.


That's great to know, so the change actually didn't add any meaningful load to the server or database? That's awesome!

Providing a new home for refugees in the Aurora Arcology

ISD LackOfFaith
ISD Community Communications Liaisons
ISD Alliance
#92 - 2014-11-18 17:13:29 UTC
Jandice Ymladris wrote:
ISD LackOfFaith wrote:
Tappits wrote:
I would to know how big the DB for bookmarks will grow now we can see them in space.

Not at all is my guess. The bookmark icon is already in the client, and on the server it is still the same set of coordinates where the bookmarks are stored. Showing the bookmarks in space is merely a client-side rendering change. There is little to no difference server-side.


That's great to know, so the change actually didn't add any meaningful load to the server or database? That's awesome!

I don't work at CCP and have no access to their codebase, so I can't say for sure, but just like adding an option to the right click menu or changing the way bubbles look are purely visual changes that only happen on the client and the server cares little about, so should displaying bookmarks be. The client already knows where the bookmarks are, so the server shouldn't care at all about whether the client shows them or not. It's the same way that raising or lowering your graphics settings does nothing to the game server.

ISD LackOfFaith

Captain

Community Communication Liaisons (CCLs)

Interstellar Services Department

I do not respond to Eve Mail or anything other than the forums.

Ashlar Maidstone
MoonFyre BattleGroup Holdings
#93 - 2014-11-19 03:04:47 UTC
HI! Just thought I say I found this to be very informative and educational! I had often wonder just how big the data base was for Eveonline and can attest to the fact that it's HUGE!!

Thanks for a great read!!Big smileBig smileBig smileBig smileBig smile
Asayanami Dei
Adhocracy Incorporated
Adhocracy
#94 - 2014-11-19 05:12:51 UTC
Today I learned that TQ could fit on my home PC's HDD. Also, what a bunch of nerds you guys are Roll

I'm a leaf on the wind, watch how I--THE CAPACITOR IS EMPTY

Youtube: /asayanami

Twitter: @asayanami

wormholefundamentals.com

Amose Amanum
Pandemic Horde Inc.
Pandemic Horde
#95 - 2014-12-09 11:47:24 UTC
Since the CREST market data is now available on Tranquility, I expect this will become public knowledge soon, and I want the bragging rights for figuring it out weeks ago ;)

The oldest current sell order in Eve is for a pair of Quad Light Beam Laser II on sale at Karan VIII - Royal Amarr Institute School. The vendor is Kroma BaSyl. The sell order ID is 537910304, placing its vintage at around October 2007. I purchased the third-last one to verify these details, then notified Kroma so he could jack up the price from 1.6m to 165m.
Rekindle
Federal Navy Academy
Gallente Federation
#96 - 2014-12-09 12:35:45 UTC  |  Edited by: Rekindle
CCP DeNormalized wrote:
DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...

We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.

We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total.



ive always been impressed that you picked MSSQL. Your partioning scheme must be insane.
CCP DeNormalized
C C P
C C P Alliance
#97 - 2014-12-09 21:40:28 UTC
Amose Amanum wrote:
Since the CREST market data is now available on Tranquility, I expect this will become public knowledge soon, and I want the bragging rights for figuring it out weeks ago ;)

The oldest current sell order in Eve is for a pair of Quad Light Beam Laser II on sale at Karan VIII - Royal Amarr Institute School. The vendor is Kroma BaSyl. The sell order ID is 537910304, placing its vintage at around October 2007. I purchased the third-last one to verify these details, then notified Kroma so he could jack up the price from 1.6m to 165m.



nice work Amose!

CCP DeNormalized - Database Administrator

CCP DeNormalized
C C P
C C P Alliance
#98 - 2014-12-09 21:45:30 UTC
Rekindle wrote:
CCP DeNormalized wrote:
DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...

We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.

We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total.



ive always been impressed that you picked MSSQL. Your partioning scheme must be insane.



For us, the only thing we use partitions for are sliding window deletes on sequential log tables.

Being able to simply swap out a huge number of rows covering the date range and drop that with almost no IO is great.



CCP DeNormalized - Database Administrator

Theodoric Darkwind
The Scope
Gallente Federation
#99 - 2014-12-09 22:07:44 UTC
CCP DeNormalized wrote:
DB is currently around 2.8 TB, 2 weeks ago it was 3 TB...

We do routine archiving to pull old log records, etc... out to separate databases in an attempt to run as lean as possible.

We also have difference services (sso/vgs/images) in different DB's, so while the core DB itself is around 2 TB (2.8 w/ free space in files for growth), the entire stack is closer to 5-6 TB total.


That is quite a bit smaller than I was expecting, but I can see why it gets archived regularly, performance would suffer after while if it kept growing (that and storage costs would get excessive).

I have seen MUCH bigger, at the datacenter I work at we have a colo customer with 6 petabytes stored onsite.
Altessa Post
Midnight special super sexy
#100 - 2014-12-09 23:02:54 UTC
Interesting read, thank you very much!

(I have been several times at fanfest but this is the first time I hear about an admin round table. Dang...)

On the internet, you can be whatever you want to be. It is amazing that so many people chose to be stupid.