These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Information Portal

 
  • Topic is locked indefinitely.
 

Dev blog: Tranquility Tech III

First post First post
Author
Previous Topic Next Topic
Arline Kley
PIE Inc.
Khimi Harar
#21 - 2015-10-13 17:23:50 UTC
Delicious, delicious tech filth.

I'll have a word with my boss about hopefully getting our servers updated to EXSi version 6... and goddamn what I would give to work there.

"For it was said they had become like those peculiar demons, which dwell in matter but in whom no light may be found." - Father Grigori, Ravens 3:57
Master Degree
I dont want to pay taxes
#22 - 2015-10-13 17:35:44 UTC  |  Edited by: Master Degree
as a IT pro, from experience i can tell that high IO SQL DB running in M$ Failover cluster @ vmware is not the best choice, rather go SQL always on, more storage needed, agree, but failovers are much easier (and much faster).. and you can replicate more times eg active, replica 1, replica 2 etc, can use one of the replica for reads and dont bother with operations on active writting db .. only thing what can be problem is switching of listener between nodes during sudden HW crash or vmotion (MAC address conflict in vmware 5.0, hope they fix it in 6.0 while running vmotion on loaded hosts)

eventually switch to hyper-v (core preferably due patches), license is cheaper as esx(i), but the downside is, that hyper-v is with features at least two releases behind vmware (if you dont pay huge money for scvmm)


just my 5 cents, i assume you made the math already :-)

PS: really nice HW, just vendor is not one of my favorites :)
Beta Maoye
#23 - 2015-10-13 17:44:07 UTC
Awesome hardware.

Is TQ T3 ready to host hundreds of player built structures in every star system of New Eden?
Chribba
Otherworld Enterprises
Otherworld Empire
#24 - 2015-10-13 17:46:16 UTC
Nom nom nom! Really yummy! Great work guys!

/c

★★★ Secure 3rd party service ★★★

Visit my in-game channel 'Holy Veldspar'

Twitter @ChribbaVeldspar
CCP Gun Show
C C P
C C P Alliance
#25 - 2015-10-13 17:52:14 UTC
Gilbaron wrote:
CCP Gun Show wrote:
Rebekah Aivo wrote:
I don't know that I'd say that they ditched Cisco, just that they ditched Cisco at the LB layer.

I'd imagine that they're probably using Cisco Nexus switches for the core switching, and beefy F5s (I'd guess Viprion over LTM, but...).

Definitely some good geek porn here for sure :D

I hope to GOD we're using ESXi 5.5... it's the hotness.


We are actually going with version 6.0 on ESXi Blink


how come you don't have a dev tag?


Fixed , as this is my first blog and first time i had my account active on the forums so tiny hiccup in the registration Cool
l0rd carlos
the king asked me to guard the mountain
#26 - 2015-10-13 18:08:00 UTC
Quote:
What you see here are 2x IBM SAN volume controllers which govern and control 2x IBM V5000 controllers which store all the data with 3x expansion shelves that house 9x800 GB SSD's with a grand total of 83x 1.2TB 10K SAS disks.


I don't get this. The sentence make it sound like the SSDs have SAS disks build in :D That can't be right.

Youtube Channel about Micro and Small scale PvP with commentary: Fleet Commentary by l0rd carlos
Amarisen Gream
The.Kin.of.Jupiter
#27 - 2015-10-13 18:14:51 UTC
my poor little brain cells now hurt.


but i'm drooling with excitement.

"The Lord loosed upon them his fierce anger All of his fury and rage. He dispatched against them a band of Avenging Angels" - The Scriptures, Book II, Apocalypse 10:1

#NPCLivesMatter #Freetheboobs
TheMercenaryKing
Collapsed Out
Pandemic Legion
#28 - 2015-10-13 18:16:58 UTC
l0rd carlos wrote:
Quote:
What you see here are 2x IBM SAN volume controllers which govern and control 2x IBM V5000 controllers which store all the data with 3x expansion shelves that house 9x800 GB SSD's with a grand total of 83x 1.2TB 10K SAS disks.


I don't get this. The sentence make it sound like the SSDs have SAS disks build in :D That can't be right.


Likely it is a tiered system with 9 SSDs and 83 10k drives.
virm pasuul
Imperial Academy
Amarr Empire
#29 - 2015-10-13 18:18:55 UTC
Thanks for the tech porn :)

Still single thread server code?
virm pasuul
Imperial Academy
Amarr Empire
#30 - 2015-10-13 18:21:43 UTC
I have fallen in love with ESXi 5.5
My windows boxes run better on 5.5 than on metal, that still amazes me. If I had a time machine and could go back in time and tell old me that win server runs better on ESX than on bare metal old me would call bull and refuse to believe time travelling me, but it's true.
Guillame Herschel
Buffalo Soldiers
#31 - 2015-10-13 18:23:12 UTC
Quote:
...what could possibly go wrong?!


Beware of vSwitch.
CCP Gun Show
C C P
C C P Alliance
#32 - 2015-10-13 18:23:38 UTC
TheMercenaryKing wrote:
l0rd carlos wrote:
Quote:
What you see here are 2x IBM SAN volume controllers which govern and control 2x IBM V5000 controllers which store all the data with 3x expansion shelves that house 9x800 GB SSD's with a grand total of 83x 1.2TB 10K SAS disks.


I don't get this. The sentence make it sound like the SSDs have SAS disks build in :D That can't be right.


Likely it is a tiered system with 9 SSDs and 83 10k drives.


yes its tiered so hot data resides on SSD's and SAS takes the cold data

does that answer your question ?

Sad
virm pasuul
Imperial Academy
Amarr Empire
#33 - 2015-10-13 18:28:49 UTC
One thing to watch out for CCP is default memory interleaving settings in the BIOS.
I don't know if this is true for IBM, but for Dell out of the box, memory interleaving is turned off, which drops memory performance by a factor of 3 on quad path interconnect processors ( 3 not 4 because one is processor to processor ).
Also Dell default mem config is NOT optimised to use interleaved memory, so you have to be careful how you choose your physical memory config and load the paths.
I imagine IBM are much more on the ball than Dell on this front, but it's worth checking.
l0rd carlos
the king asked me to guard the mountain
#34 - 2015-10-13 18:32:41 UTC
CCP Gun Show wrote:


yes its tiered so hot data resides on SSD's and SAS takes the cold data

does that answer your question ?

Sad

Yes, thank you :-*

Youtube Channel about Micro and Small scale PvP with commentary: Fleet Commentary by l0rd carlos
Alyxportur
From Our Cold Dead Hands
ORPHANS OF EVE
#35 - 2015-10-13 18:51:40 UTC
I take it this means that the lag when making contracts, opening the market/any window, etc. will be reduced/gone, but will this also reduce the number of 'Socket Closed' events?

It would be interesting to see numerical statistics (not a line chart or diagram, please) on the instances and magnitude of each TIDI occurence for (1) a year pre-Phoebe, (2) the time between Phoebe and Aegis, and (3) post-Aegis until now.
Bienator II
madmen of the skies
#36 - 2015-10-13 19:08:37 UTC
i send you a floppy disk to backup my char

how to fix eve: 1) remove ECM 2) rename dampeners to ECM 3) add new anti-drone ewar for caldari 4) give offgrid boosters ongrid combat value
tasman devil
Puritans
#37 - 2015-10-13 19:21:30 UTC
CCP Phantom wrote:
The Tranquility server cluster is a powerful machine, enabling you to create the biggest living universe of science fiction with the most massive spaceship battles mankind has ever seen.

But you know what is even better than Tranquility? Tranquility Tech III!

Our engineers are working hard to fully revamp the server cluster with new hardware, with new storage, with new network connections, with a new location and new software. TQ Tech III will be much better than the already astonishing current TQ server.

Read more about this marvel of technology (including tech specs and pictures) in CCP Gun Show's latest blog Tranquility Tech III.


And all this is planned for very early 2016! EVE Forever!

Many thanks to the folks who wrote this Dev Blog. It is a truly good read!

I do hope it'll be an "OP SUCCESS!" :-)

And do please take pictures.

I don't belive in reincarnation I've never believed in it in my previous lives either...
xrev
Brutor Tribe
Minmatar Republic
#38 - 2015-10-13 20:16:21 UTC  |  Edited by: xrev
San storage enthousiast here :)

Keep in mind before upgrading from 4 or 8 Gbps to 16 Gbps to check the available and used buffer credits in combination with the average transmitted package size. Default FC frame size is supposed to be 2112 bytes and uses 1 buffercredit to transmit. With the increased speed, more buffercredits are used to fully utilize the line. When they're used, nothing will be transmitted until buffers are freed up.
Had a customer some time ago who had upgraded the linespeed and in combination with synchronous storage replication, production came to a halt because of the switches running out of buffers.

So CCP, please double check the framesizes and buffercredits before upgrading the speed ;)

Oh, just reminded, Iirc, the 48B-5 switches have 2 Condor3 asics, dividing the 48 ports in 0-23 on Asic1, and 24-47 on asic2. Keep in mind there's a default oversubscription on the asics of 1.5:1. So make sure to distribute the FC ports of a host evenly over both asics to control the performance :)

Cool stuff though. Make pictures when it arrives in the datacenters!
Ix Method
Doomheim
#39 - 2015-10-13 20:27:07 UTC
Volcano-powered Singularity.

Yes.

Travelling at the speed of love.
CCP Gun Show
C C P
C C P Alliance
#40 - 2015-10-13 20:30:35 UTC
Ix Method wrote:
Volcano-powered Singularity.

Yes.


we are thinking about renaming Singularity to Eyjafjallajökull Big smile

kidding