These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Information Portal

 
  • Topic is locked indefinitely.
 

New dev blog: Generic Patcher and Multi payload installer

First post
Author
Dennie Fleetfoot
DUST University
#21 - 2011-10-12 18:05:56 UTC
You see CCP? This sort of under the hood but beneficial fixing of problems is what we want before you start selling us bling. The last few dev blogs have been very promising in terms of what Hilmars letter of contrition a few days ago said was coming. I'm actually beginning to believe that there is a real change in priorities up there in Iceland. Keep it up.

CEO Dust University

CPM 1&2 Member

www.twitter.com/DennieFleetfoot

Taedrin
Federal Navy Academy
Gallente Federation
#22 - 2011-10-12 18:10:35 UTC
Xyfu wrote:
DOES IT STILL ******* DOWNLOAD TO C:\, COMPLETELY IGNORING DISK SPACE REQUIREMENTS AND LOGIC?

**** that aspect of every single patcher/installer so far. My C:\ drive is 11GiB in size, and has 200MiB free. My \temp is on X. My %appdata% is on D:\.

On that note, why can't I move the ******* cache? I can only log in on one account at a time due to disk space requirements on C:\. Pain in the ****.


A workaround to this problem is to using "Junction Points" or "Symbolic Links" to re-route a folder on the C: drive to a filesystem on another partition or disk.

This effectively "tricks" the installer into using a different drive. A nasty side effect to this is that if a program calculates disk space, it will calculate disk space for the wrong disk (programs presume that a folder on the C: drive is restricted by the amount of space left on the C: drive. Symbolic Links/Junction Points break the integrity of this assumption)
Blue Harrier
#23 - 2011-10-12 18:15:53 UTC
Sarmatiko wrote:
So is there any ETA when "this is launcher it is the greatest" roll out from your forges? Cool

Also my feedback for installer:user should be able to choose the location for downloaded files (other than default C:\ProgramData\CCP\EVE\downloads)
Many times new players complain because they do not have enough space on system drive, and the only option they have is to redownload the whole fallback installer.

I would put this as a priority, having a default but selectable download location is mandatory for this game now.

Some of us like to have a small (or even FAT32) C: drive just in case a virus or Microsoft update causes a major problem with the operating system, it is then easy to wipe and re-install without loosing all our work etc.

My download manager always has a default to a selectable location and will ask and check if you would like to change this before a download commences, please put this in soonest.

"You wait - time passes, Thorin sits down and starts singing about gold." from The Hobbit on ZX Spectrum 1982.

Sarmatiko
#24 - 2011-10-12 18:32:10 UTC
Taedrin wrote:
A workaround to this problem is to using "Junction Points" or "Symbolic Links" to re-route a folder on the C: drive to a filesystem on another partition or disk.

Can yo scratch your ears with your legs? Big smile Why would newbie (and most important new customer, sometimes total dummy in PC internal stuff) do such horrible exotic thing as "junction point"? Don't you think it's easier for developer to put standard form field in the installer window?
Or even better, installer can check free space on system drive first and then prompt new download folder if there is not enough space left. Basic stuff Straight
serine twilight
Hobgoblin Marketeers
#25 - 2011-10-12 18:45:15 UTC
I would like to see a md5/SHA-1 for the offline exe installer/7z dumps, also if you want, a torrent would be even better. you could use 2 very legal and free open source trackers:

udp://tracker.publicbt.com:80/announce

udp://tracker.openbittorrent.com:80/announce

with superseeding ensuring that everyone could download Eve online.

I don't know about everyone else, but i would seed forever.
steave435
Perkone
Caldari State
#26 - 2011-10-12 19:15:02 UTC
Nice :)
I'm assuming that when the actual install starts, the installer first installs one of the payloads, followed by the second one? If so, would this make it possible to enable you to start installing the first payload while the second one is still downloading?
Chribba
Otherworld Enterprises
Otherworld Empire
#27 - 2011-10-12 19:25:32 UTC
Should be interesting to see where this goes.

/c

★★★ Secure 3rd party service ★★★

Visit my in-game channel 'Holy Veldspar'

Twitter @ChribbaVeldspar

Crasniya
The Aussienauts
#28 - 2011-10-12 19:52:57 UTC  |  Edited by: Crasniya
Xyfu wrote:
DOES IT STILL ******* DOWNLOAD TO C:\, COMPLETELY IGNORING DISK SPACE REQUIREMENTS AND LOGIC?

**** that aspect of every single patcher/installer so far. My C:\ drive is 11GiB in size, and has 200MiB free. My \temp is on X. My %appdata% is on D:\.

On that note, why can't I move the ******* cache? I can only log in on one account at a time due to disk space requirements on C:\. Pain in the ****.


... The only possible explanation I have for this, is that you, or whoever set up your machine, partitioned your hard drive like an idiot. No C:\ drive where Windows XP or newer is installed should be less than 20 GB. When Windows XP came out, 20 GB hard drives weren't even available, so really you should have a C:\ drive of 60 GB or more. My C:\ drive is 2 TB, but that's how I roll.

Unfortunately, CCP can't save you from yourself.

Soraya Xel - Council of Planetary Management 1 - soraya@biomassed.net

mkint
#29 - 2011-10-12 20:59:52 UTC
My concern isn't so much how things get patched and downloaded (i've never had a problem before except with sisi, and sisilauncher.exe made that much better.) I'm more concerned with WHY exactly the download is 4.5 gigs? Wasn't the download something like 200 megs a few short years ago? Looks like a lot of bloat to me. I would be interested in seeing a graph of the download size since launch (maybe overlayed with a graph of the installed+cache size.) Maybe also overlay that with a graph of standard $ cost of disk space over the same time period, and the cost of internet bandwidth. Would also be interesting to mark the graph with major expansions and patches (let the players come to a conclusion for themselves if the bloat has been worth it.)

Maxim 6. If violence wasn’t your last resort, you failed to resort to enough of it.

CCP Atropos
C C P
C C P Alliance
#30 - 2011-10-12 21:43:13 UTC
mkint wrote:
My concern isn't so much how things get patched and downloaded (i've never had a problem before except with sisi, and sisilauncher.exe made that much better.) I'm more concerned with WHY exactly the download is 4.5 gigs? Wasn't the download something like 200 megs a few short years ago? Looks like a lot of bloat to me. I would be interested in seeing a graph of the download size since launch (maybe overlayed with a graph of the installed+cache size.) Maybe also overlay that with a graph of standard $ cost of disk space over the same time period, and the cost of internet bandwidth. Would also be interesting to mark the graph with major expansions and patches (let the players come to a conclusion for themselves if the bloat has been worth it.)


4.5GB is the compressed size, it's roughly twice that on disk. You can see for yourself by navigating to you EVE install. Most of it is art assets, with a few hundred megabytes for audio and video. The actual code and binary part of the game is ~100MB. The unpacked size of the client is about average for a lot of the high level visual fidelity MMO's; as an example here are some comparable metrics, taken from the relevant "minimum system requirements" pages on the providers webpages:

  • World of Warcraft: 25GB
  • Lord of the Rings Online: 7GB
  • Rift: 8GB


There are of course others to which this doesn't apply, such as League of Legends, who have a 750MB requirement, but I hope you would agree that the visuals are vastly different in both games and so you can't really compare the fidelity of them and space requirements.

It's just the cost that comes from continued improvement. I've no doubt the installer size will increase as time goes forward, sorry! Smile
Sarmatiko
#31 - 2011-10-12 21:55:40 UTC
Crasniya wrote:
... The only possible explanation I have for this, is that you, or whoever set up your machine, partitioned your hard drive like an idiot.

Dude, don't judge others by yourself.
If game installer failed free space check and failed install process - that is bad installer, not the bad customer.
"Stupid users" it's not the right excuse for bad design when you trying to increase your playerbase. You must deal with all scenarios or user will drop EVE without even trying .
CCP Atropos
C C P
C C P Alliance
#32 - 2011-10-12 21:56:40 UTC
Also I should point out, whilst the technology mentioned in this blog has been out for a few months now, and used by many people, it isn't the final piece of the puzzle when it comes to installing and patching; we're constantly working on improvements, such as multi language language support for the installer, patcher and Repair Tool, as well as general performance improvements for them as well.

There's also other, blue-sky-concepts that we can look into and work on, such as BitTorrent support and staged installation of the client, but more on these once there's something to show Smile
Ten Bulls
Sons of Olsagard
#33 - 2011-10-12 22:05:42 UTC
Does it work under Wine ?
CCP Atropos
C C P
C C P Alliance
#34 - 2011-10-12 23:01:36 UTC
It's not something we've tested so you will have to tell me Smile. I think someone said that the Repair Tool did, and the Generic Patcher is largely the same technology, so you should be ok, although it's not a supported platform, and so we've not spent any cycles testing it out I'm afraid.
Sedrie
Apple Industries Inc.
#35 - 2011-10-13 03:21:55 UTC  |  Edited by: Sedrie
Largo Coronet wrote:
YO SON I HEARDS YOU LIKE TO PATCH SOS I GOTS YOU A PATCH FOR YOUR PATCH SOS YOU CAN PATCH YOUR PATCH WHILE YOU PATCHQuestion

Seriously, nice work trying to streamline the mess.


You ******. I had to log in so I could like this post.
DeLaBu
CAF Industries
#36 - 2011-10-13 05:07:20 UTC
Xyfu wrote:

On that note, why can't I move the ******* cache? I can only log in on one account at a time due to disk space requirements on C:\. Pain in the ****.


Can't help with your other questions, but there is a good work around under Vista/Windows 7.

Disclaimer : Use these steps at your own risk - make a backup of everything if you are afraid of losing stuff.

1. Make sure the game is shut down.
2. Copy the whole cache to another folder, let's call this NEWFOLDER
3. Copy the path to the current cache folder to your clipboard, let's call this OLDFOLDER
4. DELETE the current cache folder
5. Open an elevated command prompt (Click Start, search for cmd, right click, run as administrator)
6. Type the following: mklink /D OLDFOLDER NEWFOLDER

You have now created a symbolic link to your new cache folder. You new cache folders now resides in NEWFOLDER (eating space there) but is still available where EVE expects it.

As an example, here are the instructions with my folder paths:
1. Make new cache folder at e:\data\evecache
2. Copy the content of old cache folder at C:\Users\admin\AppData\Local\CCP\EVE to e:\data\evecache
3. DELETE C:\Users\admin\AppData\Local\CCP\EVE
4. Open elevated cmd prompt and type mklink /D C:\Users\admin\AppData\Local\CCP\EVE e:\data\EVEcache

NOTE : The cache resides in a hidden folder C:\Users\admin\AppData, to get there, navigate to C:\Users\admin, then manually add the \AppData to your explorer address or change your explorer settings to show hidden folders.
Sturmwolke
#37 - 2011-10-13 06:27:13 UTC
I think you need a better name for the generic patcher, something that stands out.
For god's sake man, this is real space pixel we're talking about. Where's your sense of flair and style?

Let me start, how about :

FixMe™

or

WorkingDisaster™

or

WarpDriveInactive™

or

Alice™ ... I like the sound of Alyssandra™ better though.

Big smile
M1AU
Zappenduster Inc.
#38 - 2011-10-13 06:52:19 UTC
Ten Bulls wrote:
Does it work under Wine ?


I'd like to know that too!
Tairon Usaro
G-Fleet Alpha
#39 - 2011-10-13 07:42:47 UTC
Good Move !
As far as i understand this is well established methodology from SISI .... but it fits well for Liveserver as well.

Nevertheless i would suggest that you provide a third mode for updating:

1.) updater retrieves installed client version number and checks with the currently active version code from CDN
if they match => no update needed installed version is valid

This what the updater already does to my understanding

if they dont match => my proposal would be, the CDN checks if the submitted to-be-updated version is already known by it, meaning there is already the list of blocks known how to patch version A into the currently valid version B

if the list of blocks is already known the CDN sends it to the updater. The updater doesn't need to do the checksum analysis and doen't need to build the list for data blocks to be requested, but simply takes the list of patch blocks from the CDN

if the list of blocks is not already known for the specific version to be updated by CDN, then the updater behaves the same as SISI updater/repair does. It does it full file checksum analyses, verifies it with checksums lists from CDN and build a list of blocks to be requested and patched into the old version to update it to current.
In addition to patching the updater sends the block list for patching version A to B to CDN, so the next user doesnt need to it anymore and gets the block list from CDN server


Why should you implement this ?
cause doing the checksum analysis takes quite lot time, which for minor patches exceeds the download for the patch blocks.
You dont have to borther with 20 version patch builds or block lists anymore, this gets created by the users themself.

and if the strategy fails and CDN provides the wrong block list for whatever reason there is still method 3 of bruteforce analysis by the updater and creating its own block list.
Floydd Heywood
Doomheim
#40 - 2011-10-13 07:50:28 UTC
Nice. But I noticed some while ago that you can always use the repair tool to patch the game. Regardless of whether your installation is broken or you're just missing a patch, just fire up the repair tool and it will download the files that are missing, corrupt or outdated.

Some time ago I had constant problems with crashes that left my client corrupted. The 'generic patcher' ability of the repair tool saved me a lot of bandwidth.

So it isn't really new, but still nice.