These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Information Portal

 
  • Topic is locked indefinitely.
 

Dev Blog: Download-on-Demand Is Coming To Singularity!

First post First post
Author
Previous Topic Next Topic
Sentient Blade
Crisis Atmosphere
Coalition of the Unfortunate
#201 - 2015-03-05 13:47:33 UTC
CCP Atropos wrote:
The first dialog (https://i.imgur.com/fqmh018.png) clearly says at the bottom 'Would you like to configure it now?' The second dialog (https://i.imgur.com/M25WccD.png) allows you to change it, and subsequently asks if you would like to migrate any existing assets you've got.

I'm willing to discus the wording if you think it's unclear. Please give me some ideas you think might work better.


That's cool and all, but personally I would like to see it do as a few other installers do and show a list of hard drives and their available space with a one-click switching between them.

http://i61.tinypic.com/23i72fa.jpg
Vincent Athena
Photosynth
#202 - 2015-03-05 13:59:21 UTC
Part of the problem was at my end. I kept trying different ways to connect, to speed things up. It turns out that the download of the cache is very unforgiving of having your connection changed in the middle. I would:

Start the client
See a really slow download
Change my connection (say, from wireless to Ethernet, or when I went from work to home)
Find the client stops downloading
Have to force quit the client
Restart the client, just to see it sit there, not downloading anything (but still running flat out on one core)
Force quit the client
Find the resource cache, and trash it
Start the client, and hope it finishes before I need to interrupt it.

Eventually, I did get a full download, and I'm on Sisi. Anyway, if I must download 11 gig, that process needs to be more resistant to real world screw-ups.

Also, finding the cache is a challenge. The window that shows you the location is too small. The entire path does not fit, and as its greyed out, you cannot scroll it over to see it all.

Know a Frozen fan? Check this out

Frozen fanfiction
Nolan Kotulan
Nova Tabula Rasa
#203 - 2015-03-05 15:09:44 UTC  |  Edited by: Nolan Kotulan
Started again from scratch.
The new launcher updates correctly and restarts without any problem.

But:

  • I didn't get any dialog box, didn't get any option, nothing...
  • The download is very fast at start and get slower and slower as the time past...
  • The percents are totally out of sync with the downloaded files' size...
  • The download stops again at around 60%...
  • The launcher doesn't freeze again when the download stops, but...
  • ...it freezes when I try to interact with it.


http://i.imgur.com/yDQ2n4l.jpg

So, I still can't log on SiSi anymore...

Edit
Note that if I restart the launcher, download starts again (and has kept already downloaded files as the total download size has been reduced) but freezes stops almost immediatly...

Per aspera ad astra
Ke'Daar
Ministry of War
Amarr Empire
#204 - 2015-03-05 16:47:33 UTC
CCP Maxwell wrote:
Vincent Athena wrote:
"Downloading updates to res cache: (xxx/11.4GB)"

11.4 GB AAAARRRRGGGG!

Edit: The download is going very, very slowly. I'm on a big pipe, so it's not clear what the issue is. But I do notice that eve has one core of my four totally maxed out, during the download. MBP, intel core i7. Its like its too busy doing....something... to do the download in a timely fashion.


Seeing the same issue, and looking into this.


I have the exact same problem as this guy

Edit: On the Mac Client
CCP Snorlax
C C P
C C P Alliance
#205 - 2015-03-05 17:30:55 UTC
I've added a simple command line tool for managing the shared resource cache. This tool can be found in the bin folder under the EVE installation.

You run it from the install folder for EVE, in a command window. Run it with no arguments to show a list of commands (and the current cache location).

The rescache tool has the following commands:

  • verify - scans all the files in the index and calculates the md5 checksum used to verify the contents of the files. If the checksum for any file doesn't match the index, the file is deleted.
  • download - downloads any files listed in the index that are not found in the cache.
  • purge - purges any extra files from the cache.
  • move - moves the rescache to a new location. This moves the folder itself and updates the registry entry the client uses to find the cache.
  • diff - scans the cache against the index and reports the number of files missing and extra files.


Neither the EVE Launcher nor the EVE client should be running while using this tool.

The Python source for this lives in a public GitHub repository: https://github.com/ccpgames/rescache

The tool currently only works for Windows - I'm starting work on Mac support - hopefully this will help us figure out some of the Mac issues we're having in the launcher. If any brave soul out there wants to help with this on the Mac, the source is out there.

I hope this turns out to be a useful tool.

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/
Ayni Naskingar
Axolotl Armageddon
#206 - 2015-03-05 20:50:52 UTC
I don't konw if it is know yet, but when i start the Launcher I get this exception: (Pastebin) When starting the launcher in admin mode I don't get it.
Hizumi Mizushiro
Earth Alliance Expeditionary Force
#207 - 2015-03-06 08:04:01 UTC  |  Edited by: Hizumi Mizushiro
CCP Snorlax wrote:

The tool currently only works for Windows - I'm starting work on Mac support - hopefully this will help us figure out some of the Mac issues we're having in the launcher. If any brave soul out there wants to help with this on the Mac, the source is out there.


Would love to help you test it out; soon as you can figure out how to not depend on the winreg module to fetch rescache path information
CCP Snorlax
C C P
C C P Alliance
#208 - 2015-03-06 09:06:52 UTC
Hizumi Mizushiro wrote:
CCP Snorlax wrote:

The tool currently only works for Windows - I'm starting work on Mac support - hopefully this will help us figure out some of the Mac issues we're having in the launcher. If any brave soul out there wants to help with this on the Mac, the source is out there.


Would love to help you test it out; soon as you can figure out how to not depend on the winreg module to fetch rescache path information

I'm looking into exactly that as we speak!

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/
Hizumi Mizushiro
Earth Alliance Expeditionary Force
#209 - 2015-03-06 09:59:17 UTC  |  Edited by: Hizumi Mizushiro
CCP Snorlax wrote:

I'm looking into exactly that as we speak!



Issue 1:
bypassed winreg module by hardcoding path to rescache

Issue 2:
resfileindex.txt is buried deep inside multi level hidden (in osx at least) paths via multiple application wrappers and the wine/cider windows emulation directories (10 by my count on my .app)

Most users may know how to run python script in terminal - they may not know they need to dig that deep into eve's application.
Suggest adding argv parsing and adding a parameter for osx to request path to eve online.app and manually pathing to the wine/windows eve installation folder.

Result:
verify works (currently on 13000/62780 files)

EDIT:
all files successfully checked

deleted random directory
download works and fetches missing files
re-verify checks out


OS X 10.9.5 on 2011 MPB
CCP Snorlax
C C P
C C P Alliance
#210 - 2015-03-06 10:11:53 UTC
Hizumi Mizushiro wrote:
CCP Snorlax wrote:

I'm looking into exactly that as we speak!



Issue 1:
bypassed winreg module by hardcoding path to rescache

Issue 2:
resfileindex.txt is buried deep inside multi level hidden (in osx at least) paths via multiple application wrappers and the wine/cider windows emulation directories (10 by my count on my .app)

Most users may know how to run python script in terminal - they may not know they need to dig that deep into eve's application.
Suggest adding argv parsing and adding a parameter for osx to request path to eve online.app and manually pathing to the wine/windows eve installation folder.

Result:
verify works (currently on 13000/62780 files)

EDIT:
all files successfully checked

deleted random directory
download works and fetches missing files
re-verify checks out


OS X 10.9.5 on 2011 MPB


Good to hear this is working. I'm sorting out these issues right now, hope to have an update later today.

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/
Gerart en Daire
HY-AE
#211 - 2015-03-06 14:55:01 UTC
Worrff wrote:
A few queries that I hope someone who has carried this out can help with. The Devs stopped monitoring this thread some time ago, as they do.
...


"As they do"... on weekends. The thread was started on the 25th (Wednesday), with regular dev replies until 20:00 UTC on Friday 27th and even one reply on Saturday. Granted, they didn't get back to the thread until Wednesday, which was a bit frustrating.

I was going to ask if they had/why hadn't Salpun and Nolan Katulan tried out my workaround for a crashing launcher/bypassing the launcher completely*, but hopefully the new launcher version and CCP Snorlax's new tool have made the need for that *mostly* obsolete (still need repair.exe --server=sisi if the launcher isn't patching the rest of the game files, since the new tool is only for the cache, I think?).


*Assuming their main goal was to get on Singularity, rather than just troubleshooting the launcher issues.
CCP Snorlax
C C P
C C P Alliance
#212 - 2015-03-06 14:55:21 UTC
The rescache tool described above should now work on the Mac as well. I'll need to investigate the best way of packaging this with the client so you don't have to get it from GitHub.

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/
Amarisen Gream
The.Kin.of.Jupiter
#213 - 2015-03-06 14:57:10 UTC
Would love to try this out, but it seems the link from the Dev Blog for the mac client is 404

"The Lord loosed upon them his fierce anger All of his fury and rage. He dispatched against them a band of Avenging Angels" - The Scriptures, Book II, Apocalypse 10:1

#NPCLivesMatter #Freetheboobs
Sarmatiko
#214 - 2015-03-06 18:50:21 UTC  |  Edited by: Sarmatiko
CCP Snorlax wrote:
I hope this turns out to be a useful tool.

This is really useful tool Bear

Diff result for my cache now:

Scanning index, checking for missing files

No missing files
51372 extra files (8.95GB)

This is exactly what I've suspected, when just after priming cache for the first time (extracted 11 Gb from stuff), launcher started downloading 8.5Gb of new relevant resources. Maybe stuff extracting process was flawed?
CCP Snorlax
C C P
C C P Alliance
#215 - 2015-03-06 20:13:06 UTC
Sarmatiko wrote:
CCP Snorlax wrote:
I hope this turns out to be a useful tool.

This is really useful tool Bear

Diff result for my cache now:

Scanning index, checking for missing files

No missing files
51372 extra files (8.95GB)

This is exactly what I've suspected, when just after priming cache for the first time (extracted 11 Gb from stuff), launcher started downloading 8.5Gb of new relevant resources. Maybe stuff extracting process was flawed?

Yes, embarrassingly enough, the first version of the extraction process produced files with wrong names due to a case sensitivity issue. That has been fixed now.

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/
Salpun
Global Telstar Federation Offices
Masters of Flying Objects
#216 - 2015-03-06 20:38:12 UTC  |  Edited by: Salpun
Gerart en Daire wrote:
Worrff wrote:
A few queries that I hope someone who has carried this out can help with. The Devs stopped monitoring this thread some time ago, as they do.
...


"As they do"... on weekends. The thread was started on the 25th (Wednesday), with regular dev replies until 20:00 UTC on Friday 27th and even one reply on Saturday. Granted, they didn't get back to the thread until Wednesday, which was a bit frustrating.

I was going to ask if they had/why hadn't Salpun and Nolan Katulan tried out my workaround for a crashing launcher/bypassing the launcher completely*, but hopefully the new launcher version and CCP Snorlax's new tool have made the need for that *mostly* obsolete (still need repair.exe --server=sisi if the launcher isn't patching the rest of the game files, since the new tool is only for the cache, I think?).


*Assuming their main goal was to get on Singularity, rather than just troubleshooting the launcher issues.

Singularity access was never the issue it was the launcher/ computer not doing what I expected it to do. Creating a new file header should give me the permissions to add to it but for some reason the computer was not allowing itself to save files into it. Will have to attempt a third cache file to see if the error handling is now clearerBlink.

If i dont know something about EVE. I check https://wiki.eveonline.com/en/wiki/ISK_The_Guide

See you around the universe.
Demolishar
United Aggression
#217 - 2015-03-07 13:47:30 UTC
Does this mean clients will share resource caches, reducing the RAM usage of each individual client?
CCP Snorlax
C C P
C C P Alliance
#218 - 2015-03-07 15:32:13 UTC
Demolishar wrote:
Does this mean clients will share resource caches, reducing the RAM usage of each individual client?

No, this only affects disk usage.

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/
Salpun
Global Telstar Federation Offices
Masters of Flying Objects
#219 - 2015-03-08 20:04:27 UTC  |  Edited by: Salpun
Having issues with the command prompt closing as soon as the rescache program runs. any one else having this issue.

Edit New download.

Launcher version 7066 only down loaded one set of documents but hung at 100% while it deployed the files. Looked like it was doing nothing.

If i dont know something about EVE. I check https://wiki.eveonline.com/en/wiki/ISK_The_Guide

See you around the universe.
Ke'Daar
Ministry of War
Amarr Empire
#220 - 2015-03-09 09:27:58 UTC
Gerart en Daire wrote:
Worrff wrote:
A few queries that I hope someone who has carried this out can help with. The Devs stopped monitoring this thread some time ago, as they do.
...


"As they do"... on weekends. The thread was started on the 25th (Wednesday), with regular dev replies until 20:00 UTC on Friday 27th and even one reply on Saturday. Granted, they didn't get back to the thread until Wednesday, which was a bit frustrating.

I was going to ask if they had/why hadn't Salpun and Nolan Katulan tried out my workaround for a crashing launcher/bypassing the launcher completely*, but hopefully the new launcher version and CCP Snorlax's new tool have made the need for that *mostly* obsolete (still need repair.exe --server=sisi if the launcher isn't patching the rest of the game files, since the new tool is only for the cache, I think?).


*Assuming their main goal was to get on Singularity, rather than just troubleshooting the launcher issues.


Mind helping a fellow Mac user with some detailed instructions on how to use the tool... like what files to get from https://github.com/ccpgames/rescache , where to put them and which ones to run on Mac with the right syntax for running them

I will even say please on my knees