These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Information Portal

 
  • Topic is locked indefinitely.
 

Dev Blog: Download-on-Demand Is Coming To Singularity!

First post First post
Author
CCP Snorlax
C C P
C C P Alliance
#221 - 2015-03-09 11:13:23 UTC  |  Edited by: CCP Snorlax
Ke'Daar wrote:


Mind helping a fellow Mac user with some detailed instructions on how to use the tool... like what files to get from https://github.com/ccpgames/rescache , where to put them and which ones to run on Mac with the right syntax for running them

I will even say please on my knees

No need to get down on your knees.

I'm not much of a Mac user, so if somebody with more experience would chime in with better instructions, I'd be most grateful.

On the github page linked above, you should see a 'Download ZIP' button on the right hand side. Download and extract the files to a folder - when I tried this in Chrome, it put the file in my Downloads folder and extracted to rescache-master.

Open up a terminal window, change the directory to the rescache-master folder and run 'python rescache.py'.

Use the -i option to tell the tool what resource index file to use - it can either be the full path to the resfileindex.txt in the EVE installation, or simply the name of the app under the Applications folder, for example:

To verify the integrity of files in the cache:
python rescache.py -i "EVE Online Sisi.app" verify


To download any files missing from the cache:
python rescache.py -i "EVE Online Sisi.app" download


To purge any extra files from the cache:
python rescache.py -i "EVE Online Sisi.app" purge

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/

Ke'Daar
Ministry of War
Amarr Empire
#222 - 2015-03-09 12:25:25 UTC
CCP Snorlax wrote:
Ke'Daar wrote:


Mind helping a fellow Mac user with some detailed instructions on how to use the tool... like what files to get from https://github.com/ccpgames/rescache , where to put them and which ones to run on Mac with the right syntax for running them

I will even say please on my knees

No need to get down on your knees.

I'm not much of a Mac user, so if somebody with more experience would chime in with better instructions, I'd be most grateful.

On the github page linked above, you should see a 'Download ZIP' button on the right hand side. Download and extract the files to a folder - when I tried this in Chrome, it put the file in my Downloads folder and extracted to rescache-master.

Open up a terminal window, change the directory to the rescache-master folder and run 'python rescache.py'.

Use the -i option to tell the tool what resource index file to use - it can either be the full path to the resfileindex.txt in the EVE installation, or simply the name of the app under the Applications folder, for example:

To verify the integrity of files in the cache:
python rescache.py - i "EVE Online Sisi.app" verify


To download any files missing from the cache:
python rescache.py - i "EVE Online Sisi.app" download


To purge any extra files from the cache:
python rescache.py - i "EVE Online Sisi.app" purge





Thank you kind Sir. It works, however it took me a wee bit to realise there should not be a space between the "-" and the "i" after rescache.py like it is in you post
CCP Snorlax
C C P
C C P Alliance
#223 - 2015-03-09 12:54:02 UTC
Ke'Daar wrote:

Thank you kind Sir. It works, however it took me a wee bit to realise there should not be a space between the "-" and the "i" after rescache.py like it is in you post

Doh, sorry about that - don't know how that happened...

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/

Amak Boma
Dragon Factory
xX SERENITY Xx
#224 - 2015-03-09 23:59:13 UTC  |  Edited by: Amak Boma
Gerart en Daire wrote:
Yup, file junction seems to work like a charm. Didn't go past the character selection screen yet, but I have 0 MB in C:\ProgramData\CCP\ where the link/junction is, and 300MB DoD'd to D:\EVEsharedCache, which is were I pointed the link.

So, to anyone else who's having their launcher crash, either directly and/or when they try to adjust the settings to move the cache away from C:, try the following:
  1. In your EVE singularity folder (make a copy of the tranquility folder and rename it to something else), create a shortcut of the repair.exe, modify the target line to be ...\repair.exe --server=sisi
  2. Run the modified repair shortcut, this will patch the Singularity folder to the newest Singularity version, instead of using the launcher to do it.
  3. Go to \bin\ in your Singularity folder, create a shortcut to exefile.exe (and you may want to move it up one folder level to the Singularity root folder), modify the target line to read ...\bin\exefile.exe /server:Singularity
  4. At this point you can run the exefile and check that you can login and get to the character selection screen. This will also start downloading the basic stuff (low res ship models etc.) to the cache in C:, but it shouldn't fill up gigabytes in seconds, so no worries.
  5. Go to C:\ProgramData\CCP\. The path continues with \EVE\SharedCache\ResCache\ and 256 hexadecimal-numbered subfolders, if you started up Singularity with the exefile as advised in the previous point. You can now delete the \EVE\ folder and all subfolders+contents.
  6. Open the Windows command prompt, doesn't matter what the current location is, type:
    mklink /J C:\ProgramData\CCP\EVE\ D:\EVEsharedCache
    (feel free to substitute another target instead of D:\EVEsharedCache)
  7. Go to D: and create the folder D:\EVEsharedCache, if you hadn't earlier (again, feel free to chose another location/name).
  8. Use the exefile shortcut to start up EVE again, DoD should be downloading filed to the new folder, with 0 space being taken up in C:\ProgramData\CCP. And you can now play on Singularity, and test how DoD works for you (do you get lag, do some resources take strangely long to download or are corrupted, etc). *huzzah*


getting this error when shortcut of repair.exe with -server=sisi command . when using /server:singularity it asks for 12gb patch which my mobile internet wont be able to support as its limited to 6 gb per month. what now.

Build folder info:
__name__: main
version: 8.53
build: 867850
codename: EVE-2015-CLAUDETTE
region: ccp
cryptopack: CryptoAPI
sync: 867850
branch: //eve/branches/staging/2015-CLAUDETTE
appname: EVE
usescriptindexfiles: 1
socketio: iocp
server: Tranquility
edition: premium
role: client
aid: 0
resfromstuffonly: 0
port: 26000
Traceback (most recent call last):
File "repairTool\progressPanel.pyc", line 82, in _TaskRun
File "repairTool\repairUI.pyc", line 97, in Start
File "repairTool\repairLogic.pyc", line 199, in Repair
File "repairTool\repairLogic.pyc", line 331, in Restore
File "repairTool\repairLogic.pyc", line 398, in GetRepairUrl
File "repairTool\repairTools.pyc", line 185, in GetServerBuildNumber
File "repairTool\repairTools.pyc", line 146, in SafeUrlOpen
TypeError: __init__() takes exactly 6 arguments (2 given)
Total Runtime: 0h00m01s
Tarpedo
Incursionista
#225 - 2015-03-10 02:24:19 UTC  |  Edited by: Tarpedo
CCP Atropos wrote:
I deployed an updated version of the EVE Launcher to Singularity. It should fix those of you on XP crashing. There's also improvements to some of the feedback, as well as the initial introduction to download on demand. You can trigger the first time popups via the /runfirsttimesetup command line argument.

For those who can't start the EVE Launcher you can download the installer from here: http://cdn1.eveonline.com/EveOnlineLauncher/beta/EVEOnlineLauncher_2_2_867066.exe


This thing has asked something in French and then rewritten standard EVE launcher. Now I have to delete EVE installation and redownload it because standard launcher cannot be installed into non-empty directory. Good reason to uninstall EVE completely.

By the way - I've started this procedure because on Sisi captain quarters didn't work at all after installing DoD client on top of copied TQ client.
Ke'Daar
Ministry of War
Amarr Empire
#226 - 2015-03-10 06:07:46 UTC
CCP Snorlax: I have one more question for you...

Now that I am merely downloading all 13G of shared cache, am I set for when this goes to TQ?, or would I be obliged to download it all again?

Asking from a country where slow expensive broadband is the norm...


Yes yes I know.. there are actually still such countries out there
CCP Atropos
C C P
C C P Alliance
#227 - 2015-03-10 13:48:17 UTC
Tarpedo wrote:
CCP Atropos wrote:
I deployed an updated version of the EVE Launcher to Singularity. It should fix those of you on XP crashing. There's also improvements to some of the feedback, as well as the initial introduction to download on demand. You can trigger the first time popups via the /runfirsttimesetup command line argument.

For those who can't start the EVE Launcher you can download the installer from here: http://cdn1.eveonline.com/EveOnlineLauncher/beta/EVEOnlineLauncher_2_2_867066.exe


This thing has asked something in French and then rewritten standard EVE launcher. Now I have to delete EVE installation and redownload it because standard launcher cannot be installed into non-empty directory. Good reason to uninstall EVE completely.

By the way - I've started this procedure because on Sisi captain quarters didn't work at all after installing DoD client on top of copied TQ client.


You can also reinstall the TQ version of the EVE Launcher from here http://cdn1.eveonline.com/EveOnlineLauncher/release/EVEOnlineLauncher_2_2_859950.exe
CCP Atropos
C C P
C C P Alliance
#228 - 2015-03-10 13:56:07 UTC
I'm deploying a new version to Singularity that includes the following fixes:

  • The first time extraction/migration from existing assets now picks up and moves the contents of the 'res' folder (ie: the audio and video assets)
  • Resetting the settings in the settings window works again
  • You will receive a popup warning when trying to change the shared cache directory to a folder that you can't write to (such as Program Files (x86))
  • OSX build now correctly runs the first time extraction/migration


You can manually install it from this here: http://cdn1.eveonline.com/EveOnlineLauncher/beta/EVEOnlineLauncher_2_2_868398.exe
Vincent Athena
Photosynth
#229 - 2015-03-10 18:21:22 UTC
CCP Snorlax wrote:

On the github page linked above, you should see a 'Download ZIP' button on the right hand side. Download and extract the files to a folder - when I tried this in Chrome, it put the file in my Downloads folder and extracted to rescache-master.

Open up a terminal window, change the directory to the rescache-master folder and run 'python rescache.py'.

Use the -i option to tell the tool what resource index file to use - it can either be the full path to the resfileindex.txt in the EVE installation, or simply the name of the app under the Applications folder, for example:

To verify the integrity of files in the cache:
python rescache.py -i "EVE Online Sisi.app" verify


To download any files missing from the cache:
python rescache.py -i "EVE Online Sisi.app" download


To purge any extra files from the cache:
python rescache.py -i "EVE Online Sisi.app" purge

OK, I did all this, and got some odd results on my Mac.
It downloaded all the files, which is odd as I had already done that by running my sisi client. In addition, the SharedCache folder did not get bigger. So where did it put 13 gig of files? A bit of searching......
They all got placed in a new folder structure in the rescache-master folder:

~/Library/Application Support/EVE Online/p-drive ..... (And so on. And yes, the top new folder was named ~ ).

I had changed the directory to the rescache-master folder, and the command I used was:

python rescache.py -i "EVE Singularity.app" download

Know a Frozen fan? Check this out

Frozen fanfiction

CCP Snorlax
C C P
C C P Alliance
#230 - 2015-03-10 21:43:00 UTC
Ke'Daar wrote:
CCP Snorlax: I have one more question for you...

Now that I am merely downloading all 13G of shared cache, am I set for when this goes to TQ?, or would I be obliged to download it all again?

Asking from a country where slow expensive broadband is the norm...


Yes yes I know.. there are actually still such countries out there

You're all set - this is the same set of files as the TQ client will use when this goes live.

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/

CCP Snorlax
C C P
C C P Alliance
#231 - 2015-03-10 21:44:22 UTC
Vincent Athena wrote:
CCP Snorlax wrote:

On the github page linked above, you should see a 'Download ZIP' button on the right hand side. Download and extract the files to a folder - when I tried this in Chrome, it put the file in my Downloads folder and extracted to rescache-master.

Open up a terminal window, change the directory to the rescache-master folder and run 'python rescache.py'.

Use the -i option to tell the tool what resource index file to use - it can either be the full path to the resfileindex.txt in the EVE installation, or simply the name of the app under the Applications folder, for example:

To verify the integrity of files in the cache:
python rescache.py -i "EVE Online Sisi.app" verify


To download any files missing from the cache:
python rescache.py -i "EVE Online Sisi.app" download


To purge any extra files from the cache:
python rescache.py -i "EVE Online Sisi.app" purge

OK, I did all this, and got some odd results on my Mac.
It downloaded all the files, which is odd as I had already done that by running my sisi client. In addition, the SharedCache folder did not get bigger. So where did it put 13 gig of files? A bit of searching......
They all got placed in a new folder structure in the rescache-master folder:

~/Library/Application Support/EVE Online/p-drive ..... (And so on. And yes, the top new folder was named ~ ).

I had changed the directory to the rescache-master folder, and the command I used was:

python rescache.py -i "EVE Singularity.app" download

OK, that's strange - I'll look into this.

CCP Snorlax - Software Architect - Team RnB - @CCP_Snorlax - http://ccpsnorlax.blogspot.is/

Ke'Daar
Ministry of War
Amarr Empire
#232 - 2015-03-11 07:24:01 UTC
Vincent Athena wrote:
CCP Snorlax wrote:

On the github page linked above, you should see a 'Download ZIP' button on the right hand side. Download and extract the files to a folder - when I tried this in Chrome, it put the file in my Downloads folder and extracted to rescache-master.

Open up a terminal window, change the directory to the rescache-master folder and run 'python rescache.py'.

Use the -i option to tell the tool what resource index file to use - it can either be the full path to the resfileindex.txt in the EVE installation, or simply the name of the app under the Applications folder, for example:

To verify the integrity of files in the cache:
python rescache.py -i "EVE Online Sisi.app" verify


To download any files missing from the cache:
python rescache.py -i "EVE Online Sisi.app" download


To purge any extra files from the cache:
python rescache.py -i "EVE Online Sisi.app" purge

OK, I did all this, and got some odd results on my Mac.
It downloaded all the files, which is odd as I had already done that by running my sisi client. In addition, the SharedCache folder did not get bigger. So where did it put 13 gig of files? A bit of searching......
They all got placed in a new folder structure in the rescache-master folder:

~/Library/Application Support/EVE Online/p-drive ..... (And so on. And yes, the top new folder was named ~ ).

I had changed the directory to the rescache-master folder, and the command I used was:

python rescache.py -i "EVE Singularity.app" download


I just checked and I had the same happen to me when using rescache.py

Correct SharedCache folder did not grow, while I too found another SharedCache folder underneath the rescache-master folder
Rain6637
GoonWaffe
Goonswarm Federation
#233 - 2015-03-11 07:35:41 UTC  |  Edited by: Rain6637
That reminds me: Treesize Free is a great freeware utility for monitoring file and directory sizes. You can select directories or drives, and it has file size, disk percent, and file count. You can also save reports of the active tree.

Publisher's download site

Screenshots:
By file size
By file count

Thanks in advance
Virgil McMacset
Caldari Provisions
Caldari State
#234 - 2015-03-11 10:06:17 UTC
Why is this so annoyingly un-friendly to it's users?

CCP would you mind please realising that many ppl playing Eve are not all computer junkies and therefore would appreciate something that just clicked and played with out all this file sorting carry on.

How about some simple and clear instructions on how to get the Sisi launcher with DOD to work for Mac without trying to download the whole dam client folder again at 12. something Gb?
Or directing us to said link on how to do it?

Some of these instruction are akin to explaining to a car sales man to strip the engine down out of that Chevy on the lot and put it back together again then looking at him expectantly while giving him a Jamie Oliver recipe for apple crumble, and telling him these are the instructions on how to perform the Chevy engine rebuild.

My question is A. Can we please get a simple instruction package for Mac how to A download the dam thing without downloading another full size client.
B. If the purge function is not adhered to how to reset the launcher to prompt the same questions again on start up so as to configure the location of the res cache folder.

I have both my server files inside the single Eve client at Eve Online p_drive / local settings/ Application Data /CCP /EVE/ c_program_files_ccp_eve_tranquility & c_program_files_ccp_eve_singularity

I use the Terminal window with this command to open SIsi : open /Applications/Singularity.app --args /server:Singularity

Which used to do the job nicely , until now?

But it still keeps trying to download the complete client again at 12Gb???

Any help here would be very handy right about now Thank you.
Bad Albosa
Republic Military School
Minmatar Republic
#235 - 2015-03-11 11:57:46 UTC
after having used https://github.com/ccpgames/rescache

verified 62809 files
0 corrupt
267 files not yet downloaded

tried python rescache download function

267 files missing - 25,95 MB - 46,73MB on disk
Downloaded 0 files (267 failed)


Launcher still stuck in rescache downloading

So whats next?
Server side problem?


Sarmatiko
#236 - 2015-03-11 13:31:27 UTC
Bad Albosa wrote:

Launcher still stuck in rescache downloading


Do you have "Download all resources" option enabled in launcher?
If not, I think launcher only downloads essential files from resfileindex_prefetch and the rest of files are DoD.
Manssell
OmiHyperMultiNationalDrunksConglomerate
#237 - 2015-03-11 13:34:07 UTC
I really want to echo what Virgil McMacset said.

So I try'd to update the Mac client today and got the prompt to either use the client on demand or not. I opted not to since I know the Mac will crash, but now sisi is wanting to download the whole 16gis rather than use what I already have for sisi now. Should you select the download on demand if you already have the client installed, or is this patch a new full download either way?
CCP Atropos
C C P
C C P Alliance
#238 - 2015-03-11 14:11:39 UTC
Manssell wrote:
I really want to echo what Virgil McMacset said.

So I try'd to update the Mac client today and got the prompt to either use the client on demand or not. I opted not to since I know the Mac will crash, but now sisi is wanting to download the whole 16gis rather than use what I already have for sisi now. Should you select the download on demand if you already have the client installed, or is this patch a new full download either way?

The prompt you probably got was 'would you like to migrate any existing assets now?' and some associated descriptive blurb. If you don't migrate your client build then of course it will try to download assets, because it doesn't have any assets in the right format to use.
Manssell
OmiHyperMultiNationalDrunksConglomerate
#239 - 2015-03-11 14:17:09 UTC
CCP Atropos wrote:
Manssell wrote:
I really want to echo what Virgil McMacset said.

So I try'd to update the Mac client today and got the prompt to either use the client on demand or not. I opted not to since I know the Mac will crash, but now sisi is wanting to download the whole 16gis rather than use what I already have for sisi now. Should you select the download on demand if you already have the client installed, or is this patch a new full download either way?

The prompt you probably got was 'would you like to migrate any existing assets now?' and some associated descriptive blurb. If you don't migrate your client build then of course it will try to download assets, because it doesn't have any assets in the right format to use.



Ok. So does that mean I'm stuck downloading a new client now, or can this be stopped? If it can't then which assets can be deleted then so I don't have two sisi builds on my computer? (I'm running out of room here).

Also bit of feedback, the dialog box that asks this is not very clear to those of us that are not programers. It really looked like it was asking if you wanted to use download on demand or not, but there was no hint it would download a whole new client if you say no.
Virgil McMacset
Caldari Provisions
Caldari State
#240 - 2015-03-11 14:26:50 UTC  |  Edited by: Virgil McMacset
Manssell wrote:
CCP Atropos wrote:
Manssell wrote:
I really want to echo what Virgil McMacset said.

So I try'd to update the Mac client today and got the prompt to either use the client on demand or not. I opted not to since I know the Mac will crash, but now sisi is wanting to download the whole 16gis rather than use what I already have for sisi now. Should you select the download on demand if you already have the client installed, or is this patch a new full download either way?

The prompt you probably got was 'would you like to migrate any existing assets now?' and some associated descriptive blurb. If you don't migrate your client build then of course it will try to download assets, because it doesn't have any assets in the right format to use.



Ok. So does that mean I'm stuck downloading a new client now, or can this be stopped? If it can't then which assets can be deleted then so I don't have two sisi builds on my computer? (I'm running out of room here).

Also bit of feedback, the dialog box that asks this is not very clear to those of us that are not programers. It really looked like it was asking if you wanted to use download on demand or not, but there was no hint it would download a whole new client if you say no.


Yes what exactly does that comment actually mean ?
I am exactly in the same mind as Manssell, the whole thing is seemingly pretty vague in explanation thus far.
Can you give us some clear instructions here please what we need to do to get the client working again without having full size multiple clients installed on Mac?
Like put the square in the square hole and the triangle in the triangle hole rather than prompts that literally make no sense on the install.