These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

SDEExternalsToSql Tool (Phoebe 1.0+ compatible)

First post First post
Author
Previous Topic Next Topic
Darkblad
Doomheim
#81 - 2015-03-27 09:24:27 UTC
CCP FoxFour wrote:
The designer does have a bit of OCD though... so maybe. :)
I'm familiar with that, self observation and such. Blink
Thank you!

NPE – ISD – RIP
Jognu
French Kiss Singularity
#82 - 2015-04-17 17:20:34 UTC
This problem is still here with the Scylla SDE.

EveAI developper: https://forums.eveonline.com/default.aspx?g=posts&t=21803
Desmont McCallock
#83 - 2015-04-28 18:17:30 UTC
Still good for Mosaic 1.0. Skin data will be supported on a next release.
Lunydale Yliana
Proudly Snoring
#84 - 2015-05-08 22:22:16 UTC
I'm having some issue using this.
When i launch it, everything is said to be imported successfully but, my database is still empty.

I'm new to .NET technology, I'm probably doing something wrong, but can't tell what it is. Any idea ?
I'd be grateful.
Hel O'Ween
Men On A Mission
#85 - 2015-05-10 17:37:40 UTC
Steps to insert the data:

- Import CCP's SDE into your MS SQL instance
- Edit the maching.config of the tool with the necessary credentials to let the tool access the above server/database
- Copy the *.yml and *.db files included in CCP's SDE dwonload into the appropriate folders of the tool.
- (optional) omit/delete the YAML files you're not interested in. Desmont has made his tool fool-proved. Missing YAML files are ignored
- Run the tool

That's how it works for me.

EVEWalletAware - an offline wallet manager.
Darkblad
Doomheim
#86 - 2015-05-10 21:57:27 UTC
Make sure to adjust the config file to your setup, in case you chose a different name for the database and/or prefer a different way of authentication.

NPE – ISD – RIP
Lunydale Yliana
Proudly Snoring
#87 - 2015-05-11 21:39:41 UTC
Thanks for your help ! :D
But I still have the same problem...

In the configuration file, I just changed the connectionString of EveStaticData with the one of my database. I have something like:
(I had to put the parenthesis to post it)

  (connectionStrings)
    (clear )(/clear)
    (add name="EveStaticData" connectionString="Data Source=HARMAGUEDON\SQLEXPRESS;Initial Catalog=Evening_sde_db;Integrated Security=True;Connect Timeout=15;Encrypt=False;TrustServerCertificate=False" providerName="System.Data.SqlClient" )(/add)
    (add name="UniverseDataEntities" connectionString="metadata=res://*/SQLiteToSql.UniverseData.csdl|res://*/SQLiteToSql.UniverseData.ssdl|res://*/SQLiteToSql.UniverseData.msl;provider=System.Data.SQLite;provider connection string="data source=SQLiteFiles\universeDataDx.db"" providerName="System.Data.EntityClient" )(/add)
  (/connectionStrings)


And I guess it's fine, because the tool connects to the database, and makes imports.

But actually I just realized something: some of the tables do contain some imported data. it's just that most of them are empty, but not all.
Here's a report from SQL Server Express:
http://i.imgur.com/oquclVJ.png
http://i.imgur.com/R9t4PAU.png

Is that how it's supposed to be ? I'd be quite confused.

One more hint maybe:
When I execute the tool before the table are created, it says is cannot find the 'invTypes' table and stops.
If I initialize the database first, with the ebs_DATADUMP.sql file from CCP, it "works".
Isn't the tool supposed to create the tables by itself ?

Again, thanks for any help !
Hel O'Ween
Men On A Mission
#88 - 2015-05-12 02:04:23 UTC
Lunydale Yliana wrote:

One more hint maybe:
When I execute the tool before the table are created, it says is cannot find the 'invTypes' table and stops.
If I initialize the database first, with the ebs_DATADUMP.sql file from CCP, it "works".
Isn't the tool supposed to create the tables by itself ?


You did import (or better: restore) the *.bak from CCP's SDE into your SQL-Server first, right?

I ask, because I've never used the *.sql to (re-)create the database. I just restore over my existing installation, as I don't need all the relations and stuff in the *.sql.

EVEWalletAware - an offline wallet manager.
Lunydale Yliana
Proudly Snoring
#89 - 2015-05-12 22:34:45 UTC
Oh. Right... :)
Works like a charm now.

Maybe it was something obvious to do, but I'm totally new to this...

Sorry for my noobiness, and thanks again for your help ! :)
Mr Mac
Dark Goliath
#90 - 2015-05-13 03:48:50 UTC  |  Edited by: Mr Mac
Desmont McCallock wrote:
Still good for Mosaic 1.0. Skin data will be supported on a next release.

I didn't use tool. I did read codes on github. One or two universe tables changed, you should check
Im at work. I cant check which table

Edit: your scripts create mapJumps table with celestialID (destinationID in static data) and mapLandmarks with two more columns.
Hel O'Ween
Men On A Mission
#91 - 2015-05-13 11:09:59 UTC
Lunydale Yliana wrote:
Oh. Right... :)
Sorry for my noobiness, and thanks again for your help ! :)


You're welcome. Everyone of us has started out at some point. And we're still learning on a daily basis. Big smile

Lessons learned at this point: describe the steps you took to set up the DB and use Desmont's tool to import the missing data. We would've spotted the missing restore/import right in the first post. Blink

EVEWalletAware - an offline wallet manager.
Desmont McCallock
#92 - 2015-05-15 19:56:23 UTC
Mr Mac wrote:
Desmont McCallock wrote:
Still good for Mosaic 1.0. Skin data will be supported on a next release.

I didn't use tool. I did read codes on github. One or two universe tables changed, you should check
Im at work. I cant check which table

Edit: your scripts create mapJumps table with celestialID (destinationID in static data) and mapLandmarks with two more columns.
It's not only those. There are plenty more throughout the entire DB. You surely can understand that those columns where kept deliberately for backwards compatibility.
War Porcika
Hamster Holding Corp
#93 - 2015-06-06 16:43:22 UTC
It seems it's working with Carnyx. Big smile
Darkblad
Doomheim
#94 - 2015-06-13 10:29:11 UTC
This additional explanation by CCP Nullarbor on the topic of type(ID) changes coming soon is fear inducing. This may result in probably three or even more tables (invTypes, invGroups, invCategories) also getting removed from the MS-SQL table within the Static Data Export. Another pile of *.yaml files to be expected :/


I already asked wether this will be the case in that thread but fo far did'nt receive a .response

NPE – ISD – RIP
Desmont McCallock
#95 - 2015-06-13 18:46:12 UTC
Fear not, we will compensate on those changes.
Darkblad
Doomheim
#96 - 2015-06-14 07:54:11 UTC
It's good to know that there's still hope beyond that point, thank you! Big smile

NPE – ISD – RIP
Darkblad
Doomheim
#97 - 2015-06-29 15:54:53 UTC
CCP Fozzie published a sample of the way that typeID information will be included (within the typeIDs.yaml) to the Aegis SDE moments ago:
CCP FoxFour wrote:
Some people have been asking to get a sample of how the types data is going to look now. So here it is. This will take effect in the next release.

Sample: https://gist.github.com/Regner/f6d49c3aacc816e41341

Will try and get a complete export later.

NPE – ISD – RIP
CCP FoxFour
C C P
C C P Alliance
#98 - 2015-06-29 15:56:02 UTC
Darkblad wrote:
CCP Fozzie published a sample of the way that typeID information will be included (within the typeIDs.yaml) to the Aegis SDE moments ago:
CCP FoxFour wrote:
Some people have been asking to get a sample of how the types data is going to look now. So here it is. This will take effect in the next release.

Sample: https://gist.github.com/Regner/f6d49c3aacc816e41341

Will try and get a complete export later.



Here is a full export for the typeIDs, not just a sample: http://dl.eve-files.com/media/1506/typeIDs.zip

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.
Plaid Rabbit
Enlightened Industries
Goonswarm Federation
#99 - 2015-07-03 21:37:23 UTC
1: Can you publish this as part of a standard URL? So that we can get the latest YAML programically.

2: Can you include information from the dbo.invTypes table, such as volume, mass, capacity, portionSize, etc...
Desmont McCallock
#100 - 2015-07-04 10:19:20 UTC
I have added support to import the skin related yaml files into the SQL server.
I haven't yet released a new version due to the upcoming changes of Aegis release. Once the Aegis changes have been implemented in the tool there will be a new version release.

P.S.: For those anxious to get the bleeding edge version of the tool, they can compile it from the source code.