These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Eve Ships db dump

First post
Author
Previous Topic Next Topic
Caldari Citizen 1233743983
Science and Trade Institute
Caldari State
#1 - 2017-04-04 10:48:42 UTC
o/ Been a while since ive made any software for eve. Started a new project where i require some of the DB dumps, particularly in this case a up-to-date dump of ships with there id's and names specifically. i Believe i used to get this data from the static eve dumps by ccp for devs, but i cant seem to find the sql dumps in there any more..? anyway, would appreciate it if someone could point me in the right direction, i cant seem to find a up-to-date version. Don't mind the format as ill be converting to JSON anyway.

kind regards, Citz
Messenger Of Truth
Butlerian Crusade
#2 - 2017-04-04 12:07:19 UTC  |  Edited by: Messenger Of Truth
the data dumps are here: https://developers.eveonline.com/resource/resources

They are now only released in YAML format instead of as database exports.

To get a list of all items, you can unzip the datadump and load fsd/typeIDs.yaml

That will get you all items, then you can filter it down a bit more by also loading fsd/groupIDs.yaml and fsd/categoryIDs.yaml

Find the "Ship" category, the go through the groups and find all groups which are in the Ship category, then go through the items and find all the items that are in any of the ship groups. (i.e. if it was sql, an inner join of category and group, followed by an inner join of group and type)

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#3 - 2017-04-04 13:53:49 UTC
https://www.fuzzwork.co.uk/dump/ if you're looking for it in csv or an sql database.

as mentioned above, the data is now provided in yaml files. (which made the conversion process _so_ much simpler)

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Caldari Citizen 1233743983
Science and Trade Institute
Caldari State
#4 - 2017-04-04 14:42:12 UTC
Messenger Of Truth wrote:
the data dumps are here: https://developers.eveonline.com/resource/resources

They are now only released in YAML format instead of as data dumps.

To get a list of all items, you can unzip the datadump and load fsd/typeIDs.yaml

That will get you all items, then you can filter it down a bit more by also loading fsd/groupIDs.yaml and fsd/categoryIDs.yaml

Find the "Ship" category, the go through the groups and find all groups which are in the Ship category, then go through the items and find all the items that are in any of the ship groups. (i.e. if it was sql, an inner join of category and group, followed by an inner join of group and type)



Thanks! i didn’t realise they where in that file, just imported now, going to be a bit long winded to extract what i need though.

Steve Ronuken wrote:
https://www.fuzzwork.co.uk/dump/ if you're looking for it in csv or an sql database.

as mentioned above, the data is now provided in yaml files. (which made the conversion process _so_ much simpler)



i was checking out https://www.fuzzwork.co.uk/dump/latest/ earlier for a a SQL for it, couldn’t figure out what one i needed though, looking for files that begin with "ships" or "typeID" etc hasnt helped, do you know what file im specifically looking for?

P.S thank you for maintaining such a resource, very helpful and well kept, Thanks!
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#5 - 2017-04-04 15:31:37 UTC
Caldari Citizen 1233743983 wrote:
Messenger Of Truth wrote:
the data dumps are here: https://developers.eveonline.com/resource/resources

They are now only released in YAML format instead of as data dumps.

To get a list of all items, you can unzip the datadump and load fsd/typeIDs.yaml

That will get you all items, then you can filter it down a bit more by also loading fsd/groupIDs.yaml and fsd/categoryIDs.yaml

Find the "Ship" category, the go through the groups and find all groups which are in the Ship category, then go through the items and find all the items that are in any of the ship groups. (i.e. if it was sql, an inner join of category and group, followed by an inner join of group and type)



Thanks! i didn’t realise they where in that file, just imported now, going to be a bit long winded to extract what i need though.

Steve Ronuken wrote:
https://www.fuzzwork.co.uk/dump/ if you're looking for it in csv or an sql database.

as mentioned above, the data is now provided in yaml files. (which made the conversion process _so_ much simpler)



i was checking out https://www.fuzzwork.co.uk/dump/latest/ earlier for a a SQL for it, couldn’t figure out what one i needed though, looking for files that begin with "ships" or "typeID" etc hasnt helped, do you know what file im specifically looking for?

P.S thank you for maintaining such a resource, very helpful and well kept, Thanks!



Important tables:

invTypes. For all the names.
invGroups. so you can get the category id for all the types. (you get the groupid from invTypes, then the category id from invGroups. you want category 6)
dgmTypeAttributes. For all the attributes of ships.
dgmAttributeTypes. for the explanation of each attribute. (attributeid from dgmTypeAttributes)

There's a mysql version, sqlite, postgres and mssql

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Caldari Citizen 1233743983
Science and Trade Institute
Caldari State
#6 - 2017-04-04 16:35:37 UTC
Steve Ronuken wrote:
Caldari Citizen 1233743983 wrote:
Messenger Of Truth wrote:
the data dumps are here: https://developers.eveonline.com/resource/resources

They are now only released in YAML format instead of as data dumps.

To get a list of all items, you can unzip the datadump and load fsd/typeIDs.yaml

That will get you all items, then you can filter it down a bit more by also loading fsd/groupIDs.yaml and fsd/categoryIDs.yaml

Find the "Ship" category, the go through the groups and find all groups which are in the Ship category, then go through the items and find all the items that are in any of the ship groups. (i.e. if it was sql, an inner join of category and group, followed by an inner join of group and type)



Thanks! i didn’t realise they where in that file, just imported now, going to be a bit long winded to extract what i need though.

Steve Ronuken wrote:
https://www.fuzzwork.co.uk/dump/ if you're looking for it in csv or an sql database.

as mentioned above, the data is now provided in yaml files. (which made the conversion process _so_ much simpler)



i was checking out https://www.fuzzwork.co.uk/dump/latest/ earlier for a a SQL for it, couldn’t figure out what one i needed though, looking for files that begin with "ships" or "typeID" etc hasnt helped, do you know what file im specifically looking for?

P.S thank you for maintaining such a resource, very helpful and well kept, Thanks!



Important tables:

invTypes. For all the names.
invGroups. so you can get the category id for all the types. (you get the groupid from invTypes, then the category id from invGroups. you want category 6)
dgmTypeAttributes. For all the attributes of ships.
dgmAttributeTypes. for the explanation of each attribute. (attributeid from dgmTypeAttributes)

There's a mysql version, sqlite, postgres and mssql


works like a charm, many thanks! <3