These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

YC118-3 conversion

First post
Author
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#1 - 2016-03-09 16:20:02 UTC
mysql: https://www.fuzzwork.co.uk/dump/mysql56-yc118-3-117575.tbz2

sqlite: https://www.fuzzwork.co.uk/dump/yc118-3-117575/eve.db.bz2

postgres: https://www.fuzzwork.co.uk/dump/yc118-3-117575/postgres-yc1183.117575.dmp.bz2

SQL Server: https://www.fuzzwork.co.uk/dump/yc118-3-117575/YC118-3-117575.bak.bz2

individual yaml, csv, sql files: https://www.fuzzwork.co.uk/dump/yc118-3-117575/


Note there are no xls format files here. This is because I've updated my exporter to support new lines in csvs. Which is the only reason I was doing xls.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Rondo Haxton
Accelerated Cognition
#2 - 2016-03-09 21:57:48 UTC
Vote Steve Ronuken for CSM
Simon Force
The Scope
Gallente Federation
#3 - 2016-04-24 15:34:02 UTC
It is still a mystery for me why you choose to export some datas in YAML format. Most of my parsers are unable to read your lists (i.e. manufactoring, products).

Most modern programming languages already implemented XML and JSON parser (c#, Java and C++ with Qt library). Can you tell me the reason why you didn't take one of these formats? They are more common and the difference between Json and Yaml is just that Json uses brackets to enclose objects and lists.

lg
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#4 - 2016-04-24 16:17:46 UTC
Simon Force wrote:
It is still a mystery for me why you choose to export some datas in YAML format. Most of my parsers are unable to read your lists (i.e. manufactoring, products).

Most modern programming languages already implemented XML and JSON parser (c#, Java and C++ with Qt library). Can you tell me the reason why you didn't take one of these formats? They are more common and the difference between Json and Yaml is just that Json uses brackets to enclose objects and lists.

lg



I'm assuming you're talking about CCP in this case, as the only yaml in my files is stuff straight from CCP (Which I'm probably going to stop providing in this fashion, when the full conversion happens) And all the data in the yaml is also in the databases.

Anyway, to answer the question why CCP provides the data in yaml:

Calling it an export isn't entirely accurate. What we're getting is an extract of data from their versioning system. Yaml works _really_ well with VCS, due to how it's formatted.

Having them convert it into another form is an additional step, which introduces more Cost for them. And costs are something you have to burn political capital on. We're actually going to be getting the entire SDE in yaml pretty soon, which means they can automate the entire thing, and that reduces the work involved, and hence the cost.

(there's also a few other technical differences between json and yaml. Interestingly, yaml is a superset of json)

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter