These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

SDEExternalsToSql Tool (Phoebe 1.0+ compatible)

First post First post
Author
Previous Topic Next Topic
Desmont McCallock
#61 - 2014-11-03 17:49:51 UTC
Hel O'Ween wrote:
Desmont McCallock wrote:
Tool still good for Oceanus 1.0 SDE.


Unfortunately that doesn't seem to be true for Phoebe Sad :

Importing blueprints.yaml... 99%
Ausnahmefehler: System.Exception: Key differs from blueprintTypeID
   bei EVEMon.SDEExternalsToSql.YamlToSql.Tables.Blueprints.ImportData(YamlMappingNode rNode) in e:\Projects\CSharp\BattleClinic\EVEMon\Tools\SDEExternalsToSql\YamlToSql\Tables\Blueprints.cs:line 141.
   bei EVEMon.SDEExternalsToSql.YamlToSql.Tables.Blueprints.Import() in e:\Projects\CSharp\BattleClinic\EVEMon\Tools\SDEExternalsToSql\YamlToSql\Tables\Blueprints.cs:line 92.
   bei EVEMon.SDEExternalsToSql.Program.Main() in e:\Projects\CSharp\BattleClinic\EVEMon\Tools\SDEExternalsToSql\Program.cs:line 26.
And this is because I have guard clause all over the tools' code that also checks for data consistency. This exception is thrown because there is a data inconsistency in the blueprints.yaml data. More specifically all ids after ID: 34267 have different blueprintTypeIDs. Someone from CCP should have a look at it and confirm if this is an issue.
Hel O'Ween
Men On A Mission
#62 - 2014-11-04 17:06:27 UTC  |  Edited by: Hel O'Ween
Desmont McCallock wrote:
More specifically all ids after ID: 34267 have different blueprintTypeIDs. Someone from CCP should have a look at it and confirm if this is an issue.


I was afraid something like that might be the cause after having seen other discussions about the Phoebe data here. But unfortunately I don't "speak" YAML nor C# to be sure.

Is there an easy way that I could tell your tool to excempt the BPO file from the import? I don't need those for my application.

[Added]
Say - if I remove the BPOs you mentioned or remove every BPO except one from that YAML, would your tool tolerate that or may I run into further sanity checks caused by that action?

EVEWalletAware - an offline wallet manager.
Desmont McCallock
#63 - 2014-11-04 17:48:02 UTC
Hel O'Ween wrote:
Desmont McCallock wrote:
More specifically all ids after ID: 34267 have different blueprintTypeIDs. Someone from CCP should have a look at it and confirm if this is an issue.


I was afraid something like that might be the cause after having seen other discussions about the Phoebe data here. But unfortunately I don't "speak" YAML nor C# to be sure.

Is there an easy way that I could tell your tool to excempt the BPO file from the import? I don't need those for my application.

[Added]
Say - if I remove the BPOs you mentioned or remove every BPO except one from that YAML, would your tool tolerate that or may I run into further sanity checks caused by that action?
Just remove the blueprints.yaml file from the folder. The tool will just display a message that it didn't found the file and will continue with the rest of the import Big smile.
Hel O'Ween
Men On A Mission
#64 - 2014-11-05 14:44:13 UTC
Ha, nice! That was too easy. You're my hero, Desmont.

EVEWalletAware - an offline wallet manager.
Lost Hamster
Hamster Holding Corp
#65 - 2014-11-06 20:34:00 UTC  |  Edited by: Lost Hamster
Desmont McCallock wrote:
Hel O'Ween wrote:
Desmont McCallock wrote:
Tool still good for Oceanus 1.0 SDE.


Unfortunately that doesn't seem to be true for Phoebe Sad :
And this is because I have guard clause all over the tools' code that also checks for data consistency. This exception is thrown because there is a data inconsistency in the blueprints.yaml data. More specifically all ids after ID: 34267 have different blueprintTypeIDs. Someone from CCP should have a look at it and confirm if this is an issue.


It's not just this. The whole blueprint yaml format have changed
Not sure if you have read it:
https://developers.eveonline.com/blog/article/industry-changes-for-phoebe
" Each activity type is now a string instead of a number so that we can produce a meaningful schema definition behind the scenes."

So if you even drop out the rows after ID: 34267 - the whole DB will be empty.
Desmont McCallock
#66 - 2014-11-06 21:10:06 UTC
Lost Hamster wrote:
Desmont McCallock wrote:
Hel O'Ween wrote:
Desmont McCallock wrote:
Tool still good for Oceanus 1.0 SDE.


Unfortunately that doesn't seem to be true for Phoebe Sad :
And this is because I have guard clause all over the tools' code that also checks for data consistency. This exception is thrown because there is a data inconsistency in the blueprints.yaml data. More specifically all ids after ID: 34267 have different blueprintTypeIDs. Someone from CCP should have a look at it and confirm if this is an issue.


It's not just this. The whole blueprint yaml format have changed
Not sure if you have read it:
https://developers.eveonline.com/blog/article/industry-changes-for-phoebe
" Each activity type is now a string instead of a number so that we can produce a meaningful schema definition behind the scenes."

So if you even drop out the rows after ID: 34267 - the whole DB will be empty.
I will cross that bridge hopefully on the weekend.
Desmont McCallock
#67 - 2014-11-08 15:29:26 UTC  |  Edited by: Desmont McCallock
I have released a new version that is compatible with the Phoebe changes.
Order is restored.

You can also find a fixed version of the blueprints.yaml file here (for you own sanity).

Enjoy.

Edit: Link to yaml file restored.
Lost Hamster
Hamster Holding Corp
#68 - 2014-11-09 21:53:12 UTC  |  Edited by: Lost Hamster
Desmont McCallock wrote:
I have released a new version that is compatible with the Phoebe changes.
Order is restored.

You can also find a fixed version of the blueprints.yaml file here (for you own sanity).

Enjoy.


Look's good. Thanks!
What was wrong with the original yaml file?

Edit: Nevermind.. I see it in the other thread.
rsantos
The Scope
Gallente Federation
#69 - 2014-11-13 16:01:41 UTC  |  Edited by: rsantos
I was importing the blueprint yaml file and runed into this problem also...
here is the inconsistent "entries" ...

t
Desmont McCallock
#70 - 2014-12-08 19:42:03 UTC
Still good for Rhea 1.0. Corrected blueprints.yaml file can be found here.
Jognu
French Kiss Singularity
#71 - 2014-12-09 22:19:34 UTC
Good work, as always ! Big smile

EveAI developper: https://forums.eveonline.com/default.aspx?g=posts&t=21803
Risingson
#72 - 2014-12-10 11:03:29 UTC
Just wanted to place another thank you for saving a lot of time for us mssqls.
Desmont McCallock
#73 - 2015-01-17 09:08:34 UTC
Still good for Proteus 1.0. Corrected blueprints.yaml file can be found here.
Desmont McCallock
#74 - 2015-02-20 18:29:45 UTC
Still good for Taimat 1.0. Corrected blueprints.yaml file can be found here.
Lost Hamster
Hamster Holding Corp
#75 - 2015-02-20 20:31:34 UTC
Desmont McCallock wrote:
Still good for Taimat 1.0. Corrected blueprints.yaml file can be found here.

You are great! Thanks!

Can you give me some info how are you fixing the blueprint.yaml? Any spec program?
Desmont McCallock
#76 - 2015-02-21 14:53:02 UTC
I'm just removing the duplicate entries in the skills node of the defected blueprint ids.
Because this is turning into a joke (CCP not fixing their yaml SDE files) I'm considering adding into the tool a duplicate data check so I'm not correcting the file every single time but let the tool handle it.
Darkblad
Doomheim
#77 - 2015-03-24 21:48:45 UTC  |  Edited by: Darkblad
Desmont McCallock wrote:
I'm just removing the duplicate entries in the skills node of the defected blueprint ids.
Because this is turning into a joke (CCP not fixing their yaml SDE files) I'm considering adding into the tool a duplicate data check so I'm not correcting the file every single time but let the tool handle it.
It's not just an issue with the SDE (the blueprints.yaml), the same issue is found in the ingame info.

50mm Reinforced Steel Plates II Blueprint, Copying (typeID 20344 duplicate Skill's typeID 11442)
800mm Reinforced Steel Plates II Blueprint, Copying (typeID 20352 duplicate Skill's typeID 11442)
1600mm Reinforced Steel Plates II Blueprint, Copying (typeID 20354 duplicate Skill's typeID 11442)
Perpetual Motion Unit I Blueprint Invention (typeID 27022 triple Skill's typeID 3402), unpublished, but still a troublemaker.

Reported this Bug with EBR-34960

NPE – ISD – RIP
Desmont McCallock
#78 - 2015-03-25 15:31:13 UTC  |  Edited by: Desmont McCallock
And that's why I just released a new version that deals with the issue once and for all. Got sick and tired waiting on CCP to fix it.
Darkblad
Doomheim
#79 - 2015-03-25 23:09:54 UTC
Wise choice.
My Bug report got closed with the comment that the BH did'nt have duplicate entries for nanite engineering, while I attached a similar screenshot like the ones above.

NPE – ISD – RIP
CCP FoxFour
C C P
C C P Alliance
#80 - 2015-03-27 09:17:22 UTC
Darkblad wrote:
Desmont McCallock wrote:
I'm just removing the duplicate entries in the skills node of the defected blueprint ids.
Because this is turning into a joke (CCP not fixing their yaml SDE files) I'm considering adding into the tool a duplicate data check so I'm not correcting the file every single time but let the tool handle it.
It's not just an issue with the SDE (the blueprints.yaml), the same issue is found in the ingame info.

50mm Reinforced Steel Plates II Blueprint, Copying (typeID 20344 duplicate Skill's typeID 11442)
800mm Reinforced Steel Plates II Blueprint, Copying (typeID 20352 duplicate Skill's typeID 11442)
1600mm Reinforced Steel Plates II Blueprint, Copying (typeID 20354 duplicate Skill's typeID 11442)
Perpetual Motion Unit I Blueprint Invention (typeID 27022 triple Skill's typeID 3402), unpublished, but still a troublemaker.

Reported this Bug with EBR-34960


You I like! Exact details and there is even a bug report! :D

I have passed this information on to the team responsible for the industry feature. Since it doesn't break anything though, it will probably get a bit of a low priority. The designer does have a bit of OCD though... so maybe. :)

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.