These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
12Next page
 

Aegis 1.1.1 SDE - Released

First post First post
Author
Previous Topic Next Topic
Desmont McCallock
#1 - 2015-07-09 17:15:20 UTC  |  Edited by: Desmont McCallock
SDE for Aegis 1.1.1 just got released so get your copies. Stay tuned for more info on it.
Mr Mac
Dark Goliath
#2 - 2015-07-09 17:40:23 UTC
Better now
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#3 - 2015-07-09 18:15:30 UTC
bah! More effort to load things back into invTypes, so people don't complain at it being missing! Blink

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Medusa The Gorgon
Temple of the Serpent
The Gorgon Empire
#4 - 2015-07-09 18:22:32 UTC
Steve Ronuken wrote:
bah! More effort to load things back into invTypes, so people don't complain at it being missing! Blink

It is still 'missing'. The process of my killboard upgrade I used _years_ flawlessly is broken in 1 day. I never used yaml and it will be noticeable amount of time to write support.
Ydnari
Estrale Frontiers
#5 - 2015-07-09 18:27:29 UTC
Steve Ronuken wrote:
bah! More effort to load things back into invTypes, so people don't complain at it being missing! Blink

You should ask your CSM representative to get CCP to release the data in a format that's convenient for the users rather than them PirateBlink

--
Medusa The Gorgon
Temple of the Serpent
The Gorgon Empire
#6 - 2015-07-09 18:34:41 UTC
I'm not blaming CCP is changing format. After all, yaml doesn't force you to install proprietary software and can be parsed easily, I'm blaming the methods CCP use - munch portion of MSSQL datadump and spit it to yaml files. So, now I have to support and MSQL and YAML to assemble data I need.
Pretty silly.
Convert all to yaml, announce mssql datadump deprecation and remove it after 1 year. That's how responsible devs should work (in any public projects).
Desmont McCallock
#7 - 2015-07-09 18:57:46 UTC
Ydnari wrote:
Steve Ronuken wrote:
bah! More effort to load things back into invTypes, so people don't complain at it being missing! Blink

You should ask your CSM representative to get CCP to release the data in a format that's convenient for the users rather than them PirateBlink
Good luck with that.
Desmont McCallock
#8 - 2015-07-09 18:59:40 UTC
Medusa The Gorgon wrote:
I'm not blaming CCP is changing format. After all, yaml doesn't force you to install proprietary software and can be parsed easily, I'm blaming the methods CCP use - munch portion of MSSQL datadump and spit it to yaml files. So, now I have to support and MSQL and YAML to assemble data I need.
Pretty silly.
Convert all to yaml, announce mssql datadump deprecation and remove it after 1 year. That's how responsible devs should work (in any public projects).
Patients is a virtue. Soon I'll update this tool which you probably haven't used yet.
Zifrian
The Frog Pond
Ribbit.
#9 - 2015-07-09 19:06:38 UTC
Medusa The Gorgon wrote:
I'm not blaming CCP is changing format. After all, yaml doesn't force you to install proprietary software and can be parsed easily, I'm blaming the methods CCP use - munch portion of MSSQL datadump and spit it to yaml files. So, now I have to support and MSQL and YAML to assemble data I need.
Pretty silly.
Convert all to yaml, announce mssql datadump deprecation and remove it after 1 year. That's how responsible devs should work (in any public projects).

Get in line. We've asked for consistency on this for years. The thing is, the SDE is a collateral job for those that work on it.

You have two options really, build your own processing or wait for someone like Desmont or Steve to convert the data for you.

Maximze your Industry Potential! - Download EVE Isk per Hour!

Import CCP's SDE - EVE SDE Database Builder
Desmont McCallock
#10 - 2015-07-09 19:41:42 UTC
@CCP Creber Cattus
You might wonna have a look at typeIDs 33857 and 33858. Name and description is all messed up.
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#11 - 2015-07-09 20:40:32 UTC
Desmont McCallock wrote:
Ydnari wrote:
Steve Ronuken wrote:
bah! More effort to load things back into invTypes, so people don't complain at it being missing! Blink

You should ask your CSM representative to get CCP to release the data in a format that's convenient for the users rather than them PirateBlink
Good luck with that.



I've asked...

Considering that many of said users depend on my conversions, I'd prefer it to be as simple as possible. Blink

in other news: get em while they're hot! https://forums.eveonline.com/default.aspx?g=posts&m=5876199


And in other news again: No descriptions on groups and categories.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Desmont McCallock
#12 - 2015-07-09 21:05:07 UTC
EVEMonSDEExternalsToSql tool for Aegis has been released.
https://forums.eveonline.com/default.aspx?g=posts&m=5876243#post5876243
Jack Tronic
borkedLabs
#13 - 2015-07-09 23:05:25 UTC  |  Edited by: Jack Tronic
Medusa The Gorgon wrote:
I'm not blaming CCP is changing format. After all, yaml doesn't force you to install proprietary software and can be parsed easily, I'm blaming the methods CCP use - munch portion of MSSQL datadump and spit it to yaml files. So, now I have to support and MSQL and YAML to assemble data I need.
Pretty silly.
Convert all to yaml, announce mssql datadump deprecation and remove it after 1 year. That's how responsible devs should work (in any public projects).


YAML is cancer from Ruby/Python devs and its actually difficult to parse. There are many variations of YAML parsing and once you start writing complex YAML structures you end up with hilarious failures.
https://news.ycombinator.com/item?id=7326190


TOML on the otherhand is FTW



Also CCP isn't slowly converting to YAML for our usage. They are converting it for themselves. In essence its a private project for them ;)
Pete Butcher
The Scope
Gallente Federation
#14 - 2015-07-10 06:03:52 UTC
Seems like we have integrity problems. Item types 351296, 352522, 352597, 352598 and 356915 belong to non-existing market groups.

http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool
CCP Creber Cattus
C C P
C C P Alliance
#15 - 2015-07-10 11:48:50 UTC
Desmont McCallock wrote:

You might wonna have a look at typeIDs 33857 and 33858. Name and description is all messed up.

I took a look, and they indeed look strange, but digging into it I'm sad to say that they are actually "correct"! (from the SDE point of view)
Reason: We don't distinguish between types that only exist on Serenity from TQ types, and for these two types (which by the look of it are some monuments that are only on Serentiy) then the types were authored with Chinese text as the default (english) name and that propogated somewhat strangly thought the translation system for other languages.


Steve Ronuken wrote:

And in other news again: No descriptions on groups and categories.

Groups and categories had development facing descriptions (nothing that players could see in client) and we did indeed include that in the SDE, but now our internal tools don't have those fields anymore.. so no more descriptions for groups or categories (not even internally..)
Desmont McCallock
#16 - 2015-07-10 12:00:10 UTC  |  Edited by: Desmont McCallock
CCP Creber Cattus wrote:
Desmont McCallock wrote:

You might wonna have a look at typeIDs 33857 and 33858. Name and description is all messed up.

I took a look, and they indeed look strange, but digging into it I'm sad to say that they are actually "correct"! (from the SDE point of view)
Reason: We don't distinguish between types that only exist on Serenity from TQ types, and for these two types (which by the look of it are some monuments that are only on Serentiy) then the types were authored with Chinese text as the default (english) name and that propogated somewhat strangly thought the translation system for other languages.
OK. I get what you are saying but from the sanity side those names should not have an 'en' node if they are only in Chinese or use the '{ }' as you do in other types (i.e. 352044).

Edit: Going back to the Mosaic SDE I do notice that it was so since. The typeName and description where in Chinese. Which leads me to the conclusion that CCP might not change them.
Desmont McCallock
#17 - 2015-07-10 12:06:57 UTC  |  Edited by: Desmont McCallock
On another issue MarketGroupIDs (354496, 354341, 354396, 354395, 356922) are missing from the invMarketGroups table. Although they probably refer to test items just for the completeness of the SDE it would be fare to include them.
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#18 - 2015-07-10 12:44:46 UTC
CCP Creber Cattus wrote:
Desmont McCallock wrote:

You might wonna have a look at typeIDs 33857 and 33858. Name and description is all messed up.

I took a look, and they indeed look strange, but digging into it I'm sad to say that they are actually "correct"! (from the SDE point of view)
Reason: We don't distinguish between types that only exist on Serenity from TQ types, and for these two types (which by the look of it are some monuments that are only on Serentiy) then the types were authored with Chinese text as the default (english) name and that propogated somewhat strangly thought the translation system for other languages.


Steve Ronuken wrote:

And in other news again: No descriptions on groups and categories.

Groups and categories had development facing descriptions (nothing that players could see in client) and we did indeed include that in the SDE, but now our internal tools don't have those fields anymore.. so no more descriptions for groups or categories (not even internally..)



I guess I can accept that Smile

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Desmont McCallock
#19 - 2015-07-10 13:40:56 UTC
Desmont McCallock wrote:
CCP Creber Cattus wrote:
Desmont McCallock wrote:

You might wonna have a look at typeIDs 33857 and 33858. Name and description is all messed up.

I took a look, and they indeed look strange, but digging into it I'm sad to say that they are actually "correct"! (from the SDE point of view)
Reason: We don't distinguish between types that only exist on Serenity from TQ types, and for these two types (which by the look of it are some monuments that are only on Serentiy) then the types were authored with Chinese text as the default (english) name and that propogated somewhat strangly thought the translation system for other languages.
OK. I get what you are saying but from the sanity side those names should not have an 'en' node if they are only in Chinese or use the '{ }' as you do in other types (i.e. 352044).

Edit: Going back to the Mosaic SDE I do notice that it was so since. The typeName and description where in Chinese. Which leads me to the conclusion that CCP might not change them.

OK, I figured it out. I just remembered how unicode characters must be treated in SQL.
Cat Harkness
Twilight Labs
The Serenity Initiative
#20 - 2015-07-11 02:25:32 UTC
Steve Ronuken wrote:
CCP Creber Cattus wrote:
Desmont McCallock wrote:

You might wonna have a look at typeIDs 33857 and 33858. Name and description is all messed up.

I took a look, and they indeed look strange, but digging into it I'm sad to say that they are actually "correct"! (from the SDE point of view)
Reason: We don't distinguish between types that only exist on Serenity from TQ types, and for these two types (which by the look of it are some monuments that are only on Serentiy) then the types were authored with Chinese text as the default (english) name and that propogated somewhat strangly thought the translation system for other languages.


Steve Ronuken wrote:

And in other news again: No descriptions on groups and categories.

Groups and categories had development facing descriptions (nothing that players could see in client) and we did indeed include that in the SDE, but now our internal tools don't have those fields anymore.. so no more descriptions for groups or categories (not even internally..)



I guess I can accept that Smile


So these Items are New on Serenity, because I do not see them in the Carnyx Dump?
Or did these, along with several others just get added to the dump?

Cat Harkness

CEO

Twilight Labs
12Next page