These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Tiamat SDE Conversions - New Table

First post First post
Author
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#1 - 2015-02-17 11:54:14 UTC  |  Edited by: CCP Phantom
BigWolfUK
Sons-of-Liberty
#2 - 2015-02-17 11:55:46 UTC
Thanks as always Steve
CCP FoxFour
C C P
C C P Alliance
#3 - 2015-02-17 12:00:26 UTC
I just posted the packaged values for containers as well there.

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.

Legedric Striker
State War Academy
Caldari State
#4 - 2015-02-17 12:02:06 UTC
Thanks again for the good and incredibly fast work!

EVE-Skillplan.net - Plan your pilot skill training online on PC, Mac, tablet or smartphone!

Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#5 - 2015-02-17 12:19:50 UTC
I'll see about doing the container volume as a patch release.

Currently thinking about how to handle it.

Would people prefer a separate typeid column that's null for the ones with groups, or should I have typeids for everything that have a packaged volume? (generated as part of the conversion process) tossing the groupid

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Steve Rock
Viziam
Amarr Empire
#6 - 2015-02-18 13:53:28 UTC  |  Edited by: Steve Rock
As always thanks for your amazing work! Much appreciated.

Just a couple issues (mainly with the original export itself):
- the foreign keys at the end of the sql have typos (staTypes table should be staStationTypes and a few dbo. here and there)
- the table ChrFactions is missing the placeholder record 500021 (all factions) and 500024 (Vigilant Tyrannos) referenced from crpNPCCorporations, fks don't like that
- not really an issue but postgres export uses quotes around object names (tables, fields etc) and that makes it reeeeally annoying to query and horrible to wrap into an ORM. I've written a simple script that lowercases it and add underscores instead.

But again thanks for your work, i dread the idea of installing mssql and you're saving me a lot of time!
Cedric Mactavish
Shiva Hara
#7 - 2015-02-26 20:31:55 UTC
First of all, a million thanks for your work, Steve.

Summary: I am getting errors querying 4 of the tables (from MSSQL, with the SQLite SDE as a linked server). It looks like some data definition issue on the SQLite .db

My question: Can this be fixed? And, if so, is to whom in CCP should I petition? (It's more an annoyance than anything; I can use the .xls versions as a workaround...)

Detail:

The error is of the form:
OLE DB provider 'MSDASQL' for linked server 'EVESQLITE' returned data that does not match expected data length for column xxx. The (maximum) expected data length is yyy, while the returned data length is zzz.

The tables / columns / expected length / returned length for which the issue occurs are:

dgmEffects / modifierInfo / 255 / 287
industryActivityProbabilities / probability / 3 / 4
mapLandmarks / description / 255 / 483
trnTranslations / text / 255 / 518

Of these, only probability would be really important to any calculation apps...

I know hardly anyone uses MSSQL, but I've been using it for decades for everything ...

Thanks again!
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#8 - 2015-02-26 20:50:57 UTC
hrm. you may be able to adjust the sqlite database by adjusting the column lengths. There are tools for dealing with sqlite in a gui out there :)

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Gordon Newman
Deep Core Mining Inc.
Caldari State
#9 - 2015-03-08 13:49:08 UTC  |  Edited by: Gordon Newman
Some items in invItems have their typeID set to '-1' which is non-existent.

itemID typeID ownerID locationID flagID quantity
3019581 -1 1 60013903 0 -1
3019582 -1 1 60013903 0 -1
3019583 -1 1 60013903 0 -1
3019584 -1 1 60013903 0 -1

EDIT:
chrFaction ID 500021 and 500024 are also missing

Co-Founder of element43 - Join our team! | EVE Live | EMDRMon | accounts-eve

Zifrian
The Frog Pond
Ribbit.
#10 - 2015-03-20 01:11:31 UTC
CCP FoxFour wrote:
I just posted the packaged values for containers as well there.

Is this invVolumes something that is included in the data dump because I've seemed to miss it. Or is this something you are just making public? I always had a packaged table that I built and added to my data but a SDE table would be ideal.

Maximze your Industry Potential! - Download EVE Isk per Hour!

Import CCP's SDE - EVE SDE Database Builder

Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#11 - 2015-03-20 17:12:44 UTC
It's not in the SDE from CCP. I'm adding it to my conversions from now on. I'm thinking about how to manage it more appropriately going forwards. I /think/ I'm going to revise it to just be typeids and fill it all in on conversion, so I can also put containers into it.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Zifrian
The Frog Pond
Ribbit.
#12 - 2015-03-20 22:12:39 UTC
Steve Ronuken wrote:
It's not in the SDE from CCP. I'm adding it to my conversions from now on. I'm thinking about how to manage it more appropriately going forwards. I /think/ I'm going to revise it to just be typeids and fill it all in on conversion, so I can also put containers into it.

Ok thanks. Unnecessary duplicate data is annoying but I don't see how else you do it either. The query to build the data is easy enough though assuming they don't change the group values.

Maximze your Industry Potential! - Download EVE Isk per Hour!

Import CCP's SDE - EVE SDE Database Builder