These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Crucible database dump

First post
Author
Desmont McCallock
#21 - 2011-12-03 16:52:48 UTC
Try again on Monday.
Zifrian
The Frog Pond
Ribbit.
#22 - 2011-12-04 01:07:51 UTC
The invItems table seems to be incomplete (I hope). There are no asteroids in the table anymore.

This is from Incarna:
Select top 10 invTypes.typeName, invGroups.groupName
from invTypes, invItems, invGroups
where invTypes.typeID = invItems.typeID
and invTypes.groupID = invGroups.groupID
and invGroups.categoryID = 25
group by invGroups.groupName, invTypes.typeName

Returns:

Fiery Kernite Kernite
Pyroxeres Pyroxeres
Solid Pyroxeres Pyroxeres
Veldspar Veldspar
Condensed Scordite Scordite
Kernite Kernite
Viscous Pyroxeres Pyroxeres
Concentrated Veldspar Veldspar
Dense Veldspar Veldspar
Scordite Scordite

Same query in Crucible returns no rows.

Maximze your Industry Potential! - Download EVE Isk per Hour!

Import CCP's SDE - EVE SDE Database Builder

Celebrain
Aliastra
Gallente Federation
#23 - 2011-12-04 20:50:21 UTC
Celebrain wrote:
I've been using the eveOwners table to detect and display the bloodline (and therefore race too) of each individual agent.


You know what? never mind on this one, I finally found the "missing" agent bloodline type data, in the invItems table. :P
Mnengli Noiliffe
Doomheim
#24 - 2011-12-04 21:48:06 UTC
Desmont McCallock wrote:

Edit 2: cruc10-sqlite3-v.1.db.7z
Notice: Not compatible with EAM

I can only use sqlite export...

tried this one, and new t2 modules' material requirements are not the same as the ones shown in game for t2 bpo.
Desmont McCallock
#25 - 2011-12-05 07:03:16 UTC
Because T2 modules requirements are combination of invTypeMaterials and ramTypeRequirements. Search the forums, there are at least a dozen topics on the subject.
CCP Prism X
C C P
C C P Alliance
#26 - 2011-12-05 08:02:47 UTC
Zifrian wrote:
The invItems table seems to be incomplete (I hope). There are no asteroids in the table anymore.

This is from Incarna:
Select top 10 invTypes.typeName, invGroups.groupName
from invTypes, invItems, invGroups
where invTypes.typeID = invItems.typeID
and invTypes.groupID = invGroups.groupID
and invGroups.categoryID = 25
group by invGroups.groupName, invTypes.typeName


No, we sanitized a lot of stuff out of invItems, asteroids included.

Desmont McCallock wrote:
Would be nice if it included the SQL script file.

Not very hot on releasing anything about our own internal structure of things. Not that obscurity is security but transparency isn't either. Blink

Desmont McCallock wrote:

Changes (possible breaking) found:
- agtConfig -> empty table ??? (edit: related data have been inserted in agtAgents table, which was about time)
- dgmAttributeTypes -> some attributeName values are NULL (intended?)
- eveNames -> renamed to invNames
- eveLocations -> removed
- eveOwners -> removed
- invPositions -> added
- invUniqueNames -> added
- translationLaguages -> added (typo error on table name - contains no data, should be removed)
- translationTables -> added
- trnTranslationLanguages -> added
- warCombatZoneSystems -> added
- warCombatZones -> added


I thought the changelog had mentioned that eveNames and eveOwners were now invNames and invUniqueNames as well as that eveLocations is now invPositions.

The dogma attributes missing names is probably due to our new translation system, will look at that.
Lutz Major
Austriae Est Imperare Orbi Universo
#27 - 2011-12-05 08:05:50 UTC
Zifrian wrote:
The invItems table seems to be incomplete (I hope). There are no asteroids in the table anymore.

This is from Incarna:
Select top 10 invTypes.typeName, invGroups.groupName
from invTypes, invItems, invGroups
where invTypes.typeID = invItems.typeID
and invTypes.groupID = invGroups.groupID
and invGroups.categoryID = 25
group by invGroups.groupName, invTypes.typeName

Remove the invItems table from your query and it should work again
Zifrian
The Frog Pond
Ribbit.
#28 - 2011-12-05 12:20:42 UTC
Lutz Major wrote:
Zifrian wrote:
The invItems table seems to be incomplete (I hope). There are no asteroids in the table anymore.

This is from Incarna:
Select top 10 invTypes.typeName, invGroups.groupName
from invTypes, invItems, invGroups
where invTypes.typeID = invItems.typeID
and invTypes.groupID = invGroups.groupID
and invGroups.categoryID = 25
group by invGroups.groupName, invTypes.typeName

Remove the invItems table from your query and it should work again

Nah, I was linking this to the map tables by the location id in invitems to find out where certain asteroids spawned. So this was just a partial query.

Maximze your Industry Potential! - Download EVE Isk per Hour!

Import CCP's SDE - EVE SDE Database Builder

Desmont McCallock
#29 - 2011-12-05 14:22:17 UTC  |  Edited by: Desmont McCallock
@CCP Prism X
Is there any particular reason why the invNames table key is bigint?
Same goes for invPositions.
Mnengli Noiliffe
Doomheim
#30 - 2011-12-05 14:30:01 UTC
Desmont McCallock wrote:
Because T2 modules requirements are combination of invTypeMaterials and ramTypeRequirements. Search the forums, there are at least a dozen topics on the subject.


I am talking about basic requirements like tritanium etc. besides t1 base module.

is it also modified to include t1's requirements? so I have to subtract i.e. tritanium needed for t1 module from t2's count?
Xander Hunt
#31 - 2011-12-06 01:48:56 UTC
Desmont McCallock wrote:
@CCP Prism X
Is there any particular reason why the invNames table key is bigint?
Same goes for invPositions.


64-bit.
Xander Hunt
#32 - 2011-12-06 02:08:08 UTC
CCP Prism X wrote:

Desmont McCallock wrote:
Would be nice if it included the SQL script file.

Not very hot on releasing anything about our own internal structure of things. Not that obscurity is security but transparency isn't either. Blink


I can understand the idea of not wanting to release internal structure details, and I don't THINK MS-SQL will export true SQL statements in any form, a simple VB script that connects, reads the table data you define, then exports sanitized SQL code isn't that hard to do. Many bonuses to doing it this way.

A> I don't have to have MS SQL installed anywhere.
B> Script kiddies writers can take the SQL code and modify it to whatever their DB preferences are
C> When you upgrade to the next version of MS SQL, we won't have to either
D> You can limit what tables are exported
E> If so inclined, any table that hasn't been changed doesn't need to be included in a new dump.

Downsides:
A> Table locking while data is exported - This'll hurt on larger tables, but this could be done on and mirrored server. However, if option E above is done and assuming the bigger tables may not be touched that often, may be a moot point.
B> Large export of data that has to live somewhere until its compressed
Desmont McCallock
#33 - 2011-12-06 06:56:30 UTC
Xander Hunt wrote:
Desmont McCallock wrote:
@CCP Prism X
Is there any particular reason why the invNames table key is bigint?
Same goes for invPositions.


64-bit.


Well, that's the point. It doesn't need to be 64bit. The id numbering still fits in 32bit (int).
Mnengli Noiliffe
Doomheim
#34 - 2011-12-06 07:06:09 UTC  |  Edited by: Mnengli Noiliffe
Desmont McCallock wrote:
Because T2 modules requirements are combination of invTypeMaterials and ramTypeRequirements. Search the forums, there are at least a dozen topics on the subject.


ok here is the example.

the new t2 gang links, according to the game, have the following common requirements:

106 tritanium
8 transmitter
0.5 RAM Electronics
6 nocxium -- except for skirmish
4 morphite
1 megacyte
13 isogen
1 hypersynaptic fibers
1 link I
3 nanotransistors
8 X microprocessor

These numbers might be a little off since they're possibly from invented BPC but they give the picture.

now let's see what we get form the export. I am using sqlite version so it might be outdated or wrong...

select (select typeName from invTypes where typeID=materialTypeID),quantity from invTypeMaterials where typeID=(select typeID from invTypes where typeName="Armored Warfare Link - Damage Control II" and published)
=> [(u'Tritanium', 939), (u'Isogen', 110), (u'Nocxium', 55), (u'Megacyte', 11), (u'Morphite', 3), (u'Nanotransistors', 22), (u'Hypersynaptic Fibers', 11)]

I am aware of the way RAMs are represented but they are not relevant here.

can someone check the output on the MSSQL with the recent export?
Desmont McCallock
#35 - 2011-12-06 07:13:55 UTC
Yet again. Your query returns what you get when you reprocess the item, not what it requires to produce.
Mnengli Noiliffe
Doomheim
#36 - 2011-12-06 07:39:01 UTC
so the correct way is to subtract any matching t1 materials from t2 materials, in case there is a t1 consumed item in RAM list?

ok, thanks for the hint and sorry if it's an off topic.
Lutz Major
Austriae Est Imperare Orbi Universo
#37 - 2011-12-06 07:55:56 UTC
Mnengli Noiliffe wrote:
so the correct way is to subtract any matching t1 materials from t2 materials, in case there is a t1 consumed item in RAM list?

ok, thanks for the hint and sorry if it's an off topic.

No. You must only subtract the recycled materials of any recycle-flagged item in the ramTypeRequirements table

For example: Expanded Cargohold II:

SELECT * FROM ramTypeRequirements WHERE typeID = 1320

You see, that the Expanded Cargohold I (requiredTypeID = 1317) is marked as recycle. Now you must subtract the materials from the Expanded Cargohold I from the other materials in the ramTypeRequirements table


See also http://www.eveonline.com/ingameboard.asp?a=topic&threadID=1220024&page=1#30
Desmont McCallock
#38 - 2011-12-06 12:11:25 UTC
Listen to Lutz. He has a PhD on the subject.
Lutz Major
Austriae Est Imperare Orbi Universo
#39 - 2011-12-06 12:14:53 UTC
Desmont McCallock wrote:
Listen to Lutz. He has a PhD on the subject.
Unfortunately I have only a Minmatar Graduation Certificate ... and it isn't even signed Sad
Desmont McCallock
#40 - 2011-12-06 15:16:00 UTC
Any ETA for fixed SDE?