These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
12Next page
 

Phoebe 1.0 SDE is out.

First post First post
Author
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#1 - 2014-10-31 17:24:43 UTC  |  Edited by: CCP Phantom
mysql:
https://www.fuzzwork.co.uk/dump/mysql56-phoebe-1.0-107269.tbz2

postgres:
https://www.fuzzwork.co.uk/dump/phoebe-1.0-107269/postgres-phoebe-1-107269.dmp.bz2 (https://www.fuzzwork.co.uk/dump/phoebe-1.0-107269/postgres-phoebe-1-107269-schema.dmp.bz2 is the same, but in an eve schema)

sqlite:
https://www.fuzzwork.co.uk/dump/phoebe-1.0-107269/eve.db.bz2

Everything else:
https://www.fuzzwork.co.uk/dump/phoebe-1.0-107269/

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

CCP Phantom
C C P
C C P Alliance
#2 - 2014-10-31 18:56:57 UTC
Thank you!

Great work as always,Steve Ronuken Big smile

CCP Phantom - Senior Community Developer

Mana Potion
School of Applied Knowledge
Caldari State
#3 - 2014-10-31 21:00:20 UTC
As always... stellar work!

Thanks Steve
Tennoku
Mercury Nation
#4 - 2014-11-01 05:01:56 UTC
Thanks!

I noticed in another thread you posted the following query:
SELECT materialtypeid,typename,greatest(1,ceil(quantity*(1-(7/100)))) runquantity
FROM industryActivityMaterials
JOIN invTypes ON (industryActivityMaterials.materialtypeid=invTypes.typeid)
WHERE industryActivityMaterials.typeid=22465 and activityid=1;

+----------------+-------------------------------+-------------+
| materialtypeid | typename | runquantity |
+----------------+-------------------------------+-------------+
| 3828 | Construction Blocks | 22 |
| 11399 | Morphite | 14 |
| 11478 | R.A.M.- Starship Tech | 9 |
| 11533 | Magpulse Thruster | 56 |
| 11534 | Gravimetric Sensor Cluster | 70 |
| 11540 | Quantum Microprocessor | 335 |
| 11544 | Titanium Diborite Armor Plate | 1395 |
| 11550 | Graviton Reactor Unit | 14 |
| 11552 | Scalar Capacitor Unit | 140 |
| 11558 | Sustained Shield Emitter | 36 |
| 16238 | Cormorant | 1 |
+----------------+-------------------------------+-------------+


When I run that, my output is (using the postgres DB, and query modified):
SELECT "materialTypeID","typeName",greatest(1,ceil(quantity*(1-(7/100)))) as runquantity
FROM "industryActivityMaterials"
JOIN "invTypes" ON ("industryActivityMaterials"."materialTypeID"="invTypes"."typeID")
WHERE "industryActivityMaterials"."typeID"=22465 and "activityID"=1;

materialTypeID |      typeName      | runquantity
----------------+--------------------+-------------
              0 | #System            |         150
              2 | Corporation        |          60
              3 | Region             |           1
              4 | Constellation      |          23
              5 | Solar System       |          75
              6 | Sun G5 (Yellow)    |           9
              7 | Sun K7 (Orange)    |        1500
              8 | Sun K5 (Red Giant) |         360
              9 | Sun B0 (Blue)      |          38
             10 | Sun F0 (White)     |          15
(10 rows


When I look at the DB data, the materialTypeID's in the industryActivityMaterials number 0 through 10 for most or all products, appearing to be an index relative to each blueprint rather than ID's to actual invTypes. It appears I could use the info from invTypeMaterials, but I would like to understand the discrepancy here.

Has the DB structure changed since you wrote that query a few months ago? What does materialTypeID refer to?

Also, the values for industryActivityProducts productTypeID appear to be missing.

If I look at the Oceanus sqlite DB, the values appear as I would have expected them.

Thanks!
Captain Thunk
Explode. Now. Please.
Alliance. Now. Please.
#5 - 2014-11-01 07:25:10 UTC
Seriously, the datadump needs to a unified structure.

It's ridiculous with yaml parts, mssql parts and sqlite parts.

Being dependent on effectively one or two guys to convert it into something people can use is stupid
Althalus Stenory
Flying Blacksmiths
#6 - 2014-11-01 11:01:00 UTC  |  Edited by: Althalus Stenory
Tennoku wrote:
...


This is the exact same problem as I reported here for the early phoebe SDE : https://forums.eveonline.com/default.aspx?g=posts&m=5128325#post5128325

I was hoping it'll be fixed :/

EsiPy - Python 2.7 / 3.3+ Swagger Client based on pyswagger for ESI

CCP FoxFour
C C P
C C P Alliance
#7 - 2014-11-01 11:28:50 UTC
Captain Thunk wrote:
Seriously, the datadump needs to a unified structure.

It's ridiculous with yaml parts, mssql parts and sqlite parts.

Being dependent on effectively one or two guys to convert it into something people can use is stupid


And we agree, it's on my list of things to look at. What I actually want to do is get it to be an artifact of our CI system, and then with the push of a button it be uploaded to our CDN and added to an RSS feed so that you guys can just follow that and get notified when a new version is released.

Thats the dream, and isn't actually that far off. There are just other things that I want to do that are taking higher priority. It's really hard to justify the effort of doing that work when someone like Steve is doing it and I could be doing other things.

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.

CCP FoxFour
C C P
C C P Alliance
#8 - 2014-11-01 11:30:14 UTC
Althalus Stenory wrote:
Tennoku wrote:
...


This is the exact same problem as I reported here for the early phoebe SDE : https://forums.eveonline.com/default.aspx?g=posts&m=5128325#post5128325

I was hoping it'll be fixed :/


I have passed word of this on to others, but it's the weekend now and with the Phoebe release on Tuesday it may be a bit before a response.

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.

Althalus Stenory
Flying Blacksmiths
#9 - 2014-11-01 12:01:46 UTC  |  Edited by: Althalus Stenory
CCP FoxFour wrote:
Althalus Stenory wrote:
Tennoku wrote:
...


This is the exact same problem as I reported here for the early phoebe SDE : https://forums.eveonline.com/default.aspx?g=posts&m=5128325#post5128325

I was hoping it'll be fixed :/


I have passed word of this on to others, but it's the weekend now and with the Phoebe release on Tuesday it may be a bit before a response.

No problems, thanks :)

But just to be sure, my previous post was about sde conversion issues (not taking the correct value in the yaml), and not data duplications (as it seems there is no more issues for this now :D)

EsiPy - Python 2.7 / 3.3+ Swagger Client based on pyswagger for ESI

CCP FoxFour
C C P
C C P Alliance
#10 - 2014-11-01 13:18:43 UTC
Althalus Stenory wrote:
CCP FoxFour wrote:
Althalus Stenory wrote:
Tennoku wrote:
...


This is the exact same problem as I reported here for the early phoebe SDE : https://forums.eveonline.com/default.aspx?g=posts&m=5128325#post5128325

I was hoping it'll be fixed :/


I have passed word of this on to others, but it's the weekend now and with the Phoebe release on Tuesday it may be a bit before a response.

No problems, thanks :)

But just to be sure, my previous post was about sde conversion issues (not taking the correct value in the yaml), and not data duplications (as it seems there is no more issues for this now :D)


Ah yes, it does appear to have been an issue in the conversion as the YAML and such all seems fine.

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.

Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#11 - 2014-11-01 20:29:59 UTC
CCP FoxFour wrote:
Althalus Stenory wrote:
CCP FoxFour wrote:
Althalus Stenory wrote:
Tennoku wrote:
...


This is the exact same problem as I reported here for the early phoebe SDE : https://forums.eveonline.com/default.aspx?g=posts&m=5128325#post5128325

I was hoping it'll be fixed :/


I have passed word of this on to others, but it's the weekend now and with the Phoebe release on Tuesday it may be a bit before a response.

No problems, thanks :)

But just to be sure, my previous post was about sde conversion issues (not taking the correct value in the yaml), and not data duplications (as it seems there is no more issues for this now :D)


Ah yes, it does appear to have been an issue in the conversion as the YAML and such all seems fine.



Sad I screwed up.

It's the same problem as with the initial beta. I created a new loader script, and this time, forgot and ran the old one. I'll have a proper update soon.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#12 - 2014-11-01 21:04:36 UTC
That's it updated.

If you need just the industry tables (on mysql) https://www.fuzzwork.co.uk/dump/phoebe-1.0-107269/industryTables.sql.bz2

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Tennoku
Mercury Nation
#13 - 2014-11-02 09:47:20 UTC
Great, thanks! I'll check that out as soon as I have time.
Ydnari
Estrale Frontiers
#14 - 2014-11-04 01:35:58 UTC
The blueprints.yaml and hence the conversion still have Data Interfaces as materials for invention.

e.g.

10679:
  activities:
    copying:
      time: 720
    invention:
      materials:
      - quantity: 1
        typeID: 20412
      - quantity: 1
        typeID: 20414
      - quantity: 1
       typeID: 25556


25556 is Incognito Data Interface, 10679 is 125mm Railgun I Blueprint.

http://community.eveonline.com/news/dev-blogs/invention-updates/ says Data Interfaces are going away.

--

Ydnari
Estrale Frontiers
#15 - 2014-11-04 15:05:33 UTC
Ydnari wrote:
The blueprints.yaml and hence the conversion still have Data Interfaces as materials for invention.

e.g.

10679:
  activities:
    copying:
      time: 720
    invention:
      materials:
      - quantity: 1
        typeID: 20412
      - quantity: 1
        typeID: 20414
      - quantity: 1
       typeID: 25556


25556 is Incognito Data Interface, 10679 is 125mm Railgun I Blueprint.

http://community.eveonline.com/news/dev-blogs/invention-updates/ says Data Interfaces are going away.


And this is also in game now with the Phoebe release; 125mm Railguns still need a Data Interface to invent, which no longer exist.

--

Aineko Macx
#16 - 2014-11-04 20:02:51 UTC
Before the removal of interfaces, we could get the groupID of compatible decryptors for invention via dgmAttributeType=1115 of the used interface. Now that they are gone, there doesn't seem to be a clean way to get this data.
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#17 - 2014-11-04 20:23:05 UTC
Aineko Macx wrote:
Before the removal of interfaces, we could get the groupID of compatible decryptors for invention via dgmAttributeType=1115 of the used interface. Now that they are gone, there doesn't seem to be a clean way to get this data.



Now you use groupud 1304 (iirc).

Universal decryptors.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Desmont McCallock
#18 - 2014-11-04 20:28:20 UTC
Also I found data inconsistencies in blueprints.yaml data. https://forums.eveonline.com/default.aspx?g=posts&m=5174902#post5174902
Aineko Macx
#19 - 2014-11-05 18:51:51 UTC
ramAssemblyLineTypeDetailPerCategory is missing all rows for categoryID=9 (Blueprints)
Aineko Macx
#20 - 2014-11-06 18:59:13 UTC  |  Edited by: Aineko Macx
12Next page