These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

i need a data dump of manufacturing data, will pay for info

First post
Author
Wingmate
Perkone
Caldari State
#1 - 2013-12-06 15:10:54 UTC
good day o/

i need a data dump of all modules and their manufacturing prices. ideally this includes everything, even the stuff that you can't build anymore. one of my big manufacturing spreadsheets is way out of date, and i want to start using it again. gdocs is my product destination of choice, but excel is obviously fine as well.

here's the headers i need.

productID
materialID
prod time
portion size
volume
(unpackaged size? is this an option as well? not important if not)
productName
NeededMaterialName
quantityofMaterials
damage per job
recycle
meta
blueprint id
blueprint name

i'd expect to see a one-dimensional list that has lines that look like this:

http://i.imgur.com/CRlgORx.jpg

i can't offer a ton of isk for this, but let me know how long it took and i'll recompense appropriately.

thanks for your time.

i make spreadsheets for pretty cheap. contact me for more info.

https://forums.eveonline.com/default.aspx?g=posts&t=197433

SurrenderMonkey
State Protectorate
Caldari State
#2 - 2013-12-06 15:20:10 UTC
For the life of me, I will never understand why people love to take perfectly good relational data and try to smash it into a spreadsheet format.

OP, you should check out the static data dump. Alternatively, why not just use, e.g., Eve IPH or some other pre-existing tool?

"Help, I'm bored with missions!"

http://swiftandbitter.com/eve/wtd/

Nolen Cadmar
Caldari Provisions
Caldari State
#3 - 2013-12-06 15:21:22 UTC
I would offer my services, but to compile a list of ALL items along with all that data would take me a very long time. Not sure if there's an easy way to just pull all that data from a dump of some kind. I don't do server dumps currently. Will be looking into it in the future though. Good luck. If anyone knows how to do a dump like this, I'd be interested in speaking with them about learning :(

Nolen's Spreadsheet Guru Services

Pre-made spreadsheets available covering market, manufacturing and more!

Custom requests welcome!

Sheet Screenshots

Nolen Cadmar
Caldari Provisions
Caldari State
#4 - 2013-12-06 15:23:43 UTC
SurrenderMonkey wrote:
For the life of me, I will never understand why people love to take perfectly good relational data and try to smash it into a spreadsheet format.

OP, you should check out the static data dump. Alternatively, why not just use, e.g., Eve IPH or some other pre-existing tool?

I dissagree. Personally, I don't really like programs like IPH. And afaik, IPH doesn't have all the information the OP requested.

Obviously I'm biased, but I like my own spreadsheets better than EVE IPH. Programs like that tend to try and cover EVERYTHING. Sometimes it's nice to have a simple, less complicated spreadsheet that performs the same job without giving you a headache.

Nolen's Spreadsheet Guru Services

Pre-made spreadsheets available covering market, manufacturing and more!

Custom requests welcome!

Sheet Screenshots

Wingmate
Perkone
Caldari State
#5 - 2013-12-06 15:28:26 UTC
i can't pull this stuff at work, and my time available to game at home is precious (my kid just turned 1!). not to mention that i never learned how to do it, and i'm totally fine paying someone else for being good at this stuff. lastly, as a guy who sells spreads for an (eve) living, i like my own stuff and would prefer to use it.

nolen, yeah, there's a way to do it with one query, i think. i'm basically just waiting until steve ronuken comes in and barfs data on me that he pulled in ten minutes =)

i make spreadsheets for pretty cheap. contact me for more info.

https://forums.eveonline.com/default.aspx?g=posts&t=197433

Nolen Cadmar
Caldari Provisions
Caldari State
#6 - 2013-12-06 15:32:27 UTC
Wingmate wrote:
i can't pull this stuff at work, and my time available to game at home is precious (my kid just turned 1!). not to mention that i never learned how to do it, and i'm totally fine paying someone else for being good at this stuff. lastly, as a guy who sells spreads for an (eve) living, i like my own stuff and would prefer to use it.

nolen, yeah, there's a way to do it with one query, i think. i'm basically just waiting until steve ronuken comes in and barfs data on me that he pulled in ten minutes =)

Honestly, I was expecting the same thing :)

He'll be here sooner or later.

Nolen's Spreadsheet Guru Services

Pre-made spreadsheets available covering market, manufacturing and more!

Custom requests welcome!

Sheet Screenshots

Lucas Kell
Solitude Trading
S.N.O.T.
#7 - 2013-12-06 16:12:59 UTC
Depending on how lazy I'm feeling I might throw this out later. How much are you paying me to not feel lazy? :D

The Indecisive Noob - EVE fan blog.

Wholesale Trading - The new bulk trading mailing list.

Wingmate
Perkone
Caldari State
#8 - 2013-12-06 16:51:13 UTC
100m or so if it takes a while. alternatively, is the plex charity thing still running? i'll contribute 150m to that instead based on your preference.

i make spreadsheets for pretty cheap. contact me for more info.

https://forums.eveonline.com/default.aspx?g=posts&t=197433

Tau Cabalander
Retirement Retreat
Working Stiffs
#9 - 2013-12-06 18:29:53 UTC
More appropriate post for the EVE Technology Lab
Fubar
Eagle Eye Inc.
#10 - 2013-12-06 18:43:41 UTC
You can use this list that I created for my UES spreadsheet.

Blueprint, ore, ice text files <--- period files use a period as the decimal separator and the comma files use the comma as the decimal separator.

Enjoy.
Wingmate
Perkone
Caldari State
#11 - 2013-12-06 19:59:48 UTC  |  Edited by: Wingmate
tau, you're totally right. just derped on the forum screen i guess.

fubar, i can't access that document, unfortunately. i'll get you an email address that you can attach it to, give me a second.

i'll update if/when i hear from fubar.

i make spreadsheets for pretty cheap. contact me for more info.

https://forums.eveonline.com/default.aspx?g=posts&t=197433

Wafflehead
Garoun Investment Bank
Gallente Federation
#12 - 2013-12-06 21:40:18 UTC
Maybe you should try one of them spreadsheet services?
oh wait.. you offer that... why cant you create this?
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#13 - 2013-12-06 21:52:24 UTC  |  Edited by: Steve Ronuken
http://www.fuzzwork.co.uk/resources/materialsfull.zip

Not quite all you want, but other bits can be grabbed from invBlueprintTypes and invTypes, with a vlookup.


select invTypeMaterials.typeid,materialtypeid,it1.typename productname,it2.typename materialname,quantity,1 damageperjob,0 recycle,metagroupname meta,blueprinttypeid,it3.typeid blueprintname,'basic' materialtype
from
invTypeMaterials
join invTypes it1 on invTypeMaterials.typeid=it1.typeid
join invTypes it2 on invTypeMaterials.materialtypeid=it2.typeid
join invBlueprintTypes on invBlueprintTypes.producttypeid=invTypeMaterials.typeid
join invTypes it3 on invBlueprintTypes.blueprinttypeid=it3.typeid
join invMetaTypes on invMetaTypes.typeID=it1.typeid
join invMetaGroups on invMetaGroups.metaGroupID=invMetaTypes.metaGroupID;


select it1.typeid,ramTypeRequirements.requiredtypeid,it1.typename productname,it2.typename materialname,quantity,1 damageperjob,0 recycle,metagroupname meta,blueprinttypeid,it3.typeid blueprintname,'basic' materialtype from
ramTypeRequirements join invBlueprintTypes on ramTypeRequirements.typeid=invBlueprintTypes.blueprinttypeid
join invTypes it1 on invBlueprintTypes.producttypeid=it1.typeid
join invTypes it2 on ramTypeRequirements.requiredtypeid=it2.typeid
join invTypes it3 on invBlueprintTypes.blueprinttypeid=it3.typeid
join invMetaTypes on invMetaTypes.typeID=it1.typeid
join invMetaGroups on invMetaGroups.metaGroupID=invMetaTypes.metaGroupID
join invGroups on invGroups.groupid=it1.groupid
where activityid=1 and categoryid!=16;

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Wingmate
Perkone
Caldari State
#14 - 2013-12-06 22:08:04 UTC
Wafflehead wrote:
Maybe you should try one of them spreadsheet services?
oh wait.. you offer that... why cant you create this?


thanks for reading the thread.

steve, awesome as always. thanks again dude. you're right, i can get the rest of what i want there.

i make spreadsheets for pretty cheap. contact me for more info.

https://forums.eveonline.com/default.aspx?g=posts&t=197433

Zifrian
The Frog Pond
Ribbit.
#15 - 2013-12-06 22:36:12 UTC
I have all this data in Access for IPH working files so it was relatively easy to pull, but you really should look into getting it for yourself in the future through either Steve's conversions or your own program. Because every time they have a patch and change something, you'll have to update it. Not to mention that I'm not sure I got everything you wanted and going back and forth to get something like this is time consuming to get it the way you want. Plus you'll be confident the data is correct.

https://docs.google.com/spreadsheet/ccc?key=0AukAV6sUNfRndDhMOFVkdTktLW91RDUzQ2pvNUVkNmc&usp=sharing

Maximze your Industry Potential! - Download EVE Isk per Hour!

Import CCP's SDE - EVE SDE Database Builder

Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#16 - 2013-12-06 23:10:31 UTC
oops. Forgot that the T1 modules don't have an entry in the invMetaTypes table.

Re-exported with a left join and a coalesce

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

ISD Ezwal
ISD Community Communications Liaisons
ISD Alliance
#17 - 2013-12-07 00:05:09 UTC
This thread has been moved to EVE Technology Lab.

ISD Ezwal Community Communication Liaisons (CCLs)

Wingmate
Perkone
Caldari State
#18 - 2013-12-09 22:54:23 UTC
i combined some of steve and fubar's info and was able to get what i need. i'm starting to approach google's max number of cells in a sheet just with that =3 i need to purge some stuff that's unused so it's back in range, but i appreciate the assistance.

i'll try to remember to pay out tonight when i get home.

i make spreadsheets for pretty cheap. contact me for more info.

https://forums.eveonline.com/default.aspx?g=posts&t=197433

Alghara
Les chevaliers de l'ordre
Goonswarm Federation
#19 - 2013-12-11 15:34:43 UTC  |  Edited by: Alghara
Steve Ronuken wrote:

select it1.typeid,ramTypeRequirements.requiredtypeid,it1.typename productname,it2.typename materialname,quantity,1 damageperjob,0 recycle,metagroupname meta,blueprinttypeid,it3.typeid blueprintname,'basic' materialtype from
ramTypeRequirements join invBlueprintTypes on ramTypeRequirements.typeid=invBlueprintTypes.blueprinttypeid
join invTypes it1 on invBlueprintTypes.producttypeid=it1.typeid
join invTypes it2 on ramTypeRequirements.requiredtypeid=it2.typeid
join invTypes it3 on invBlueprintTypes.blueprinttypeid=it3.typeid
join invMetaTypes on invMetaTypes.typeID=it1.typeid
join invMetaGroups on invMetaGroups.metaGroupID=invMetaTypes.metaGroupID
join invGroups on invGroups.groupid=it1.groupid
where activityid=1 and categoryid!=16;


I believe there are one mistake

select it1.typeid,ramTypeRequirements.requiredtypeid,it1.typename productname,it2.typename materialname,quantity,1 damageperjob,0 recycle,metagroupname meta,blueprinttypeid,it3.typeid blueprintname,'basic' materialtype from
ramTypeRequirements join invBlueprintTypes on ramTypeRequirements.typeid=invBlueprintTypes.blueprinttypeid
join invTypes it1 on invBlueprintTypes.producttypeid=it1.typeid
join invTypes it2 on ramTypeRequirements.requiredtypeid=it2.typeid
join invTypes it3 on invBlueprintTypes.blueprinttypeid=it3.typeid
join invMetaTypes on invMetaTypes.typeID=it1.typeid
join invMetaGroups on invMetaGroups.metaGroupID=invMetaTypes.metaGroupID
join invGroups on invGroups.groupid=it2.groupid <--- it1 is not correct for me It2 is correct if you would like to delete the skill
where activityid=1 and categoryid!=16;
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#20 - 2013-12-11 16:20:10 UTC
You're right. Just means the clause was useless, rather than eliminating results which should have got through, thankfully.

The metatype and metagroup clauses are also a mistake, as it should be an outer join for them (along with a coalesce on the metagroupname, to fill in T1)

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter