These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Eve-MarketData Problem

First post
Author
Haile Korhal
Professional Amateurs
#1 - 2016-12-06 03:08:53 UTC  |  Edited by: Haile Korhal
So I'm having yet another different problem with Eve MarketData. I'm using Excel and I'm using Eve MarketData to pull the Jita and Amarr market databases. However I've only gone as far as the Jita database before I ran into a problem. I'm using this url: http://api.eve-marketdata.com/api/item_prices2.xml?char_name=Haile Korhal&type_ids=&station_ids =60003760&buysell=s and it seems to pull everything just fine, except a lot of values are missing. For example, I'm looking at the TypeID for the 'Augmented' Berserker which the Fuzzworks TypeID list says is 28268, it says the beserker is worth 0 isk. So I look into the database and sure enough, it's returning a value of 0, or just not pulling anything from the game at all. Going to Jita there's a bunch there, and testing other items shows the import is working, so why is it randomly leaving items out of the data import?

My end result is to get both the Amarr and Jita markets into the spreadsheet so I can use vlookups to compare data for a client. I'm not a market trader, but my client is, so I could use some assistance if at all possible.

I've scoured the fuzzworks site, the eve-marketdata site, and the eve-central site. I've been through the aggregate data site (and found nothing I understood there), I've downloaded dozens and dozens of examples and other spreadsheets, and I'm even working with one (but it is written for google sheets so it's useless in this instance). And I'm really scratching my head here. :/

Also I've just realized both the Amarr and Jita imports pull the exact same data, the exact same items are left out, and the exact same prices and dates are listed for both even though I'm using the Jita StationID and the Amarr StationID. So, obviously I'm doing something wrong here... :\

Egregious Spreadsheet Services - For Spreadsheets as a Service to businesses, corporations, and higher, look no further!

Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#2 - 2016-12-06 11:57:30 UTC
you could also try https://market.fuzzwork.co.uk/api/

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Haile Korhal
Professional Amateurs
#3 - 2016-12-06 12:27:20 UTC
Steve! You're a miracle in disguise for all the great work you do. I've run across this page before, and I really do not know what to do with it. I've followed the steps on Power Query, I'm assuming it was written for a different version because all of my options are elsewhere, but I did find the correct ones and got it to accept a url. However, when I click on import it always opens up in Brackets (not Excel) and then crashes Excel (about 50% of the time). Am I doing something wrong here?

How do I build a proper url? I assume I start with something basic, like https://market.fuzzwork.co.uk/aggregates/? then I add station and it's ID, then &types and types, do I need to add all several thousand types to the end of the url? Would that even work? I'm trying to import the entire Amarr and Jita market all in one go, so I can then use vlookups to search for the bits I want. I thought that would be a lot simpler on the server and on my end, but so far it has turned out to be a nightmare! I've watched several Youtube videos and followed them step by step and had an identical workbook on my desktop but it still didn't work, I feel like I'm missing something so basic that no one ever talks about it.

By the way, when I look at Brackets it looks like it has all the data I want, but there's no way that I know of to parse that into a table or something human readable (or even machine readable without some major scripting). Is there a feature on older Excel versions (or newer?) that would do this for me?

I'm full of questions and honestly trying to learn, but I just keep running up into a wall and I feel woefully inadequate. :/

I would like to get all of this working for Google Docs too, but for this current project I'm working on it must be done in Excel because of Google's built in limitation on data pulls and limited processing power (I've got a half dozen google sheets and I'm trying to merge them into one Excel workbook).

Egregious Spreadsheet Services - For Spreadsheets as a Service to businesses, corporations, and higher, look no further!

Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#4 - 2016-12-06 19:56:19 UTC
Powerquery works with excel 2013 and 2016.

Unfortunately, JSON is a total PITA in the lower versions.

(I guess I could look into an XML version)

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Haile Korhal
Professional Amateurs
#5 - 2016-12-07 21:16:48 UTC  |  Edited by: Haile Korhal
I know XML is going away, but it's still here now and we've got to use what we have. Once ESI becomes more fully functional and can actually replace XML entirely, then we'll definitely start switching over. But for now, XML is here and I'm trying to learn and use it.

I cannot remember my Excel version, I thought it was 2013 but it might be 2010, so I'll double check when I get home. If I need to I'll see into getting my Home Use Program fired up and switched over from my laptop to my desktop so I can start using 2016. Your API looks a lot easier to use, so I definitely want to make use of that, I just have to get it to work (I'm probably just using an old version, so I'll update this post when I do). All the guides I've seen out there say its so easy to import XML data, and I've been having so much trouble that it has to be my old version. So, we'll see.

Thank you for your reply, I'll edit this post when I know more.

EDIT: So I'm using 2013, and I still cannot get any of those steps to work. >.< There as to be something I'm doing wrong!

Egregious Spreadsheet Services - For Spreadsheets as a Service to businesses, corporations, and higher, look no further!

Haile Korhal
Professional Amateurs
#6 - 2016-12-12 22:07:33 UTC
I've still had no luck using the other API you suggested. I do have Excel 2013 so it isn't a version problem, unless the directions were written for 2016 and they're indeed different. I hate asking for help because I always second guess myself, like maybe there was more homework I could have done, but I really cannot seem to make any headway with API imports.

Has anyone else had any luck or issue getting XML API to work lately? None of the guides I can find work anymore. :/

Egregious Spreadsheet Services - For Spreadsheets as a Service to businesses, corporations, and higher, look no further!

Zad Murrard
Frozen Dawn Inc
Frozen Dawn Alliance
#7 - 2016-12-13 07:26:32 UTC
Unless you don't really need to, don't use eve-marketdata. It has issues, some of which they have acknowledged even at the website, yet nothing has been done to fix them.

Use eve central if it suits your needs https://eve-central.com/home/develop.html.