These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

EVE-Central - The classic is back with updates

Author
Kaladr
Viziam
Amarr Empire
#41 - 2012-05-06 23:15:42 UTC
Arch Raptor wrote:
xml is working great, but I fear I may be uploading too much data from your servers as it hits a unable to pull error now and then. To make it easier, is there a way to load the entire market database from select systems say... once a hour / day?


Not at the moment.

Generally, if you're hitting an error, its due to:


  1. An actual code bug (gasp) on my side.
  2. A malformed request (spaces at the end, types that don't exist, etc etc).
  3. I restarted the server without the failover in place (sorry)


Quote:

Also what is the tab on exported data " stddev" and "percentile" refering to? guessing at percentile might be % change, no idea what stddev is... sounds like a disease lol

Need this to work on a quary system for excel 2007, any help would be appriciated.


percentile = 5% buy/sell. If you sold to the top 5% (in volume, not just orders), and took the total price, that would be percentile. For sell, its as if you've bought 5% of the market (in volume), lowest price first.

stddev = Standard deviation over all order prices.

Creator of EVE-Central.com, the longest running EVE Market Aggregator

Kaladr
Viziam
Amarr Empire
#42 - 2012-05-07 01:58:48 UTC
As a note, Unified Upload format processing is now enabled. I'm not claiming full conformance will all implementations (i.e., woking through some compression issues with EMUU right now), but its functional enough to test with.

Creator of EVE-Central.com, the longest running EVE Market Aggregator

Arch Raptor
Alternate Intention
ZERG REBORN
#43 - 2012-05-07 06:05:16 UTC
Kaladr wrote:
[quote=Arch Raptor]xml is working great, but I fear I may be uploading too much data from your servers as it hits a unable to pull error now and then. To make it easier, is there a way to load the entire market database from select systems say... once a hour / day?


Not at the moment.

Is this something that is being in the works? How much of a strain on your systems if I were to create that many query requests?

Looking at around 7500 or more, pulling all items 32 times


Generally, if you're hitting an error, its due to:


  1. An actual code bug (gasp) on my side.
  2. A malformed request (spaces at the end, types that don't exist, etc etc).
  3. I restarted the server without the failover in place (sorry)


found the errors don't happen all the time and are on different communication requests all the time. Might be my set, I'll look into it further. Only wrote 6000 lines of requests so far, not impossible that I made an error somewhere
Bluestream3
the Goose Flock
#44 - 2012-05-08 23:02:55 UTC
I've been getting a lot of 0's from the marketstat API when the prices are there if you search on the eve-central page. Right now for example something seems to be wrong with Amarr Control Towers (http://api.eve-central.com/api/marketstat?typeid=12235&regionlimit=10000002). I don't know if you're already aware or if it's something intended. I just thought I'd post here to notify you just in-case.
Kaladr
Viziam
Amarr Empire
#45 - 2012-05-08 23:14:59 UTC
Bluestream3 wrote:
I've been getting a lot of 0's from the marketstat API when the prices are there if you search on the eve-central page. Right now for example something seems to be wrong with Amarr Control Towers (http://api.eve-central.com/api/marketstat?typeid=12235&regionlimit=10000002). I don't know if you're already aware or if it's something intended. I just thought I'd post here to notify you just in-case.


Check the age of the orders - the default view on the web interface is 360 hours, whereas the default view on the API is 24 hours. This can be fixed with the hours= parameter.

Creator of EVE-Central.com, the longest running EVE Market Aggregator

Bluestream3
the Goose Flock
#46 - 2012-05-09 00:03:43 UTC
Kaladr wrote:
Bluestream3 wrote:
I've been getting a lot of 0's from the marketstat API when the prices are there if you search on the eve-central page. Right now for example something seems to be wrong with Amarr Control Towers (http://api.eve-central.com/api/marketstat?typeid=12235&regionlimit=10000002). I don't know if you're already aware or if it's something intended. I just thought I'd post here to notify you just in-case.


Check the age of the orders - the default view on the web interface is 360 hours, whereas the default view on the API is 24 hours. This can be fixed with the hours= parameter.


Oh, can't believe I didn't notice that. Thanks.
Andy DelGardo
#47 - 2012-05-18 20:27:56 UTC
Hi,

short question: How often is eve-central updated for upload data? I noticed that even after 15mins i keep seeing the old data, instead of the refreshed i uploaded?

bye Andy
Kaladr
Viziam
Amarr Empire
#48 - 2012-05-19 04:45:19 UTC
Andy DelGardo wrote:
Hi,

short question: How often is eve-central updated for upload data? I noticed that even after 15mins i keep seeing the old data, instead of the refreshed i uploaded?

bye Andy


The web interface can cache up to 30 minutes.

The API and trade finder refreshes immediately.

Creator of EVE-Central.com, the longest running EVE Market Aggregator

Desmont McCallock
#49 - 2012-05-19 05:07:43 UTC
Kaladr wrote:
The web interface can cache up to 30 minutes.
Seriously, you need to reduce that a lot.
Andy DelGardo
#50 - 2012-05-19 08:07:07 UTC
Kaladr wrote:

The web interface can cache up to 30 minutes.

The API and trade finder refreshes immediately.


Ah so only the Web lacks behind, good to know since i just needed the fresh data in a spreadsheet. So i can simply ignore the web version in those cases i use the API.

Thx Andy
l0rd carlos
the king asked me to guard the mountain
#51 - 2012-05-19 15:22:15 UTC
Is there a way to pull data from the API without the TypeID, but with the item name?

Youtube Channel about Micro and Small scale PvP with commentary: Fleet Commentary by l0rd carlos

Scrapyard Bob
EVE University
Ivy League
#52 - 2012-05-20 12:29:27 UTC
l0rd carlos wrote:
Is there a way to pull data from the API without the TypeID, but with the item name?


Given how often CCP likes to change item names these days (bored interns?), you should simply grab one of the static data dumps and figure out the type IDs.

(See also jEVEAssets, which now provides an "items" tool which has a list of all the items and their typeIDs. Or the CSV dump over at fuzzworks.)
Kaladr
Viziam
Amarr Empire
#53 - 2012-05-22 14:48:56 UTC
Desmont McCallock wrote:
Kaladr wrote:
The web interface can cache up to 30 minutes.
Seriously, you need to reduce that a lot.



Its now reduced to 2-3 minutes. It will be 0 soon when the web front end calls the API.

Creator of EVE-Central.com, the longest running EVE Market Aggregator

Zifrian
The Frog Pond
Ribbit.
#54 - 2012-05-23 00:00:04 UTC
Any issues with price updates via API? I'm getting a lot of 0.00's right now for Jita but there are prices listed when looking at the quick look.

Maybe this example will help? Maybe I'm doing something wrong?

http://eve-central.com/home/quicklook.html?typeid=30474

My query: http://api.eve-central.com/api/marketstat?typeid=30474&usesystem=30000142

Maximze your Industry Potential! - Download EVE Isk per Hour!

Import CCP's SDE - EVE SDE Database Builder

Andy DelGardo
#55 - 2012-05-25 09:33:42 UTC
Is there still no way to get the daily/weekly trade volume via api? The stat is show in the web version, so i would really like this stat available in the api too.
Kaladr
Viziam
Amarr Empire
#56 - 2012-05-25 21:27:51 UTC
Inferno is now loaded.

Creator of EVE-Central.com, the longest running EVE Market Aggregator

Desmont McCallock
#57 - 2012-05-30 12:30:33 UTC  |  Edited by: Desmont McCallock
There is a visual issue on the site. Reported time isn't showing correctly (usually when the data are fresh?).
Kaladr
Viziam
Amarr Empire
#58 - 2012-06-03 02:28:04 UTC
Desmont McCallock wrote:
There is a visual issue on the site. Reported time isn't showing correctly (usually when the data are fresh?).


Will look into it. Odd one.

Creator of EVE-Central.com, the longest running EVE Market Aggregator

Desmont McCallock
#59 - 2012-06-03 06:34:07 UTC
I don't know if you have done anything but it looks like it's fixed.
Andy DelGardo
#60 - 2012-06-03 12:25:07 UTC  |  Edited by: Andy DelGardo
Kaladr wrote:
Desmont McCallock wrote:
There is a visual issue on the site. Reported time isn't showing correctly (usually when the data are fresh?).


Will look into it. Odd one.


Not fixed for me, get more of those broken reports and its not just a visual bug, since the API "sethours=" also breaks on those reports. It will filter out all those reports, with the strange time format "06-02 1", resulting in quite some missing data. I just noticed this, since in one of my spreadsheets i got empty reports all over the place, which could not be.

Maybe its the new evemon uploader?