These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

EVE-Central - The classic is back with updates
Author
Previous Topic Next Topic
Kaladr
Viziam
Amarr Empire
#21 - 2012-01-20 03:46:33 UTC
EVE-Central is now using the new server just for database requests. During peak times, queries should be significantly faster. All of the old code is still running.

I will be running a beta-test for the new API backend in about a week - stay tuned for details!

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Kaladr
Viziam
Amarr Empire
#22 - 2012-01-24 21:59:14 UTC
Now updated with new exciting ammo names, like Trauma!

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Omega Flames
Caldari Provisions
Caldari State
#23 - 2012-01-26 13:48:26 UTC
When we use the xml api what would be the best ratio of items / import? I have a spreadsheet that needs info on about 120+ items and I've always wondered how to setup the imports so it does the least impact on your servers to prevent getting "data could not be retrieved" errors.
Jaqa
Royale Strategic Imperative
#24 - 2012-02-04 23:00:45 UTC
Great to hear--keep up the great work.

The Original Jaqalope Pilot of the Transportosaurus Rex 100% Free Range
Kaladr
Viziam
Amarr Empire
#25 - 2012-02-06 18:01:07 UTC
Omega Flames wrote:
When we use the xml api what would be the best ratio of items / import? I have a spreadsheet that needs info on about 120+ items and I've always wondered how to setup the imports so it does the least impact on your servers to prevent getting "data could not be retrieved" errors.


I suggest 20 for statistics only calls, 5 for full order lists.

Also, avoid making more than about 2 requests per second or you may run into the rate limiter.

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Omega Flames
Caldari Provisions
Caldari State
#26 - 2012-02-08 20:55:10 UTC
Kaladr wrote:
Omega Flames wrote:
When we use the xml api what would be the best ratio of items / import? I have a spreadsheet that needs info on about 120+ items and I've always wondered how to setup the imports so it does the least impact on your servers to prevent getting "data could not be retrieved" errors.


I suggest 20 for statistics only calls, 5 for full order lists.

Also, avoid making more than about 2 requests per second or you may run into the rate limiter.

Well I'm using google docs so I assume I have no control over the requests per second?
Callean Drevus
Perkone
Caldari State
#27 - 2012-02-08 21:34:48 UTC
I'm fairly certain google docs will never reach the limit, as it caches every page you request for an unknown span of time (a few hours probably).

Developer/Creator of EVE Marketeer
Kaladr
Viziam
Amarr Empire
#28 - 2012-04-25 04:39:47 UTC
Some updates:


  • API calls are now routed to another server and hosted by the new server stack. If you have any odd issues, please let me know ASAP.
  • The E-mail push service will gain a generatedAt field trailing all other fields, such inclusion in EMDR.
  • The new unified uploader API is undergoing testing to use with third party clients. If you are currently uploading to EVE-Central, and would like to test the new API, please let me know.

Creator of EVE-Central.com, the longest running EVE Market Aggregator
D Program
#29 - 2012-04-25 05:39:07 UTC
Thank you for the great service. EVE-Cost is using EVE-Central API also now!

What is this sorcery?

http://www.eve-cost.eu
Desmont McCallock
#30 - 2012-04-25 07:26:07 UTC  |  Edited by: Desmont McCallock
Kaladr wrote:
The new unified uploader API is undergoing testing to use with third party clients. If you are currently uploading to EVE-Central, and would like to test the new API, please let me know.
Do we target the same gateway? (Answered by testing. Yes it's the same gateway)
Could it be possible to make it accept compressed data?

I want to help you test by pointing the EMUU at you.

Edit: Currently while uploading to EC using UF I get an empty string response. It would be useful if that could return a text if it's an error or "1" if the upload succeeded. I suggest "1" as it can easily be converted to a boolean that represents the "True" value and sticks with the way other servers, that receive data, have it already implemented.

Edit2: Trying a bad request I see that the server indeed returns a text on error, so what is left is to return "1" on success.
Also in order to use the compressed feature, we set the ContentEncoding header to "gzip" that helps the server detect that the post data are in compressed form. We use standard zlib compression.
Kaladr
Viziam
Amarr Empire
#31 - 2012-04-25 20:39:08 UTC
It appears to be an nginx issue - previously compressed data was supported. Once I merge in Escalation data I'll look at it.

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Kaladr
Viziam
Amarr Empire
#32 - 2012-04-26 05:00:55 UTC
Hey everyone:


  • Escalation data is now loaded. Search away for your faction items.
  • GZIP is re-enabled on the API server for bandwidth savings.

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Desmont McCallock
#33 - 2012-04-26 06:08:27 UTC
Still response for success is returned as empty text.
Attempting to upload a compressed UF message results in error message: Bad Request.
Norian Lonark
Center for Advanced Studies
Gallente Federation
#34 - 2012-04-26 12:49:45 UTC
Thank you Kaladr.

I have always used EVE-Central and your efforts in keeping this great community resource going is really appreciated.

Start wide, expand further, and never look back
Ilyk Halibut
Deep Core Mining Inc.
Caldari State
#35 - 2012-04-27 02:06:06 UTC
Kaladr wrote:
Some updates:

  • The E-mail push service will gain a generatedAt field trailing all other fields, such inclusion in EMDR.

Has this already been deployed? I'm not seeing it in the feed.

EVE Market Data Relay - A real-time feed of EVE Market data http://www.eve-emdr.com
Kaladr
Viziam
Amarr Empire
#36 - 2012-05-01 23:24:41 UTC
Ilyk Halibut wrote:
Kaladr wrote:
Some updates:

  • The E-mail push service will gain a generatedAt field trailing all other fields, such inclusion in EMDR.

Has this already been deployed? I'm not seeing it in the feed.


generatedAt is now deployed (though likely horribly broken, though it did work in testing :))

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Kaladr
Viziam
Amarr Empire
#37 - 2012-05-04 21:40:45 UTC  |  Edited by: Kaladr
Exciting news!
New APIs!

First off, I moved all of the existing API documentation to the EVE-Central Wiki. You can find documentation (with less typos, etc) here:

http://dev.eve-central.com/evec-api/start


I'd like to highlight two new APIs:

quicklook on path

For a single market type, get all of the orders which lie on a path between two systems.

http://dev.eve-central.com/evec-api/start#quicklook_path

Route

Get the route between two systems as the auto-pilot flies (mostly, kinda)

http://dev.eve-central.com/evec-api/start#route

You'll also note that the route API is returning JSON. I will be upgrading the other APIs to emit both XML and JSON for convenience.

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Desmont McCallock
#38 - 2012-05-05 20:22:53 UTC
Any progress on supporting UF?
Kaladr
Viziam
Amarr Empire
#39 - 2012-05-05 23:29:44 UTC
Desmont McCallock wrote:
Any progress on supporting UF?


Currently in progress. I'm testing interoperability with EMUU now.

Creator of EVE-Central.com, the longest running EVE Market Aggregator
Arch Raptor
Alternate Intention
ZERG REBORN
#40 - 2012-05-06 13:45:51 UTC
xml is working great, but I fear I may be uploading too much data from your servers as it hits a unable to pull error now and then. To make it easier, is there a way to load the entire market database from select systems say... once a hour / day?

I started to make a doc that pulled all 32,000 items from the select market and realized that was a huge waste of my time and your bandwidth. 32,000 * 4 markets * 2 / 20 lines per quary = 12800 quary requests. Can I get that down to maybe... 50 or less?

Trying to create a sheet that compairs data on 16 markets and gives automated results on lowest / highest price changes and % increases.

Also what is the tab on exported data " stddev" and "percentile" refering to? guessing at percentile might be % change, no idea what stddev is... sounds like a disease lol

Need this to work on a quary system for excel 2007, any help would be appriciated.