These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Eve Addicts - Now with new features...
Author
Previous Topic Next Topic
Andy DelGardo
#121 - 2012-06-26 09:48:08 UTC  |  Edited by: Andy DelGardo
Quote:

I don't think i understand what you mean or want. Can you give me an example?


I just noticed a difference in the 5% percentile, from your data and other sites. So my assumption was that u build the percentile based on just the price entries per order.
Evemarketdata/Eve-marketeer actually simulate what avg. price u would get, if u buy/sell 5% of the total available volume, using the existing orders.

Example Orders:

price; volume
100; 2
90; 2
89; 1
50; 1000
48; 1000
20; 2000

5% price percentile = 97,5, while the avg. price to buy 5% volume would be something around 50.
I hope this makes sense.

bye Andy
Snarf Aldes
University of Caille
Gallente Federation
#122 - 2012-06-26 10:16:31 UTC
Andy DelGardo wrote:
Quote:

I don't think i understand what you mean or want. Can you give me an example?


I just noticed a difference in the 5% percentile, from your data and other sites. So my assumption was that u build the percentile based on just the price entries per order.
Evemarketdata/Eve-marketeer actually simulate what avg. price u would get, if u buy/sell 5% of the total available volume, using the existing orders.

Example Orders:

price; volume
100; 2
90; 2
89; 1
50; 1000
48; 1000
20; 2000

5% price percentile = 97,5, while the avg. price to buy 5% volume would be something around 50.
I hope this makes sense.

bye Andy

This is exactly what is supposed to be calculated, unfortunately there is some error in the query i'm doing. I'm trying to figure out how to solve it atm.

Creator of Eve Addicts
Desmont McCallock
#123 - 2012-06-26 10:18:33 UTC
Thanks for the addition of the "Range" column. As always, you live up to our expectations. Big smile
Snarf Aldes
University of Caille
Gallente Federation
#124 - 2012-06-26 11:14:01 UTC
Snarf Aldes wrote:
Andy DelGardo wrote:
Quote:

I don't think i understand what you mean or want. Can you give me an example?


I just noticed a difference in the 5% percentile, from your data and other sites. So my assumption was that u build the percentile based on just the price entries per order.
Evemarketdata/Eve-marketeer actually simulate what avg. price u would get, if u buy/sell 5% of the total available volume, using the existing orders.

Example Orders:

price; volume
100; 2
90; 2
89; 1
50; 1000
48; 1000
20; 2000

5% price percentile = 97,5, while the avg. price to buy 5% volume would be something around 50.
I hope this makes sense.

bye Andy

This is exactly what is supposed to be calculated, unfortunately there is some error in the query i'm doing. I'm trying to figure out how to solve it atm.

I solved it, it was a stupid mistake in the query.

Creator of Eve Addicts
Andy DelGardo
#125 - 2012-06-26 11:15:38 UTC  |  Edited by: Andy DelGardo
Snarf Aldes wrote:

I solved it, it was a stupid mistake in the query.


Yay thx Blink

Basically your site speed and the list function to pull data via api is much better than any of the other sites out there :) Like noted, i really wished i could also pull orders via your API. The main problem of other sites is that excel data import has a URL character limit, so u cant import a URL with "&iDs=100,101.....................501", while using your list-name feature makes this possible for me and is also much more user friendly than building ling ID parameter URLs.

There is a tick using url shortener services, but those redirects also cause problems in excel.
Andy DelGardo
#126 - 2012-06-26 19:07:03 UTC  |  Edited by: Andy DelGardo
Hi,

unfortunately the math is still of :(

Examples:

http://eve.addicts.nl/api/prices.php?typeID=30562&regionID=10000002&detailed=true
http://api.eve-marketdata.com/api/item_prices2.xml?char_name=demo&type_ids=30562&region_ids=10000002&buysell=a
http://api.eve-central.com/api/marketstat?typeid=30562&regionlimit=10000002

Eve-Addicts list the 5% sell price at: 30000.00
eve-marketdata at: 74926.35
eve-central at: 74926.36

bye Andy


PS: I just noticed that the webpage-api list the correct "74926.36" price, so u might have forgotten to also apply the fix to the xml api?
Desmont McCallock
#127 - 2012-07-23 08:11:12 UTC  |  Edited by: Desmont McCallock
Site down. Looks like it got ganked.
Update: Working again.
Snarf Aldes
University of Caille
Gallente Federation
#128 - 2012-07-23 10:02:10 UTC
Desmont McCallock wrote:
Site down. Looks like it got ganked.
Update: Working again.

The VPS is having some issues, high iowaits resulting in high load.

Creator of Eve Addicts
Desmont McCallock
#129 - 2012-07-23 10:05:34 UTC
May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS.
Snarf Aldes
University of Caille
Gallente Federation
#130 - 2012-07-23 10:15:26 UTC
Desmont McCallock wrote:
May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS.

AFAIK NGINX is very good for static stuff, but not as good for dynamic stuff like php.
Also, Apache has never been a problem so far.

Normally everything is working fine, although MySQL could use more ram...

Creator of Eve Addicts
Snarf Aldes
University of Caille
Gallente Federation
#131 - 2012-07-23 10:18:34 UTC
Andy DelGardo wrote:
Hi,

unfortunately the math is still of :(

Examples:

http://eve.addicts.nl/api/prices.php?typeID=30562&regionID=10000002&detailed=true
http://api.eve-marketdata.com/api/item_prices2.xml?char_name=demo&type_ids=30562&region_ids=10000002&buysell=a
http://api.eve-central.com/api/marketstat?typeid=30562&regionlimit=10000002

Eve-Addicts list the 5% sell price at: 30000.00
eve-marketdata at: 74926.35
eve-central at: 74926.36

bye Andy


PS: I just noticed that the webpage-api list the correct "74926.36" price, so u might have forgotten to also apply the fix to the xml api?

Sorry for the late reply...

I had indeed forgotten to change the api queries Roll

Creator of Eve Addicts
Desmont McCallock
#132 - 2012-07-23 10:29:04 UTC
Snarf Aldes wrote:
Desmont McCallock wrote:
May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS.

AFAIK NGINX is very good for static stuff, but not as good for dynamic stuff like php.
Also, Apache has never been a problem so far.

Normally everything is working fine, although MySQL could use more ram...

I don't think that's the case anymore. Have a look at this: http://www.sitepoint.com/php-with-nginx-is-about-to-become-a-lot-easier/

AFAIK PHP-FPM is in PHP core as from 5.3.3.

Btw, EVE Marketeer is using NGINX/MariaDB/PHP setup and it plays quite well.
Xeross155
Sebiestor Tribe
Minmatar Republic
#133 - 2012-07-30 12:04:29 UTC
Desmont McCallock wrote:
Snarf Aldes wrote:
Desmont McCallock wrote:
May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS.

AFAIK NGINX is very good for static stuff, but not as good for dynamic stuff like php.
Also, Apache has never been a problem so far.

Normally everything is working fine, although MySQL could use more ram...

I don't think that's the case anymore. Have a look at this: http://www.sitepoint.com/php-with-nginx-is-about-to-become-a-lot-easier/

AFAIK PHP-FPM is in PHP core as from 5.3.3.

Btw, EVE Marketeer is using NGINX/MariaDB/PHP setup and it plays quite well.

NGINX itself doesn't do PHP, it hands it off through FCGI, UWSGI or otherwise. This has the benefit that not every NGINX process has to load the PHP interpreter (Something that costs a lot of RAM when using Apache).

I had a VPS with Apache+mod_php and it was continuously running out of RAM, with NGINX+php-fpm I had RAM to spare.
Desmont McCallock
#134 - 2012-07-30 12:16:09 UTC  |  Edited by: Desmont McCallock
Not to mention that NGINX handles better (and more) connections than Apache, which as you remember Snarf, caused your service to fail trying to handle market data uploads from multiple EVEMon uploaders.

Edit: DOTLAN also runs on NGINX/MySQL/PHP platform.
Wollari
Dirt Nap Squad
#135 - 2012-07-30 22:24:33 UTC
Desmont McCallock wrote:
Not to mention that NGINX handles better (and more) connections than Apache, which as you remember Snarf, caused your service to fail trying to handle market data uploads from multiple EVEMon uploaders.

Edit: DOTLAN also runs on NGINX/MySQL/PHP platform.

DOTLAN runs on NGINX/Apache/MySQL/PHP platform :-) I put Ngnix in front just to deliver static content and forward all dynamic/unknown stuff via reverse proxy request to the backend apache (running on a different port) to do the php stuff. The main reason was in the beginning that I was to lazy to rewrite all mod_rewrite rules to nginx ones and just wanted to drop nginx in.

If you start from scratch you can easily start with nginx+php-fpm which is fine, but if you're a long term apache user, you old knowledge about mod_rewrite and stuff needs some overhaul and a rewrite :-)

In theory I could replace the backend apache on DOTLAN with php-fpm nowdays, but doing something similar on a highly frequented page is kinda riska without proper testing of all coding parts. Maybe If I've enough time someday I'll do the switch but not now.

DOTLAN EveMaps | Your out-of-game map, navigation toolset, sov database, etc. since 2008
Andy DelGardo
#136 - 2012-08-17 14:35:49 UTC
Hi,

just noticed that i don't see/get the small slider anymore, to change the update time filtering? (FF14 and Chrome)