These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

Market Discussions

 
  • Topic is locked indefinitely.
 

EVE Mogul [v2] - Profit Tracking & More
Author
Previous Topic Next Topic
Jeronica
The Terrifying League Of Dog Fort
Deepwater Hooligans
#181 - 2013-06-03 12:35:14 UTC
Kas Asen wrote:
Hi,

Website looks really promising, however, i'm having a couple of issues with it. I added a corporation to my account and it took about an hour or two for it to pull the info from the API and then also process the data and start updating the graph, which was fine. The problem is that the API has been pulled two more times now (soon to be a third I think) and yet none of the profits have been updated / the "cronjob" has been running continuously without any sort of outcome since the first API pull. Also under manage corporation, it states "Cached Journal: 0000-00-00 00:00:00", I don't know if that's of any help but it didn't look right, so i thought i'd throw it in anyway

Thanks for the site anyhow :)


The cronjob being displayed is system wide, meaning it's running for everyone. I'll be looking into optimizing the pulls further to increase the rate of them being pulled.

EVE-MOGUL.COM

Trade Profit Tracking&Analytics

Offering Sotiyo Services In

New Caldari | Ashab

IPOs & Investments
Kas Asen
Delboy Enterprises
#182 - 2013-06-03 16:35:34 UTC
Jeronica wrote:
Kas Asen wrote:

...text...


The cronjob being displayed is system wide, meaning it's running for everyone. I'll be looking into optimizing the pulls further to increase the rate of them being pulled.


That makes sense, however what I was trying to say in my post is that it doesn't seem to be the rate of API pulls that slows the updates, but the rate at which the profits are calculated after an API pull. In my case it looked like the API was pulled 2 or 3 times before the transaction / profit page was actually updated. My thinking is that once the API pull has finished and you have the data downloaded, the updating of your local database and profit calculations should be reasonably quick? Unless you're dealing with a seriously large amount of data (which you may be, i'm not experienced enough to judge really).

Currently i use a program called Eve Nexus (in case you've ever heard of it), and once the API pull has finished it calculates the profit in under a second, so even with a few thousand eve wallets to go through the update time after an API pull would be hard pressed to reach over 3 hours. The source code (in case you're interested) can be found here on github.

Also sorry if it seems like i'm "attacking" the website or your ability in anyway, that's really not my intention, I simply want to try help you improve the website in any way that I can as I can see some serious potential in it.

Thanks for reading and thanks for your time.
Al'tair Enaka
NOTAXEVER
#183 - 2013-06-03 17:36:22 UTC
Kas Asen wrote:
Jeronica wrote:
[quote=Kas Asen]
...text...
Currently i use a program called Eve Nexus (in case you've ever heard of it), and once the API pull has finished it calculates the profit in under a second, so even with a few thousand eve wallets to go through the update time after an API pull would be hard pressed to reach over 3 hours.


Do keep in mind that Eve Nexus is written in Java, which is in most cases a lot faster than php (I assume the website is written in php). According to this website the majority of the benchmarks run 4 to 52 times faster in Java than in php.

It will be impossible to achieve the same performance (unless you use much better hardware) on this website as in Eve Nexus. But I do believe it can be sped up quite a bit.
Kas Asen
Delboy Enterprises
#184 - 2013-06-03 20:39:08 UTC
Heh, and there was me thinking java was a relatively slow language o.0 then again, haven't had any experience with php. I never realised a difference in language could make that much of a difference anyhow ( I always thought it was minimal and only necessary when dealing with global data etc).
Al'tair Enaka
NOTAXEVER
#185 - 2013-06-03 21:43:23 UTC  |  Edited by: Al'tair Enaka
Kas Asen wrote:
Heh, and there was me thinking java was a relatively slow language o.0 then again, haven't had any experience with php. I never realised a difference in language could make that much of a difference anyhow ( I always thought it was minimal and only necessary when dealing with global data etc).


As far as I know, the difference comes from the fact that Java is a JIT-compiled language and php is a fully interpreted language.

What this means is that Java first compiles the code to an intermediate language (bytecode) and can already apply optimizations in the process. This intermediate language is at runtime executed by the virtual machine.

Php is interpreted, and thus needs to be compiled each time it's run.

There's probably also a big overhead from the fact that php is weakly typed, while Java is strongly typed. This means that when you use php, you can put a string in an integer, and the integer is suddenly a string. Because your program has to figure this all out during runtime it loses some performance. Java simply doesn't allow this behaviour, and thus avoid the overhead of checking.

Of course, none of this matters when you use bad code. A highly optimized php app will run faster than a sloppy Java app.

P.S. To get the highest performance you will almost always use C or C++. Sometimes modules are even written in Assembler, to get every last bit of performance out of your code. But in the end, you need to pick the right language for the job. Each language has its focus.
Solock
Sniggerdly
Pandemic Legion
#186 - 2013-07-23 17:11:12 UTC
I do all my purchases on one char and all my selling on another. Is there any way to track the profit across these two characters?
Serene Python
#187 - 2013-07-24 16:12:46 UTC
Solock wrote:
I do all my purchases on one char and all my selling on another. Is there any way to track the profit across these two characters?


You may be interested in this. I am working on adding more features slowly. There is an option where you can merge characters, which is what it sounds like you may be interested in.
Syrk
Caldari Militia Supply Corps
#188 - 2013-07-24 21:06:06 UTC
Love the website. Looking forward to support for contracts. :-)
Wafflehead
Garoun Investment Bank
Gallente Federation
#189 - 2013-07-29 02:34:41 UTC  |  Edited by: Wafflehead
Error log has been sent to dev as requested :)
Tweety Bird
Tackled In Belt
#190 - 2013-07-29 21:50:39 UTC
Sorry for the downtime. We are back up. We are in the process of migrating the site to a cloud IDE and real dedicated host. Development is going on and many great things to come. Thanks for your patience. Big smile
Jeronica
The Terrifying League Of Dog Fort
Deepwater Hooligans
#191 - 2013-07-30 06:35:57 UTC
Hello.

I have decided to delete the current orders database table, it was consuming 9 GB of the ~12 GB of the space the database was using. I will be looking at a better way of storing orders in the future, and will be implemented in the next major revision. I understand this may bring up a few problems, but the space needed to be cleared. You can expect the market orders to repull again, as the API functions will continue their programming but I will most likely delete the table again when it grows in size.

This is only temporary until we get the new revision up and live.

EVE-MOGUL.COM

Trade Profit Tracking&Analytics

Offering Sotiyo Services In

New Caldari | Ashab

IPOs & Investments
Zosius
The Nordic Associates
Fraternity.
#192 - 2013-07-31 19:24:09 UTC
Hi. Nice work going. I find it very useful so far. Do you plan on making extra features for a premium version? Few things I would like to see that i would gladly pay for:

1. Option to select profitability per character.
2. do item profitability analysis
3. Some sort of inside tool to check profits/losses based on set time period (from to)
4. more flexibility to select settings when viewing market transactions. e.x. item type, dates, price range, how much of total stock has been sold.

regards,
Zosius

http://cloakybastard.blogspot.com
Dimitrios Dazhusu
DAZHUSU
#193 - 2013-08-20 08:35:42 UTC
Here's an error I get when trying to add a new character to eve-mogul:

Quote:

Unhandled Exception
Message:

simplexml_load_file(https://api.eveonline.com/account/APIKeyInfo.xml.aspx?keyID=2510027&vCode=aX934KnJuXAR1cKIxadxo46RA6refvswvwFfH1rGLSIwdWsy6LpdLd4kzuHLPy9i): failed to open stream: HTTP request failed! HTTP/1.1 403 Forbidden

Location:

/var/www/evemogul/application/controllers/characters.php on line 80

Stack Trace:

#0 /var/www/evemogul/laravel/laravel.php(42): Laravel\Error::native(2, 'simplexml_load_...', '/var/www/evemog...', 80)
#1 [internal function]: Laravel\{closure}(2, 'simplexml_load_...', '/var/www/evemog...', 80, Array)
#2 /var/www/evemogul/application/controllers/characters.php(80): simplexml_load_file('https://api.eve...')
#3 [internal function]: Characters_Controller->post_add()
#4 /var/www/evemogul/laravel/routing/controller.php(325): call_user_func_array(Array, Array)
#5 /var/www/evemogul/laravel/routing/controller.php(285): Laravel\Routing\Controller->response('add', Array)
#6 /var/www/evemogul/laravel/routing/controller.php(165): Laravel\Routing\Controller->execute('add', Array)
#7 /var/www/evemogul/laravel/routing/route.php(153): Laravel\Routing\Controller::call('characters@(:1)', Array)
#8 /var/www/evemogul/laravel/routing/route.php(124): Laravel\Routing\Route->response()
#9 /var/www/evemogul/laravel/laravel.php(167): Laravel\Routing\Route->call()
#10 /var/www/evemogul/public/index.php(34): require('/var/www/evemog...')
#11 {main}
Dimitrios Dazhusu
DAZHUSU
#194 - 2013-08-20 09:01:21 UTC
added more permissions for API key and it worked!
Tweety Bird
Tackled In Belt
#195 - 2013-08-22 01:47:36 UTC
Dimitrios Dazhusu wrote:
Here's an error I get when trying to add a new character to eve-mogul:

Quote:

Unhandled Exception
Message:

simplexml_load_file(https://api.eveonline.com/account/APIKeyInfo.xml.aspx?keyID=2510027&vCode=aX934KnJuXAR1cKIxadxo46RA6refvswvwFfH1rGLSIwdWsy6LpdLd4kzuHLPy9i): failed to open stream: HTTP request failed! HTTP/1.1 403 Forbidden



As you figured out the API key was not correct. Anyhow, stack traces will be removed and lots of changes to come soon Thanks for your interest. Big smile
Bertrand Prout
Sunday Sessions
#196 - 2013-08-23 20:42:02 UTC
Kas Asen wrote:
Jeronica wrote:
...text...


That makes sense, however what I was trying to say in my post is that it doesn't seem to be the rate of API pulls that slows the updates, but the rate at which the profits are calculated after an API pull. In my case it looked like the API was pulled 2 or 3 times before the transaction / profit page was actually updated. My thinking is that once the API pull has finished and you have the data downloaded, the updating of your local database and profit calculations should be reasonably quick? Unless you're dealing with a seriously large amount of data (which you may be, i'm not experienced enough to judge really).

Currently i use a program called Eve Nexus (in case you've ever heard of it), and once the API pull has finished it calculates the profit in under a second, so even with a few thousand eve wallets to go through the update time after an API pull would be hard pressed to reach over 3 hours. The source code (in case you're interested) can be found here on github.

Also sorry if it seems like i'm "attacking" the website or your ability in anyway, that's really not my intention, I simply want to try help you improve the website in any way that I can as I can see some serious potential in it.

Thanks for reading and thanks for your time.


On top of what has been said, this website has to deal with accounts with possibly multiple characters on them, while your app only has to handle your transactions.
Simc0m
The Scope
Gallente Federation
#197 - 2013-08-24 00:19:42 UTC
Eve-mogul is down for me, any word on the issue and how long it will be down? Thanks.
Pinnel
Dos Pollos Hermanos
#198 - 2013-08-24 09:22:12 UTC
Down for me as well. Thanks for the wonderful effort that`s been put into this site and hope to see it back up soon!
Johan Toralen
IIIJIIIITIIII
#199 - 2013-08-24 11:21:15 UTC
Same here. Great site btw. Helped me to get back into trading because its so much easier to track profits across multiple accounts.
MuriMuri
KappaPie Boxed Chocolates
#200 - 2013-08-24 21:42:14 UTC
Johan Toralen wrote:
Same here. Great site btw. Helped me to get back into trading because its so much easier to track profits across multiple accounts.


Im going through mogul withdrawl.... halp.