These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

Market Discussions

 
  • Topic is locked indefinitely.
 

EVE Mogul [v2] - Profit Tracking & More

Author
Tweety Bird
Tackled In Belt
#401 - 2014-07-23 23:44:44 UTC
Looking into it. We haven't had much time to dig into what CCP changed that made everything go crazy. It may be a few days, but down time plus a few extra days will be extended on everyone's subscriptions. APIs should not be flagged, if yours is, recreate it with the correct access mask and no expiry. Once everything is restored everything will be backfilled, so don't worry about any profit tracking or stock information not being collected, CCP has a 30 day cache we pull from.
Abidal Trekt
Caldari Provisions
Caldari State
#402 - 2014-07-23 23:55:27 UTC
Tweety Bird wrote:
what CCP changed that made everything go crazy


The answer is 9000.
Kuri Kurvora
Deep Core Mining Inc.
Caldari State
#403 - 2014-07-24 00:32:09 UTC
Abidal Trekt wrote:
Tweety Bird wrote:
what CCP changed that made everything go crazy


The answer is 9000.



Nope, I know the universal answer is 42.
MrCheesy
Imperial Shipment
Amarr Empire
#404 - 2014-07-24 03:38:47 UTC
Hey guys, Jeronica here.

My main account is unsubbed, and I can't get online on my main computer to plex it right now.

I've looked into the issues, and it looks like the flagged APIs were just temporary while CCP was changing something on their end. Unflagging everyone seemed to work. my quick fix did unflag everyone though (unsub'd people as well, they just can't access their data). I'll get that fixed next week when I finally get internet at my new house.

With the profit data, it looked like the influx of unflagged APIs brought in an overwhelming amount of transactions (think 800 APIs x 1000 transactions). Site had to process what could be 800k extra transactions, which is probably overshooting quite a bit. It was probably closer to 250k. So, our old hardware could only process 1k transactions per cycle before it would run out of memory. When we moved to new hardware (4x the memory, more CPU, etc), I never changed the value of 1k because the site was running smoothly even then. I went ahead and changed the cycle amount to 7500, which still may be a bit modest (due to mysql able to cache more efficiently, and my own cache implementations. Needless to say, it can do 7500 in under 2 minutes quite easily (translates to about 90k transactions per hour). I went ahead and forced the script back to back a few times and we should be caught up now. If people could verify this, I'd greatly appreciate it.

I'll try to get on public wifi more often to check on things, all I've been able to do is talk to Tweety off my phone, and look at database tables on a 4inch cellphone screen.

I went ahead and gave everyone 3 days of subscription time to make up for the downtime/inconvenience.

To anyone who's eve-mailed me, I'm not ignoring you! I can't log in to check the inbox.

Cheers everyone,
Jer
MrCheesy
Imperial Shipment
Amarr Empire
#405 - 2014-07-24 03:42:15 UTC
Pelagia wrote:
Just a quick suggestion, wouldn't it be better to allow the 7-day trial to provide the same functionalities as an Elite subscription?

Whilst the standard package is highly useful, there are other services which offer the same functionalities, and more, than that particular subscription, and so it's hard to gauge whether or not the additional features an Elite package provides is worth it without being able to try it out.


In response to this, I have coded the implementations in my local version of the site. Once I get online Tuesday I'll push the code to production.

TheSmokingHertog
Julia's Interstellar Trade Emperium
#406 - 2014-07-26 05:27:08 UTC
PLS make a button in the menu of EVE mogul to this forum thread (idea!)

"Dogma is kind of like quantum physics, observing the dogma state will change it." ~ CCP Prism X

"Schrödinger's Missile. I dig it." ~ Makari Aeron

-= "Brain in a Box on Singularity" - April 2015 =-

Abidal Trekt
Caldari Provisions
Caldari State
#407 - 2014-07-26 17:37:50 UTC
Something's definitely wrong, I'm not making very much isk these days because I'm too lazy to update my orders. Jeronica, fix it please :)
Jeronica
The Terrifying League Of Dog Fort
Deepwater Hooligans
#408 - 2014-07-30 14:16:44 UTC
TheSmokingHertog wrote:
PLS make a button in the menu of EVE mogul to this forum thread (idea!)


Done! :)

I've added the code to make new users (trial) with elite access.

Abidal Trekt wrote:
Something's definitely wrong, I'm not making very much isk these days because I'm too lazy to update my orders. Jeronica, fix it please :)


I've told my people to get on it :P

Some other changes:

  • Added customization to the reports. You can now allow access to certain pages on each report. I've also added a transaction API endpoint that gives you a way to pull your latest transactions if you require. More info can be seen here: https://www.eve-mogul.com/dev
  • Removed the influx of unsub'd APIs. Site should be running a lot smoother now (shouldn't have seen any degradation anyway).
  • Some of my cache management code has changed, and it will self garbage-collect. Some pages might take a few extra seconds to generate a new .css and .js asset, but will be extremely quick afterwards.
  • I added volume to some graphs, may be useful. I'll change the y axis of the profit reports for volume at a later time.


There are some more minor changes I've done, that don't require a bullet point.

Any issues, just give me a poke. I'm resubbed in eve, so I'll be in the chat channel for the morning as well.

EVE-MOGUL.COM

Trade Profit Tracking&Analytics

Offering Sotiyo Services In

New Caldari | Ashab

IPOs & Investments

Abidal Trekt
Caldari Provisions
Caldari State
#409 - 2014-07-30 17:05:16 UTC
Jeronica wrote:

  • Added customization to the reports. You can now allow access to certain pages on each report. I've also added a transaction API endpoint that gives you a way to pull your latest transactions if you require. More info can be seen here: https://www.eve-mogul.com/dev

  • Awww hell
    okoolos rimmer
    Napkin Nation
    #410 - 2014-07-31 23:21:30 UTC  |  Edited by: okoolos rimmer
    Ok a new user here. I love your webpage but I have few questions/suggestions:

    1) When getting the notification "Order Completed. An order has been completed" could we possibly also see which order that is?
    Something like.. Order completed : Damage control II blah blah blah.

    2) I'd love to have the owner of the order displayed on the order page. Maybe we could even be able to customize which columns we see and their order. Same goes for the transactions page.

    3) How about an option to "dismiss" rows in the "completed orders". It's a bit of a hassle trying the figure out last "completed order" that I already took care of.

    question: are the dates on the "orders" page the date the orders were created or last modified?
    edit: I figured that one out on my own. Still it would be neat to know when we last modified the order..
    Jeronica
    The Terrifying League Of Dog Fort
    Deepwater Hooligans
    #411 - 2014-08-01 03:41:02 UTC
    okoolos rimmer wrote:
    Ok a new user here. I love your webpage but I have few questions/suggestions:

    1) When getting the notification "Order Completed. An order has been completed" could we possibly also see which order that is?
    Something like.. Order completed : Damage control II blah blah blah.

    2) I'd love to have the owner of the order displayed on the order page. Maybe we could even be able to customize which columns we see and their order. Same goes for the transactions page.

    3) How about an option to "dismiss" rows in the "completed orders". It's a bit of a hassle trying the figure out last "completed order" that I already took care of.

    question: are the dates on the "orders" page the date the orders were created or last modified?
    edit: I figured that one out on my own. Still it would be neat to know when we last modified the order..


    Some fantastic ideas, I'll sit down tomorrow and start working on the code. I can already visualize how I want to get some of this suggestions implemented. The thought of using the orders page as a "completed order checklist" never came to me, and I can see how it would be beneficial to a lot of people.

    The other two suggestions should be easy as well, and should get it implemented by/during weekend.

    EVE-MOGUL.COM

    Trade Profit Tracking&Analytics

    Offering Sotiyo Services In

    New Caldari | Ashab

    IPOs & Investments

    Sh0plifter
    Underworld Property Accounting Partnership
    #412 - 2014-08-01 04:12:37 UTC
    Started using it for a couple of my guys, this is a pretty nice website setup.

    Even if it does fund PL.Lol
    okoolos rimmer
    Napkin Nation
    #413 - 2014-08-01 05:29:55 UTC  |  Edited by: okoolos rimmer
    Few other suggestions for the orders page:

    1) Bigger range of search options. We only have "All" "Type" and "Station". I would love to have "owner", "quantity remaining" and "region" as well. Quantity remaining could be a range say "<50".

    2) Multiple search boxes/filters so we can search for multiple criteria? Example: search for "buy order" AND name: "damage control" AND region: "forge" AND quantity:" <10" AND range: "2 jumps". Sort of like JeveAssets does asset filtering.

    3) Column or something that indicates what range the buy order is (station, system, region etc). Maybe that would show up when you use the "buy orders" filter. Option to flter/sort buy orders by their range.

    4) After I look at my "completed orders" and take care of them I'd prefer the notifications for those orders to clear on their own. Slightly annoying to have to clear the notifications for the orders you already "completed" manually. Not a big deal but hey.

    5) Some sort of cutomizable notifications when quantity remaining of an order falls below a certain level. Maybe in a form of a "watchlist" of orders that I want to be notified about when they're low. I magine that one could be difficult to implement.

    6) Timer for the next api pull.

    7) An option to get email notification when order expires with an option to set a minimum threshold (ex: don't send an email until 10 orders expire). "Dismissing" a "complete order" should decrease that counter. Email notification should contain order info/owner etc.

    8) "View Order Details" could maybe display more information when clicked:
    - Type of the order (buy or sell) and Range (if buy order).
    - owner/last modified/margin/volume.
    - Jita (or another chosen hub) sell/buy price for the item if available. Extra brownie points for an option to "compare" trade hub prices.
    - days remaining until it expires

    As "premium" features go a pie chart/table indicating most active orders would be neat. Maybe with some sort of filter too. Another feature I'd like would be a table/pie chart showing which items have top margins (in the profit section). An option to export orders/completed orders/transactions to excel/google docs etc would be welcome as well (that alone would get me to upgrade my package).


    Thanks.
    Tweety Bird
    Tackled In Belt
    #414 - 2014-08-01 21:34:18 UTC
    okoolos rimmer wrote:
    Few other suggestions for the orders page:
    Excellent suggestions. This is perfect feedback. Thank you.
    okoolos rimmer
    Napkin Nation
    #415 - 2014-08-02 02:06:46 UTC  |  Edited by: okoolos rimmer
    Here's another suggestion for a "premium feature":

    I select a completed buy order that had a range bigger then a station (maybe even one still in progress).
    Then I get table/pie chart breakdown of stations where that order got filled.

    example: I select a completed region wide buy order of 100 damage controls (Forge).
    then I get a breakdown:
    50 were sold to me in jita 4 4
    25 in Perimeter
    10 in uedama
    5 in Jan
    ...
    ...
    You could also express this in percentages ex: "50% filled in jita".
    With this feature the moment I get a notification that a buy order is complete I can see at a glance the distrubution of the items and where I need to go.



    An extention of that idea would be selecting a single item and duration then seeing that breakdown in sold or bought but on a global scale:

    For example I could select option: "buy order" item: "damage control" duration: "24h".
    Then I would get a breakdown of all stations where damage controls were sold to me in the last for 24h:

    75 sold to alt 1 in jita 4 4 @600k isk (alt + prices are optional)
    50 sold to alt 2 in Amarr @400k
    10 sold to alt 3 in uedama @200k
    5 sold to alt 4 in tama @200k
    2 sold to alt 1 in Ostingale @700k
    1 sold to alt 2 in Rancer @500k


    I could also get an equivalent breakdown if I selected "sell order". Then I'd see a breakdown of which stations I sold damage controls at in the last 24h. With this feature if I wanted to get more of a specific item or sell one I'd know exactly where to place the order. It would also help with finding best hauling routes/most active stations for specific items.

    There could be a problem with overlapping orders. Might be easier to skip the part where you tell which alt and what price. Just say "X quantity sold/bought at station Y". We can sort out the rest on our own.


    thanks.


    PS. Would it be possible to flag orders you want mogul to ignore in the profit calculation? (say I'm buying ammo/mods for personal use)
    Abidal Trekt
    Caldari Provisions
    Caldari State
    #416 - 2014-08-02 02:47:11 UTC
    okoolos rimmer wrote:

    10 sold to alt 3 in uedama
    5 sold to alt 4 in tama
    2 sold to alt 1 in Ostingale
    1 sold to alt 2 in Rancer


    Oh cool more systems to set up shop.
    Vaako Omaristos
    Doomheim
    #417 - 2014-08-06 13:55:26 UTC  |  Edited by: Vaako Omaristos
    Is it possible to get an export feature for me to input the data into my excel spreadsheets?

    I have also noticed that some character transactions are appearing in the corp transactions even though they are different.

    Trader, industrialist and thinker. Follow my progress on my 141 trading challenge here

    Sh0plifter
    Underworld Property Accounting Partnership
    #418 - 2014-08-06 15:59:46 UTC
    Hrm, something I noticed:

    I bought 87 of one ship, sold 70 so far. It is valuing on the (Elite) Custom that I have sold all 87 ships at the value of the highest value I sold the other 70 for. Was a 680k difference from high and low so really ignorable for the most part. Not sure if it calculates that into the daily/weekly profit or front page or not. I just noticed I made x-amount for 87 ships, when I still have not sold all 87.
    TheSmokingHertog
    Julia's Interstellar Trade Emperium
    #419 - 2014-08-06 18:43:16 UTC
    okoolos rimmer wrote:
    Few other suggestions for the orders page:

    1) Bigger range of search options. We only have "All" "Type" and "Station". I would love to have "owner", "quantity remaining" and "region" as well. Quantity remaining could be a range say "<50".

    ...

    Thanks.


    If you would make a filter range, I need filters for < 500k

    So make the filter dynamic, thx.

    "Dogma is kind of like quantum physics, observing the dogma state will change it." ~ CCP Prism X

    "Schrödinger's Missile. I dig it." ~ Makari Aeron

    -= "Brain in a Box on Singularity" - April 2015 =-

    Jeronica
    The Terrifying League Of Dog Fort
    Deepwater Hooligans
    #420 - 2014-08-11 02:10:37 UTC
    1) Bigger range of search options. We only have "All" "Type" and "Station". I would love to have "owner", "quantity remaining" and "region" as well. Quantity remaining could be a range say "<50".
    Added this in 1.1.9. Have many filters added, I don't have the range filter in yet.

    2) Multiple search boxes/filters so we can search for multiple criteria? Example: search for "buy order" AND name: "damage control" AND region: "forge" AND quantity:" <10" AND range: "2 jumps". Sort of like JeveAssets does asset filtering.
    This is already available. Just search for something, then for another thing. It'll filter the criteria as it's added. There is no "or" though, so you can search for "item is this OR this".

    3) Column or something that indicates what range the buy order is (station, system, region etc). Maybe that would show up when you use the "buy orders" filter. Option to flter/sort buy orders by their range.
    Added that in.

    4) After I look at my "completed orders" and take care of them I'd prefer the notifications for those orders to clear on their own. Slightly annoying to have to clear the notifications for the orders you already "completed" manually. Not a big deal but hey.
    I made it so when you look at the orders tab, it clears the orders notifications. If you'd like a more "interactive" experience (ie click on the order on the grid to mark it notified or something), I can add that in later on.

    5) Some sort of cutomizable notifications when quantity remaining of an order falls below a certain level. Maybe in a form of a "watchlist" of orders that I want to be notified about when they're low. I magine that one could be difficult to implement.
    I added some experimental code. Activate the features in the preferences tab. Right now I'm doing a 25% threshold, but I'll customize that number once the feature is tested for functionality.

    6) Timer for the next api pull.
    Might add this in at a later time. May put it in the individual character's tabs

    7) An option to get email notification when order expires with an option to set a minimum threshold (ex: don't send an email until 10 orders expire). "Dismissing" a "complete order" should decrease that counter. Email notification should contain order info/owner etc.
    Still want to add this in. I'll put it in my issues list

    8) "View Order Details" could maybe display more information when clicked:
    - Type of the order (buy or sell) and Range (if buy order).
    - owner/last modified/margin/volume.
    - Jita (or another chosen hub) sell/buy price for the item if available. Extra brownie points for an option to "compare" trade hub prices.
    - days remaining until it expires

    I've added majority of this. I'll need to add the days until order expires row as well.

    As "premium" features go a pie chart/table indicating most active orders would be neat. Maybe with some sort of filter too. Another feature I'd like would be a table/pie chart showing which items have top margins (in the profit section). An option to export orders/completed orders/transactions to excel/google docs etc would be welcome as well (that alone would get me to upgrade my package).
    I'll add the margin report this week (I have the whole week off). It's something I've wanted to add for quite awhile, yet never got around to it. The csv export is also something I'll work on implementing. The idea of "most active orders" is also an intriguing idea I'll need to play around with.

    I hope to have a lot of new features coming into the mix this week!


    Thanks.

    EVE-MOGUL.COM

    Trade Profit Tracking&Analytics

    Offering Sotiyo Services In

    New Caldari | Ashab

    IPOs & Investments