These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

RETURNED - EVE Marketeer - Market Data Aggregation & Information

Author
Domi Etymology
Violent Alternatives
#261 - 2012-01-05 03:57:04 UTC
When you get a history with a single entry, and 0 orders/0 quantity, can you somehow depriorotise that item for that region, so it is hardly ever requested when scanning the market?

Currently scanning Branch, and it feels like 90% of the time I'm scanning for items that do not exist in the region, and never have :P
Domi Etymology
Violent Alternatives
#262 - 2012-01-05 04:37:56 UTC
Oh, and when uploading item history, nothing seems to be coming up in my upload history?
Maeste Madeveda
The Spawning Pool
#263 - 2012-01-05 15:38:06 UTC
Would it be possible to add the 'field_filter' component to the 'station_info' (station details) request ?

I'd like to get a particular have info as precise as possible and sometimes artificial orders are messing up with the values of the item I want in the simpler item details.

Also it is possible to have the option not to delete the files updated through the unified uploader like it was in the previous uploader ?
Callean Drevus
Perkone
Caldari State
#264 - 2012-01-05 18:58:49 UTC
Quote:
Yes, the history tab needs to be open for the client to make calls to get history (and in turn end up in the cache files).

Thanks for answering that question :)

Quote:
When you get a history with a single entry, and 0 orders/0 quantity, can you somehow depriorotise that item for that region, so it is hardly ever requested when scanning the market?

Yes, this seems like a smart idea. Will probably try something along the lines of what Scrapyard Bob described a while back.

Quote:
Oh, and when uploading item history, nothing seems to be coming up in my upload history?

If you are using uploader 0.4, you should switch to 0.4b, but I assume you have done that already. I'll investigate this issue.

Quote:
Would it be possible to add the 'field_filter' component to the 'station_info' (station details) request ?

I'd like to get a particular have info as precise as possible and sometimes artificial orders are messing up with the values of the item I want in the simpler item details.

Yes, I'll add the field filter, I was under the impression it was there already, but it's not. Can you describe artificial order? I do my best to remove all artificial orders, but maybe someone came up with an idea good enough to pass through the filters Blink.

It's also possible to not delete the files, but it'll probably move them to a different folder then, since it's going to interfere with the uploading otherwise (especially if people leave their client running for weeks on end P, it's bound to get slower).

Developer/Creator of EVE Marketeer

Domi Etymology
Violent Alternatives
#265 - 2012-01-06 22:25:12 UTC
yep, 0.4b. Well 99% sure. I download the file called 0.4b from the site, and unpacked it. While it's running, however, the unified uploader says "Current Version: 0.4"


Oh also, a small thing with the unified uploader, the text where it shows the uploads, everage time, etc for ever marketeer, eve central and even marketdata...... that text is *constantly* flashing. Sorta gives me a headache if I look at it for too long.
Callean Drevus
Perkone
Caldari State
#266 - 2012-01-06 22:29:56 UTC
Yeah, it's version 0.4b. Probably forgot to change the version numbering (again).

The text is constantly flashing because it is being updated... I can lower the frequency though, which should make it better. On the other hand, I can hardly believe you actually spend time staring at the loveliness of uploading Blink

Developer/Creator of EVE Marketeer

Domi Etymology
Violent Alternatives
#267 - 2012-01-07 02:29:40 UTC
it's.....so.... mesmerizing......

actually, I'm just glad it doesn't freeze up like the old uploader :P
Scrapyard Bob
EVE University
Ivy League
#268 - 2012-01-07 03:57:57 UTC
One request that came in through a private convo today with someone. This particular user also runs their own cache-scanning software.

The new uploader no longer has the option of "leave cache files in place" (i.e. "don't delete"). Or maybe we need an option of "delete after N hours".

Callean Drevus
Perkone
Caldari State
#269 - 2012-01-07 09:25:36 UTC
Yup, I already got that 4 posts ago Smile it will be added.

Developer/Creator of EVE Marketeer

Scrapyard Bob
EVE University
Ivy League
#270 - 2012-01-07 15:09:30 UTC
Ooops, guess I shouldn't post requests when running on 3 hours of sleep.

On the history graph, the little tool-tip that shows you the price value as you mouse-over the lines on the graph is very hard to read. Can you make the background more opaque and increase the contrast of the text color in relationship to the background?
Scrapyard Bob
EVE University
Ivy League
#271 - 2012-01-09 00:09:10 UTC
(big list incoming)

Also, on the history graph, it needs to filter out outliers before setting the scale. A good example is the orca price in the forge.

http://www.evemarketeer.com/item/info/orca
- Someone put one up for sale in Jita at about 10x above the other prices, pushing the scale out of whack

...

Group summary links are still non-functional. Which kind of goes back to my previous suggestion of showing the item name along with the 5% buy sim price for the top (4) market regions on each row. So when I look at:

http://www.evemarketeer.com/item/group_summary/18

I would see:

(item) The Forge / Domain / Sinq Laison / Heimatar
Tritanium - 4.35 / 3.94 / 3.38 / 3.90
Pyerite - 5.33 / 5.30 / 4.96 / 5.11
etc.

If the average of values are above 100k, then it should switch to displaying the entire page in thousands, above 100M, in millions.

For the parent group (which does not contain actual items, only other market groups) it wouldn't make sense to display the prices. For instance, the parent group of "Materials" or "Ore & Minerals".

http://www.evemarketeer.com/item/group_summary/1031
http://www.evemarketeer.com/item/group_summary/533

...

On the regional drop-down, it would be nice if you would add "meta" regions like:

-1 = All
-2 = High-Sec Only
-3 = Lo-Sec Only
-4 = High/Low Only

(Swiped from EVE-MarketData's URLs for prices.)
Domi Etymology
Violent Alternatives
#272 - 2012-01-10 11:08:54 UTC
not sure if you've seen this site http://www.eve-market-guide.com

it's a great service they offer, but the data they use is never up to date. If possible, this service would make a great addition to the member services on offer.
Callean Drevus
Perkone
Caldari State
#273 - 2012-01-10 17:32:02 UTC
Hadn't seen eve market guide yet. Will loot their functions :P though EMK has everything but their invention prices, it's not yet as accessible.

As to scrapyard, good suggestions, will do. Sorry, haven't been able to work on EMK much the past week P

Developer/Creator of EVE Marketeer

Callean Drevus
Perkone
Caldari State
#274 - 2012-01-10 21:41:12 UTC
Ok:

- Field filter for station API
- Fixed orca price graph, and hopefully other outliers that are too mad to be true
- Added the group summary pages, will still need some (lots of) work
- History mouse over is more readable

These were the things that were easy to add :)

Developer/Creator of EVE Marketeer

Scrapyard Bob
EVE University
Ivy League
#275 - 2012-01-11 00:32:27 UTC  |  Edited by: Scrapyard Bob
Group summary pages look very good, other then its choice of the (4) regions to show for minerals:

http://www.evemarketeer.com/item/group_summary/18
- The Forge (yep, there's Jita)
- Delve (uh...)
- Heimatar (yep, that's Rens)
- Domain (yep, Amarr)

http://www.evemarketeer.com/item/group_summary/476
- That one uses the (4) recognized market hub regions.

I'm thinking you may want to just force the top (4) regions. Or limit your heuristic to empire regions with data less then 15 days old (Delve is 45-60 days out of date).

If you're only going to show one number, then the mid-point between the buy 5% and sell 5% might be good. Generally, when I'm looking at the page, I'm curious to know where I can buy an item at.
Scrapyard Bob
EVE University
Ivy League
#276 - 2012-01-11 00:44:30 UTC  |  Edited by: Scrapyard Bob
One more thing (hah, right) for the group summary page - which is very nice :)

The ability to click on one of the numbers to take me to that region's sell page so I can see the sell orders for that item in that region.

Okay, make that two things.

It would be useful if the page title would change depending on what you're viewing. So when looking at:

"EVE Marketeer - Group Summary - Standard Battlecruisers - Minmatar"
http://www.evemarketeer.com/item/group_summary/473

"EVE Marketeer - Item - Tornado"
http://www.evemarketeer.com/item/info/Tornado
Scrapyard Bob
EVE University
Ivy League
#277 - 2012-01-11 05:15:16 UTC
If you're interested in seeing market history uploaded more often, the regional status page needs to report on this.

- Drop the "% with last year" column. If the data hasn't been updated within the past month, it's not very useful at all. Have the Last hour/day/week/month fields only report on buy/sell order data freshness. Drop any items which have not had updates within the previous 365 days from the average as they're items that you'll probably never see.

- Add a new column for how fresh regional history data is and put it after the "Avg Time Ago" number. Call it "History Age" or "Order History". Again, drop anything older then 365 days before calculating the average age.

- The market scanner page will need to report both how fresh the buy/sell order data is (average age) as well as displaying the average history data age. I suggest always displaying both numbers rather then doing it like EMD where you have to flip to the other page to see how fresh the history data is. If both numbers are "in my face" when I hit the market scanner page, I can make an educated decision whether to set the market window to history or order details for this particular session.
Callean Drevus
Perkone
Caldari State
#278 - 2012-01-11 09:26:23 UTC
Lolz, yeah, there was something wrong with the algorithm that is used to determine the top regions. I just couldn't get it right, so I'll probably allow people to set their own regions there, it's just going to drive me mad otherwise. The default would then be to show the top 4 general market regions.

I didn't do sell/buy averaging yet because sometimes either of the values is zero, and that would mess up the average. Catching that will take a little more time, but don't worry, will be done.

Changing page titles, smart idea! Currently they only change based on the page you're on, but it's perfectly possible to add additional information.

Going to the right sell region automatically is more difficult, though I guess I can solve that in some way (it's not that is actually difficult, it's just that I"ve made it so :P).

Market history needs some love indeed. The reason I didn't do this yet is that a while ago, CCP released a dump of their history data, and was talking about providing all of that automatically, which I thought was pretty awesome, as it would erase the need for history uploads. Haven't heard anything about that anymore though.

Developer/Creator of EVE Marketeer

TheSmokingHertog
Julia's Interstellar Trade Emperium
#279 - 2012-01-11 16:11:42 UTC
Scrapyard Bob wrote:
Group summary pages look very good, other then its choice of the (4) regions to show for minerals:

http://www.evemarketeer.com/item/group_summary/18
- The Forge (yep, there's Jita)
- Delve (uh...)
- Heimatar (yep, that's Rens)
- Domain (yep, Amarr)

..



How to set another region in this overview? Like delve?

"Dogma is kind of like quantum physics, observing the dogma state will change it." ~ CCP Prism X

"Schrödinger's Missile. I dig it." ~ Makari Aeron

-= "Brain in a Box on Singularity" - April 2015 =-

Callean Drevus
Perkone
Caldari State
#280 - 2012-01-11 16:20:45 UTC
The version that is currently online determines the regions based on market activity (or it should, anyway), but I've developed a new version today that allows you to set your own regions. I'll put that version online shortly, first I'll finish my awesome new table engine.

Developer/Creator of EVE Marketeer