These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

RETURNED - EVE Marketeer - Market Data Aggregation & Information
Author
Previous Topic Next Topic
Callean Drevus
Perkone
Caldari State
#321 - 2012-01-18 19:50:29 UTC  |  Edited by: Callean Drevus
You must be kidding, I'm not going to do that to myself (creating OCR?), or to you guys.

I should probably make something clear. I'm not relying on ANY bot to get the data.

I've retrieved it once from the website, and now I can use it forever (unless CCP changes LP prices). In addition, for all I know the original data was obtained in a perfectly legal way, there is no way for me to know. The only reason I think it might have been obtained by bot is that the owner of the website in question freely admitted to botting and code injection on his/her blog.

That said, it's probably a good idea to send CCP a petition questioning whether it is alright to go ahead and use it, before I get my ass banned because I was too lazy to ask :P

Developer/Creator of EVE Marketeer
Endeavour Starfleet
#322 - 2012-01-19 05:14:01 UTC  |  Edited by: Endeavour Starfleet
Even if it is somehow greenlighted (I personally doubt it) Does it not set a very bad example using data from a site that admits to breaking the EULA?

What do you need to match that data? To avoid you having to use such questionable data in my opinion I am willing to start typing out the data myself.

Here is my first 3

1 x Hardwiring - Zainou 'Gnome' KYA750
LP Cost:2500 LP
ISK Cost: 2,500,000.00 ISK

1 X Hardwiring - Eifyr and Co. 'Gunslinger' MX 0.5
LP Cost:2500 LP
ISK Cost: 2,500,000.00 ISK

1 X Hardwiring - Eifyr and Co. 'Gunslinger' AX-0.5
LP Cost:2,500 LP
ISK Cost: 2,500,000.00 ISK

From a CONCORD LP store

Could you make use of this data in this format or do you need it in some kind of XML type run?
Callean Drevus
Perkone
Caldari State
#323 - 2012-01-19 07:25:43 UTC
In this case, I do not think it would be bad to use the data. There are other sites containing the exact same information, where I could've gotten it from too. Besides, I do not think this really constitutes an unfair game advantage, so there is no reason for the data to not be public anyway (in my opinion). Besides CCP time limitations anyway.

Using data from third parties only bothers me if I can think of ways to misuse it. Anything that saves typing and generally decreases the amount of spreadsheet fu involved is a generally a good thing in my opinion.

Anyway, a petition has been sent. Now I just have to wait for the results.

Developer/Creator of EVE Marketeer
Endeavour Starfleet
#324 - 2012-01-19 08:30:36 UTC  |  Edited by: Endeavour Starfleet
Well in the meantime I have been typing away for hours here to give you the complete CONCORD LP store data.

Even if you decide to use that data from a Edit: I mean claimed botter. I will continue to gather this data so you can replace it with legit and cleanly made data from the community.

I will start with CONCORD obviously.

Then the Faction Navy

Then others.

BTW y u no in game or in your channel so we can talk about this?

Edit: Had a connection issue but I had saved! Whew!
Callean Drevus
Perkone
Caldari State
#325 - 2012-01-19 16:56:25 UTC
I advise you to wait with writing out the data until I can fabricate a web form. Otherwise I might not be able to parse it.

Developer/Creator of EVE Marketeer
Endeavour Starfleet
#326 - 2012-01-20 00:02:59 UTC
Callean Drevus wrote:
I advise you to wait with writing out the data until I can fabricate a web form. Otherwise I might not be able to parse it.


That is fine. What I would like to request tho is it be made into a form that I can copy pasta over and over again filling the info.
Callean Drevus
Perkone
Caldari State
#327 - 2012-01-21 13:22:00 UTC
Ok, got something else updated today. The market scanner page now allows you to choose between history and order uploads (be sure to use the same setting for the market window in your client!), and dynamically shows how well updated a given region is. You can now see your contribution actually mattering again.

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#328 - 2012-01-21 14:27:04 UTC  |  Edited by: Scrapyard Bob
I prefer the old "start/stop" button being on the far right edge - made it easier to pause the updating because I could set things up so that the browser was still visible behind the market window. (This matters more on 1024x768 client windows, where space is limited.)

I'm also curious whether you can tone down the frequency of update for the 3.5 sec counter, maybe only update every 0.5 seconds. It now seems to cause graphical lag issues, even when the clients are minimized.
Callean Drevus
Perkone
Caldari State
#329 - 2012-01-21 14:39:59 UTC
Have you had the lag issue before? I never heard anything about it before, and it seems to work perfectly here. At least have not noticed any oddities.

Anyway, the start stop button was ugly, but I might add it again next to the group dropdown if it's really a problem. Isn't it still possible to set it up so that it works by just switching the window positions (Market on the right hand side, browser left)?

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#330 - 2012-01-21 14:58:25 UTC
I'm not entirely convinced that it's EMK's site that is doing it, I think one of the recent updates to the EVE client borked things. It used to be that when I minimized a market scanning window, the EVE client went from using 80% of a CPU core down to about 20-30% of a single CPU core. Now, the EVE clients are a lot more piggy about using the CPU - so it may be a CCP thing.

As long as the start/stop button is as far left/right as possible in the browser window, I can adjust. The advantage to having it on the right side is that the browser's "close" buttons are then available in cases where the client is laggy and hitting the "stop/pause" button doesn't seem to be working. If I put the browser left and market window to the right, the market window covers up those minimize/close window controls (making it harder to shutdown the IGB if it's laggy).

Also, this started yesterday on the group summary pages:
http://www.evemarketeer.com/item/group_summary/78
MYSQL ERROR OCCURRED: Unknown column 'ji0.sell' in 'field list'
Callean Drevus
Perkone
Caldari State
#331 - 2012-01-21 15:03:31 UTC
In that case, I think it must be the client, as the code for the countdown has been like that for over half a year :P

I agree that having the close buttons visible makes more sense. I'll see what I can do in that regard.

The error on the group summary page is probably due to an old bookmark, if you change the decision dropdown to what you want to see (or to and from another) it should be fixed.

Developer/Creator of EVE Marketeer
6ie
The Kiwis
#332 - 2012-01-21 19:14:23 UTC
No graphical issues for me with the count down. I'd prefer it configurable tho - I know it works well at 3s, and gets touchy around 2s.

Is whats selected to be scanned based upon my region setting for evemarketeer.com? (ie do i need to change the region depending on where I am).

Also, Ive seen multiple clients doing exactly the same scan for the same items at the same time before.

I do like the look of the new scanner page. Icons and text are a little large for my tastes.
Callean Drevus
Perkone
Caldari State
#333 - 2012-01-21 20:21:50 UTC
What's selected to be scanned is based on what region you are currently in, and what is most outdated in that region. The problem where multiple clients in the same region would upload the same things should have been fixed.

In regards to the size of the images, it is a matter of taste, but there's nothing else to show on that page, so there is no practical reason to make them tiny (and it might have something to do with display resolution :) ?).

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#334 - 2012-01-24 14:45:40 UTC  |  Edited by: Scrapyard Bob
The new unified uploader doesn't seem to be reading the cache properly after today's patch.

(And maybe you'll want to break out issues with the Unified Uploader to a new thread?)

Edit: The 2.6 EMD uploader works fine (so will use that today).
Callean Drevus
Perkone
Caldari State
#335 - 2012-01-24 17:21:26 UTC
Have you tried restarting it? :P It should be an issue with the autodetected cache folder, so in the worst case, removing that from the config file and starting the uploader should work.

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#336 - 2012-01-24 23:36:27 UTC
Callean Drevus wrote:
Have you tried restarting it? :P It should be an issue with the autodetected cache folder, so in the worst case, removing that from the config file and starting the uploader should work.


It's working now, but was definitely not working earlier (even after restarting the uploader twice).

I can only guess that I hadn't fired up every single junction mapping that I use (I have 3, and I had only fired up 2 earlier, so 1 of the junctions didn't have the latest "client update"). Or things were extra wonky earlier today.
Callean Drevus
Perkone
Caldari State
#337 - 2012-01-25 09:00:59 UTC
Ah, yes, that could be the case. If only one of the clients updates, the uploader will still use the most recent cache folder (in this case, only one client) and thus, all uploads from the older clients will not get registered.

Developer/Creator of EVE Marketeer
Endeavour Starfleet
#338 - 2012-01-26 09:18:50 UTC
I am still looking forward to gathering this LP store data when you are ready. Cool
Omega Flames
Caldari Provisions
Caldari State
#339 - 2012-01-26 09:23:13 UTC  |  Edited by: Omega Flames
Callean Drevus wrote:
Ah, yes, that could be the case. If only one of the clients updates, the uploader will still use the most recent cache folder (in this case, only one client) and thus, all uploads from the older clients will not get registered.

Was just about to update this with the error im getting now but seems Bob beat me to it, however I'm abit lost as to what I need to do to get it working again.

edit: deleting the config.ini file found in my appdata fixed it.
Callean Drevus
Perkone
Caldari State
#340 - 2012-01-26 20:22:51 UTC
Good to hear your problem has been solved.

I've updated the EMK database to use the 1.1 crucible data dump.

Developer/Creator of EVE Marketeer