These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

RETURNED - EVE Marketeer - Market Data Aggregation & Information
Author
Previous Topic Next Topic
Callean Drevus
Perkone
Caldari State
#161 - 2011-12-10 20:48:27 UTC
Rest assured :P the new uploader won't do any such thing ;)

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#162 - 2011-12-10 23:18:46 UTC
Zaepho wrote:

I don't suppose you have a log of these skew values to make an intelligent decision of how far off is commonly acceptable? I would think about 5 or 10 seconds should be MORE than plenty but I'm confident my machines talk to a decent NTP server on a regular basis :)


Well, the "windows time server" a.k.a. "time.windows.com" is commonly off by a bit. And older WinXP machines will only sync with the server about once a week unless you play with the registry or belong to a Windows domain. So 2-3 seconds is not uncommon on normal Windows boxes.

So I'd say 5 seconds should be fine, unless someone's machine is lagged in which case maybe you have to go with 10 seconds.
Dragonaire
Here there be Dragons
#163 - 2011-12-11 00:46:55 UTC
I'd allow 10 lag and 5 ahead and it shouldn't be a problem after that.

Finds camping stations from the inside much easier. Designer of Yapeal for the Eve API. Check out the Yapeal PHP API Library thread.
Callean Drevus
Perkone
Caldari State
#164 - 2011-12-11 09:24:46 UTC
Well, atm I only check whether a message comes from the future. I do not really mind getting messages from anywhere in the past. That is mostly due to the fact that uploads might end up in a queue and be recieved a lot later than they were generated, and I do not wish to exclude those.

Oh, the new uploader will probably be using a bit more memory than the old one, a function of how I deal with threaded uploading and still clearing the cache quickly. As long as you upload decently fast (and do not have 200 endpoints) it shouldn't be problematic though ('m thinking a few MB's of ram).

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#165 - 2011-12-11 15:04:44 UTC
The existing EVEMarketeer uploader reports as about 47MB used (peak) in Win7 64bit. (The EMD uploader is very similar size.)

So unless you blow that up to more then 80-ish, you should be fine.
Callean Drevus
Perkone
Caldari State
#166 - 2011-12-11 17:45:06 UTC
I present to you, the unified uploader: http://www.evemarketeer.com/downloads

You can now add any number of endpoints, have EVE Central lagging behind all other endpoints without any trouble and it be generally awesome and out of your way.

Currently only downloadable as a zip archive, but it'll change once I've worked out all the bugs. I invite you to try it out!

Developer/Creator of EVE Marketeer
Dragonaire
Here there be Dragons
#167 - 2011-12-12 07:39:24 UTC
Quick bug report here for you
Warning: Invalid argument supplied for foreach() in /var/www/www.evemarketeer.com/mod/item.php on line 88
Market statistics and information for New Eden
Catchable fatal error: Object of class yapeal could not be converted to string in /var/www/www.evemarketeer.com/var/dc9f76fa4c888904204769a29d0ad5f2.d15.php on line 15

Finds camping stations from the inside much easier. Designer of Yapeal for the Eve API. Check out the Yapeal PHP API Library thread.
Controller Vrelk
The Scope
Gallente Federation
#168 - 2011-12-12 07:40:31 UTC  |  Edited by: Controller Vrelk
Callean Drevus wrote:
I present to you, the unified uploader: http://www.evemarketeer.com/downloads

You can now add any number of endpoints, have EVE Central lagging behind all other endpoints without any trouble and it be generally awesome and out of your way.

Currently only downloadable as a zip archive, but it'll change once I've worked out all the bugs. I invite you to try it out!


Looks nice.

1) You did forget the 's' in universal under data types when adding a site.

2) [Edit] A restart of the program fixed this, but still not sure why it happened the first time.[/edit]
Also, you might want to fix the cache folder. It starts out with the windows username of Bart, and autodetect isn't changing it on my desktop, though it does fix it on my laptop. Maybe have it autodetect on first startup.
Quote:
Traceback (most recent call last):
File "UploaderFrame.pyo", line 303, in installationAutodetectButtonClick
AttributeError: Installation instance has no attribute 'folder_base'


3) Maybe add a upload log like before so we can tell if its working. if it does have one, then it isnt working for me.


4) Did you do anything to the missions page? the total looks better now, I haven't added it up for what the actual rats are, but it looks about right.
Dragonaire
Here there be Dragons
#169 - 2011-12-12 08:06:02 UTC
On another note Not sure if the new uploader is doing anything it doesn't seem to be uploading anything P

Finds camping stations from the inside much easier. Designer of Yapeal for the Eve API. Check out the Yapeal PHP API Library thread.
Controller Vrelk
The Scope
Gallente Federation
#170 - 2011-12-12 08:21:21 UTC
Dragonaire wrote:
On another note Not sure if the new uploader is doing anything it doesn't seem to be uploading anything P

Odd, my upload history on the site is completely empty.
Dragonaire
Here there be Dragons
#171 - 2011-12-12 16:07:28 UTC
Mine seems to have done some uploads now but only after disabling the other sites and a couple restarts

Finds camping stations from the inside much easier. Designer of Yapeal for the Eve API. Check out the Yapeal PHP API Library thread.
Callean Drevus
Perkone
Caldari State
#172 - 2011-12-12 17:57:16 UTC
Hmm, the only problem I am aware of is having to restart after autodetecting for the shizzle to work. I'll see wha I can do about these current troubles. The upload log should be working :P if it isn't showing anything, it isn't uploading.

Developer/Creator of EVE Marketeer
Controller Vrelk
The Scope
Gallente Federation
#173 - 2011-12-12 20:11:56 UTC
Callean Drevus wrote:
Hmm, the only problem I am aware of is having to restart after autodetecting for the shizzle to work. I'll see wha I can do about these current troubles. The upload log should be working :P if it isn't showing anything, it isn't uploading.

The new uploader isn't uploading anything on either of my computers.
Scrapyard Bob
EVE University
Ivy League
#174 - 2011-12-13 04:12:57 UTC
Will try this when you release the new version (I promise).
Controller Vrelk
The Scope
Gallente Federation
#175 - 2011-12-13 06:09:05 UTC  |  Edited by: Controller Vrelk
Counting is either off again or still off for ratting. In the past 24 hours I have made between 50-70 mill, not 292,519,637.50 as the site says.

Edit: The correct count is 105 mill, though it was actually in the range I said above due to having another person there.
Callean Drevus
Perkone
Caldari State
#176 - 2011-12-13 17:12:16 UTC
Counting is still off Blink

Developer/Creator of EVE Marketeer
Dragonaire
Here there be Dragons
#177 - 2011-12-13 17:56:03 UTC
I've just been thinking about something and thought I'd ask here. How do you come up with the list of stuff in the general list for the scans? Do you just do it randomly or by market group or are you trying to get the best coverage for things you don't have data on yet? Or have you not really thought about how to optimize things? Blink

Finds camping stations from the inside much easier. Designer of Yapeal for the Eve API. Check out the Yapeal PHP API Library thread.
Callean Drevus
Perkone
Caldari State
#178 - 2011-12-13 18:41:19 UTC  |  Edited by: Callean Drevus
The list is sorted based on what was last uploaded (in the region you reside in). That means the most outdated items are uploaded first. I'm not entirely sure whether it also does this for subsets.

I've also uploaded a new version of the unified uploader. It hasn't really changed much, but it should autodetect when you have no EVE installations defined and automatically search for them.

I'm also sorry to say that your totals have been fixed Vrelk Blink I was counting the total wallet journal amount for every rat you killed P

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#179 - 2011-12-13 19:22:33 UTC
v0.2 of the unified uploader, it starts on Win7 64bit, creates an icon in the systray, but then never does anything. The log file contains:

Traceback (most recent call last):
File "emkUploader.py", line 19, in module
File "wx\_core.pyo", line 7981, in __init__
File "wx\_core.pyo", line 7555, in _BootstrapApp
File "emkUploader.py", line 11, in OnInit
File "UploaderFrame.pyo", line 70, in __init__
File "UploaderFrame.pyo", line 107, in initialize
File "UploaderFrame.pyo", line 305, in installationAutodetectButtonClick
AttributeError: Installation instance has no attribute 'folder_base'
Callean Drevus
Perkone
Caldari State
#180 - 2011-12-13 21:15:53 UTC  |  Edited by: Callean Drevus
Hmm, will take a look.

EDIT: Fixed version uploaded

Developer/Creator of EVE Marketeer