These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

RETURNED - EVE Marketeer - Market Data Aggregation & Information
Author
Previous Topic Next Topic
Domi Etymology
Violent Alternatives
#101 - 2011-11-11 00:27:26 UTC
try setting the uploader.exe to run as administrator mode. I have nfi why it needs it, but it seemed to clear up most of the headaches for me.
Shingihada Rubik
University of Caille
Gallente Federation
#102 - 2011-11-11 02:09:51 UTC
Doesn't work, I'm also getting the following error:

Traceback (most recent call last):
File "uploader.py", line 1156, in <"module">
File "uploader.py", line 88, in __init__
File "uploader.py", line 118, in init_text
AttributeError: 'Uploader' object has no attribute 'log'
Abdiel Kavash
Deep Core Mining Inc.
Caldari State
#103 - 2011-11-11 15:49:28 UTC
I am getting the above message too. I downgraded to 2.5.4EM, which seems to upload fine (the uploads are showing in both the uploader and on the website under My Market > Upload History. However, the website and the API still show an old value (as in, 3 days old). Is this a bug, or is there some delay in processing uploads?
Callean Drevus
Perkone
Caldari State
#104 - 2011-11-11 19:17:32 UTC
Umm, turning on EVE Central proccessing 1 day ago while I couldn't keep an eye on it turned out to be the wrong decision, so the queue is now more or less filled with lots of real and bogus updates from eve central. Problem is I don't know which are real so I have to let the entire queue finish. Or purge it which would remove all real updates as well. Will soon implement something to delete only queued items from a certain source.

I appreciate the uploader bug reports btw, I'll see if i can fix the problem this weekend (I'm a bit distracted by Skyrim, but this should be possible :)

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#105 - 2011-11-12 19:07:22 UTC
Abdiel Kavash wrote:
I am getting the above message too. I downgraded to 2.5.4EM, which seems to upload fine (the uploads are showing in both the uploader and on the website under My Market > Upload History. However, the website and the API still show an old value (as in, 3 days old). Is this a bug, or is there some delay in processing uploads?


The bug should be fixed in uploader version 2.6.1 which I've just released.

Furthermore, the site should be processing orders as normal again too though it might still take some time for it to catch up the backlog.

Developer/Creator of EVE Marketeer
Shingihada Rubik
University of Caille
Gallente Federation
#106 - 2011-11-13 15:40:43 UTC
Huh, I thought I posted something here earlier today, but I guess not.

Anyways, the new update fixed everything for me at least. So it's working flawlessly for me right now, however, when I booted up my computer this morning (Windows 7) I got a new error message, but just restarting the app worked. I'm just posting to let you know since the app still works fine.

Also, I constantly get the error about not being allowed to post HTML, so I just pasted the error to Pastebin: http://pastebin.com/S76D7eCU
Scrapyard Bob
EVE University
Ivy League
#107 - 2011-11-14 21:06:05 UTC
On the market scanner page - after a while (an hour or two), it stops giving commands to the in-game market window. Not exactly sure why, (maybe you're going up against some sort of throttle and you need to back off to 3.2 or 3.5 seconds).

The page is still running, it's just not looking up items on the market.
Endeavour Starfleet
#108 - 2011-11-14 22:30:37 UTC
Site throws an error when trying to see the prices on individual items.
Callean Drevus
Perkone
Caldari State
#109 - 2011-11-14 22:44:17 UTC  |  Edited by: Callean Drevus
Shingihada Rubik wrote:
Huh, I thought I posted something here earlier today, but I guess not.

Anyways, the new update fixed everything for me at least. So it's working flawlessly for me right now, however, when I booted up my computer this morning (Windows 7) I got a new error message, but just restarting the app worked. I'm just posting to let you know since the app still works fine.

Also, I constantly get the error about not being allowed to post HTML, so I just pasted the error to Pastebin: http://pastebin.com/S76D7eCU


Ah, yes, I've seen this too, but I cannot understand why it fails intermittently, it shouldn't be different on each startup. In addition, I only see it when running from the IDE, so I've yet to find out what's causing it.

@Scrapyard Bob: Does it stop looking up items (say, the market window does not constantly pop up anymore), or does it stop sending data? Since after a few hours, the entire market would be scanned, and EVE doesn't generate new cachefiles if everything is cached already (even if the uploader deleted the files).

If the second is true, was it always doing this? Or is it a new problem?

@Endeavour: I do not get any errors, where exactly are the problems occuring?

I've also been notified that the server has bad harddisks, which means they have to be replaced. In any case, the server would be moved soon anyway (probably this weekend), but you shouldn't notice anything this time (I've been careful about setting my TTL this time), and the true time I move will mostly will depend on how soon I finish or get bored of Skyrim Roll

Developer/Creator of EVE Marketeer
Shingihada Rubik
University of Caille
Gallente Federation
#110 - 2011-11-15 00:19:28 UTC
I've been seeing that hanging too, it appears it's just the market that isn't refreshed, the webpage keeps ticking in the background but I haven't checked with the uploader while playing if it still uploads.

Also, and this is mostly because I'm stupid: Is the delete cache option on for default? Because I've been mad at EVE Mentat the last three hours for not reading any cache files when I repeatedly tried to refresh it... and then it turns out EVE Marketeer Uploader removes the cache files after uploading. Hahaha. My rage was transferred to my desk via my head when I realized that. Ugh.
Domi Etymology
Violent Alternatives
#111 - 2011-11-15 04:10:45 UTC
saw something new from the uploader today (2.6.1)

Error: Upload Error: Unable to upload, data is too old, you have to upload within 15 minutes of the check.
2011-11-15 11:38:22: Uploaded 18054 in The Forge to EC
2011-11-15 11:38:22: Uploaded 18054 in The Forge to EMK
Error: Upload Error: Unable to upload, data is too old, you have to upload within 15 minutes of the check.
2011-11-15 11:38:25: Uploaded 17367 in The Forge to EC
2011-11-15 11:38:33: Uploaded 17367 in The Forge to EMK
Error: Upload Error: Unable to upload, data is too old, you have to upload within 15 minutes of the check.
2011-11-15 11:38:39: Uploaded 17235 in The Forge to EC
2011-11-15 11:38:40: Uploaded 17235 in The Forge to EMK
2011-11-15 11:38:42: Uploaded 19696 in The Forge to EMD
2011-11-15 11:38:42: Uploaded 19696 in The Forge to EC
2011-11-15 11:38:43: Uploaded 19696 in The Forge to EMK
Error: Upload Error: Unable to upload, data is too old, you have to upload within 15 minutes of the check.


Has there been some delay built into the uploader now it's handling 3 sites. I'm not entirely sure how it's falling behind by 15 minutes, but......

btw, could those errors be a bit more specific, ie: which item ID, and to which site? I got nfi which uploads were failing from that description.
Endeavour Starfleet
#112 - 2011-11-15 04:16:01 UTC  |  Edited by: Endeavour Starfleet
Just went to another random item

http://www.evemarketeer.com/item/itemprice/3540

I get this

Quote:
Fatal error: Uncaught exception 'Dwoo_Exception' with message 'Dwoo->get/Dwoo->output's first argument must be a Dwoo_ITemplate (i.e. Dwoo_Template_File) or a valid path to a template file' in /var/www/core/lib/dwoo/Dwoo.php:314 Stack trace: #0 /var/www/core/mod/template.php(33): Dwoo->get('core/tpl/item/i...', Array) #1 /var/www/core/mod/page.php(33): template_parse('item/itemprice....', Object(Request)) #2 /var/www/core/main.php(69): page->renderBody(Object(Request)) #3 /var/www/index.php(8): include('/var/www/core/m...') #4 {main} thrown in /var/www/core/lib/dwoo/Dwoo.php on line 314
Scrapyard Bob
EVE University
Ivy League
#113 - 2011-11-15 13:46:20 UTC
Callean Drevus wrote:

@Scrapyard Bob: Does it stop looking up items (say, the market window does not constantly pop up anymore), or does it stop sending data? Since after a few hours, the entire market would be scanned, and EVE doesn't generate new cachefiles if everything is cached already (even if the uploader deleted the files).

If the second is true, was it always doing this? Or is it a new problem?


The market window stops popping up.
Callean Drevus
Perkone
Caldari State
#114 - 2011-11-15 17:42:30 UTC
Lots of things to reply to :P

Yes, the delete cache option is deleted by default, because a big cache makes EVE slow and the uploader as well (since it has to check every file in the dir). If you let one of the programs delete the files eventually you should be fine though.

@Domi: That is evemarketeer telling you it doesn't want the data anymore I believe, but it might be the uploader. This might be happening because one of the sites is down, which would cause uploads to hang before a timeout occurs. Will look into fixing that (negating services that are down, or lowering timeout).

Endeavour, how do you go to the item? The URL has changed. The search function should work fin and I thought the browser should also work.

@Scrapyard: That is bad. I know it happened to me sometimes, and the only way to fix it is to reatart the IGB. Maybe it has to do with timeout. I might make timeout selectable, so you can put it more than 3 seconds.

Developer/Creator of EVE Marketeer
Shingihada Rubik
University of Caille
Gallente Federation
#115 - 2011-11-15 21:52:11 UTC
Callean Drevus wrote:
Lots of things to reply to :P

Yes, the delete cache option is deleted by default, because a big cache makes EVE slow and the uploader as well (since it has to check every file in the dir). If you let one of the programs delete the files eventually you should be fine though.
.

Yeah, but it seems that is automatically ticks it off every time I reboot my computer (basically every morning). And this is really annoying because I will forget about it and then be angry when EVE Mentat doesn't find any cache files. Is there any way to turn this of by default, because EVE Mentat deletes the cache files anyways when it's done scanning.

Just convenience, but it's enough to make me a wee bit angry, haha.
Callean Drevus
Perkone
Caldari State
#116 - 2011-11-15 23:34:21 UTC
Well, it should remember your settings :P at startup the uploader tells you where your setting file is. If it isn't writing it correctly, maybe you can change it manually. If the problem persists, I'll try and see what I can do about it.

Developer/Creator of EVE Marketeer
Shingihada Rubik
University of Caille
Gallente Federation
#117 - 2011-11-15 23:51:20 UTC
Might have something to do with it crashing every time I reboot maybe? I just checked the config.ini file and it has correctly made delete cache = false. But yeah, I don't really know either.
Callean Drevus
Perkone
Caldari State
#118 - 2011-11-15 23:56:20 UTC
It could be writing an empty config file on crash, which would explain why the next startup reverts to default. I'll have to check that.

Developer/Creator of EVE Marketeer
Domi Etymology
Violent Alternatives
#119 - 2011-11-16 07:57:33 UTC
which folder is the config.ini file in?
Callean Drevus
Perkone
Caldari State
#120 - 2011-11-16 14:27:20 UTC
C:\Users\*username*\AppData\Roaming\eve_marketdata\config.ini

Now that I think of it, the EVE Marketdata uploader might also be overwriting your perfect config if you are running it at the same time (or intermittently), I had that after I first started building the uploader.

I could of course just make a unique config file, but at first this was useful to make the switch easier for people. I'll consider changing the location of the configuration file at the same time as adding variable URL uploading to it.

Developer/Creator of EVE Marketeer