These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

RETURNED - EVE Marketeer - Market Data Aggregation & Information
Author
Previous Topic Next Topic
Scrapyard Bob
EVE University
Ivy League
#181 - 2011-12-14 00:24:32 UTC
Searching for "plex" returns a page with a bunch of items that contains the word "plex". Which is all well and good.

But you can't click on the line that says "30 Day Pilot's License Extension (PLEX".

My guess is that it breaks due to the single-quote inside of the item's name.
Controller Vrelk
The Scope
Gallente Federation
#182 - 2011-12-14 02:15:47 UTC
I will have to say, the mission page is completely confusing me. Yesterday it was a lot higher than it should have been, today it is spot on.

1) The uploader now uploads
2) it uploads before you enter a upload key
3) It stops responding when you try to close it
4) It says version 1.0 when it should say 0.2
Dragonaire
Here there be Dragons
#183 - 2011-12-14 05:45:41 UTC  |  Edited by: Dragonaire
Quote:
2) it uploads before you enter a upload key
But with error message about not having key.
Quote:
4) It says version 1.0 when it should say 0.2
He beat me to it I noticed it on version 0.1 also but figured you'd notice and fix it on next update but seems you didn't.
Quote:
3) It stops responding when you try to close it
Edit I have notice this now and had to have Windows kill it because it wouldn't close.I have also notice if you stop scanning for a couple minutes and then restart the scan in Eve you have to kill and restart it to get it going again.

Another issue I've noticed is after it has been running for a while it seems to start refreshing the upload tab and goes to the top than jumps down to the end again I believe to add the next item but once again goes back to the top so you can't tell if it is still working or not so most of the time I end up just restarting it since I have no idea if it is still working or has locked up. This happened some with 0.1 but seems worse with 0.2 in that it seems to do it sooner.

Finds camping stations from the inside much easier. Designer of Yapeal for the Eve API. Check out the Yapeal PHP API Library thread.
Scrapyard Bob
EVE University
Ivy League
#184 - 2011-12-14 17:34:46 UTC
log entries for the 0.2b client

Exception in thread EVE Marketeer:
Traceback (most recent call last):
File "threading.pyo", line 552, in __bootstrap_inner
File "Classes.pyo", line 381, in run
File "UploaderFrame.pyo", line 94, in log
File "wx\_controls.pyo", line 1850, in AppendText
PyAssertionError: C++ assertion "m_count == -1 || m_count == -2" failed at ..\..\src\msw\textctrl.cpp(140) in UpdatesCountFilter::UpdatesCountFilter(): wrong initial m_updatesCount value

Also, I have to double-click the system tray icon to get it back to the foreground, in the past tools I only had to single-click the system tray icon to bring it forward.

The "endpoints" tab (or status tab) should also keep track of:

- How many market orders have been uploaded to each endpoint since the tool started running.
- The average time, in seconds, that it took to give each upload to the endpoint server (from "I have something for you" to "okay, it's accepted" to gauge responsiveness).
- How big the upload queue is for that particular endpoint.
- Age (in seconds) of the oldest item in the endpoint's queue.
Callean Drevus
Perkone
Caldari State
#185 - 2011-12-14 18:10:37 UTC  |  Edited by: Callean Drevus
Controller Vrelk wrote:
I will have to say, the mission page is completely confusing me. Yesterday it was a lot higher than it should have been, today it is spot on.


That's because I fixed it :) I more or less wrote than in a previous post, but probably not in a way that was clear enough.

I will try to fix most of these issues and upload a new uploader. Thank you for being my test subjects Blink

Quote:
My guess is that it breaks due to the single-quote inside of the item's name.


Correct. Fixed.

Quote:
Also, I have to double-click the system tray icon to get it back to the foreground, in the past tools I only had to single-click the system tray icon to bring it forward.


This is by design, as it is in line with most other windows applications. I was always clicking twice and it was immediately sent back to the background.

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#186 - 2011-12-14 20:17:18 UTC
Okey, the new uploader 0.3 is released.

1) It should hopefully still upload
2) It should only upload before an upload key is entered for EVE Central, it does show the message of not being able to upload with each file it parses though.
3) This happened for some reason if the uploader still had uploads in the queue when you closed it. I've now disabled closing (and I'm showing a message telling you so) while the uploader is still uploading. Not ideal, and I hope to fix that later, but at least you now know what is happening.
4) Ah, well, I of course knew about it, but opening my interface editing program was just a bit too much trouble.

5) The "wrong initial m_updatesCount value" exception should be fixed
6) The "endpoints" tab now keeps track of all mentioned things, except for the time the oldest upload was entered, this was impossible due to the way the queues are made.

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#187 - 2011-12-15 04:11:39 UTC
0.3 is much nicer - it forgot my EMK key that I had entered in version 0.2, but that was no big deal. The stats are now much more informative and give a feel for "is it working" better then watching the list scroll by.
Controller Vrelk
The Scope
Gallente Federation
#188 - 2011-12-15 04:39:01 UTC  |  Edited by: Controller Vrelk
I would recommend auto-generating the config file. That way when it is extracted, you don't overwrite the old config file that contains the keys, although I was paying attention not to overwrite it, some people may.
Scrapyard Bob
EVE University
Ivy League
#189 - 2011-12-15 04:43:52 UTC
Controller Vrelk wrote:
I would recommend auto-generating the config file. That way when it is extracted, you don't overwrite the old config file that contains the keys, although I was paying attention not to overwrite it, some people may.


Ah, that's what I had done wrong - I deleted the contents of my EMK upload program folder, which contained the XML file, before upgrading to 0.3.

(It was able to pull the EMD key from my EMD upload client, so that's why it didn't forget the EMD key.)
Controller Vrelk
The Scope
Gallente Federation
#190 - 2011-12-15 04:47:57 UTC
The uploader (0.3) isn't uploading anything for me. The queue size kept increasing until it hit 50 and then it stopped, but the uploads is still 1, which it did as soon as I opened it. It appears to be queuing everything and not uploading. I have a key entered for both EMK and EMD, and 0 for EC.
Scrapyard Bob
EVE University
Ivy League
#191 - 2011-12-15 04:55:45 UTC
Controller Vrelk wrote:
The uploader (0.3) isn't uploading anything for me. The queue size kept increasing until it hit 50 and then it stopped, but the uploads is still 1, which it did as soon as I opened it. It appears to be queuing everything and not uploading. I have a key entered for both EMK and EMD, and 0 for EC.


Mine uploaded about 450-550 to each of the (3) sites, then stopped working.

Attempting to close the uploader resulted in the following error:

Exception in thread Thread-4:
Traceback (most recent call last):
File "threading.pyo", line 552, in __bootstrap_inner
File "Classes.pyo", line 303, in run
File "Classes.pyo", line 329, in addNewFiles
IOError: [Errno 13] Permission denied: 'C:\\Users\\ScrapyardBob\\AppData\\Local\\CCP\\EVE\\c_program_files_(x86)_ccp_eve31024_tranquility\\cache\\MachoNet\\87.237.38.200\\301\\CachedMethodCalls\\8c18.cache'

Now, that could possibly be because I still have the EMD's uploader running as a fail safe against the EMK uploader hanging / stopping.

Restarted it and it picks right up and processes again. Will watch and see whether it hangs at around the same point.
Scrapyard Bob
EVE University
Ivy League
#192 - 2011-12-15 05:03:49 UTC
Controller Vrelk wrote:
The uploader (0.3) isn't uploading anything for me. The queue size kept increasing until it hit 50 and then it stopped, but the uploads is still 1, which it did as soon as I opened it. It appears to be queuing everything and not uploading. I have a key entered for both EMK and EMD, and 0 for EC.


I hit this bug too. After a few minutes of working fine (a few hundred uploads) it decided to stop uploading on all (3) threads and is just sitting there with the queue column at 50 and the current time column constantly counting upwards.

(The EMD uploader is still running strong, so EMD is up.)

While the "Wait until uploads are finished" message is nice, I'm wondering if you can eventually add a button to that dialog that says "Go ahead and exit" beside the "Oops, don't exit" button.
Scrapyard Bob
EVE University
Ivy League
#193 - 2011-12-15 05:07:05 UTC  |  Edited by: Scrapyard Bob
Seems like the issue always happens after:

EVE Central: Upload unknown problem:
EVE Central: Uploaded ##### in ########
EVE Central: None

The log has a few entries of:

Exception in thread EVE Central:
Traceback (most recent call last):
File "threading.pyo", line 552, in __bootstrap_inner
File "Classes.pyo", line 399, in run
AttributeError: 'NoneType' object has no attribute 'find'

Happened again:

EVE Marketeer: Uploaded ######## in ########
EVE Marketeer: None
EVE Marketdata: Uploaded ######## in ########
EVE Marketdata: None
EVE Central: Uploaded ######## in ########
EVE Central: Uploaded ######## in ########
EVE Central: None

Exception in thread EVE Central:
Traceback (most recent call last):
File "threading.pyo", line 552, in __bootstrap_inner
File "Classes.pyo", line 399, in run
AttributeError: 'NoneType' object has no attribute 'find'c
Callean Drevus
Perkone
Caldari State
#194 - 2011-12-15 18:59:45 UTC  |  Edited by: Callean Drevus
Config file will eventually just be placed in appdata (or home directory, for unix users).

It also seems that the uploader encounters some errors, quits processing the threads, and then continues running without end, without actually doing something. Thanks to your clear error messages I know exactly what is happening and will probably be able to fix it tonight.

I actually really want the "just go and exit this damn thing" button, but somehow, python does not allow it. Though it seems I've just found a function that does, guess I just wasn't able to find it yesterday. Thanks again for helping point out the issues!

UPDATE: Okey, version 3b is out. The only thing it does is eliminate errors and allowing you to quick prematurely.

Developer/Creator of EVE Marketeer
Major Thrasher
Native Freshfood
Minmatar Republic
#195 - 2011-12-15 20:32:18 UTC  |  Edited by: Major Thrasher
could we have filter options on the stats pages in trade information. currently its just full of minerals and junk.

drop down menu's with full selectable lists would be awsome also.

being able to see the info i want rather than everything i don't would be much more useful IMO.


another suggestiong is that the upload uploads info that hasn't been done before. for example when i start a full scan smartbomb is always first even if i just scanned and uploaded it, then restarted pc.
items should update in order of longest time since upload. similar to evemarket data.

.
Scrapyard Bob
EVE University
Ivy League
#196 - 2011-12-16 05:42:49 UTC  |  Edited by: Scrapyard Bob
Tool seems to be working better - but EVEMarketeer things that some/most of my uploads are coming from the future. (The other 2 endpoints are happy with the upload data, so I'm guessing that EMK is being too picky or has a clock that has drifted.)

Scratch that initial glowing report - it keeps crashing after 5-10 minutes of running multiple clients in multiple regions. No log messages generated, Windows 7 64bit is tossing up the "this program broke" error. Will see if I can gather more details the next time it happens.
Controller Vrelk
The Scope
Gallente Federation
#197 - 2011-12-16 05:55:07 UTC
Oh, I love how these forums don't post things... I posted this a few hours only to find out now that it never posted it.


Anyway.

What is this? http://www.evemarketeer.com/item/info/Gallente_Thanatos_Carrier
I found that while searching for "Thanatos"
Scrapyard Bob
EVE University
Ivy League
#198 - 2011-12-16 12:41:49 UTC
The crashes are still happening after a random amount of time.

Problem signature:
Problem Event Name: APPCRASH
Application Name: unifieduploader.exe
Application Version: 0.1.0.0
Application Timestamp: 49180193
Fault Module Name: KERNELBASE.dll
Fault Module Version: 6.1.7601.17651
Fault Module Timestamp: 4e211319
Exception Code: 80000003
Exception Offset: 0001280c
OS Version: 6.1.7601.2.1.0.256.48
Locale ID: 1033
Additional Information 1: 0a9e
Additional Information 2: 0a9e372d3b4ad19135b953a78882e789
Additional Information 3: 0a9e
Additional Information 4: 0a9e372d3b4ad19135b953a78882e789

In this case, it had uploaded 3900 to EMK, 5751 to EMD, 6671 to EC. No log file was generated, nothing unusual in what can be seen of the Status window. Nothing unusual in the status columns, no full queues.
Callean Drevus
Perkone
Caldari State
#199 - 2011-12-16 19:56:40 UTC  |  Edited by: Callean Drevus
Controller Vrelk wrote:
Anyway.

What is this? http://www.evemarketeer.com/item/info/Gallente_Thanatos_Carrier
I found that while searching for "Thanatos"


Interesting :) this one must be from the new datadump :P

EDIT: And I'm on the uploader problem. Will try uploading for a long time myself this evening.

Oh, and you might've noticed the "EVE Central" user boosting itself to the top of the upload list. This is not a user that is pretending to be something he's not, it's just the one I've added to keep track of the quality and number of EVE Central uploads I retrieve.

I'll have to exclude him from the homepage record though :)

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#200 - 2011-12-16 21:01:29 UTC
Major Thrasher wrote:
another suggestiong is that the upload uploads info that hasn't been done before. for example when i start a full scan smartbomb is always first even if i just scanned and uploaded it, then restarted pc.
items should update in order of longest time since upload. similar to evemarket data.


They, are.

EVE at the moment is not being nice to us marketeers in that it doesn't seem to be writing a cache file when there are no orders. Which explains why I get not upload, which explains why you always see the smartbomb first. If I receive no uploads, I cannot change the order of the list (I could change it based on what is shown, but you never know whether that is actually uploaded).

Developer/Creator of EVE Marketeer