EVE Technology Lab

Ok, now testing scanning with multiple accounts. At the very least I've found the error that was producing the EVE central errors. Now I'm seeing the EVE Marketdata timeout errors (upload within 15 minutes), so I can do something about those I hope. What I fail to understand is how my fifo queue can upload some orders correctly, only to fail on the next one...

UPDATE: Ok, rewriting the filereader led me to probably find what was causing the uploader to hang. It found a lot of files which it wasn't able to do anything with. But these files kept heaping up, because it didn't delete them, leading to what were probably immense times for scanning files. In any case, I'll keep scanning and see what happens.

UPDATE 2: The uploader get's better and better. It's now uploading into the future I've got more uploads than file reads . I guess something is still going wrong with threading.

serves you right for writing code while standing on your head.

The new images showing the item list of what's being scanned/uploaded are sweet :)

That might be caching issues, but I'm not sure. Only time I've seen something like that was the first time I loaded the page.

Yes, possibly cache issue, the site is now behaving on the clients where I'm running them at 1024x768 (so the browser window is only around 850-900 wide.

So far 0.4 of the uploader is passing with flying colors at keeping up with (3) simultaneous market scan clients running. Memory peaked out at around 62.4MB, CPU usage has been negligible. I've uploaded about 14k to each of the (3) endpoints in today's session.

I used EMD's scanner site for most of the day, but will switch over to using the EMK's scanner tomorrow.

Other small notes:

- The XML/JSON/CSV links on individual item pages all point at the "xml" version of the URL

- The location of the regional drop down still feels too far out of place in the upper right, maybe it should be where the item's icon is on an individual item's page. This would probably force you to move the item's icon to the left side of that area.

- Price history graphs look like they broke 3 weeks back and haven't updated.

- It would be nice if I'm on a particular item's page (say Tritanium) that I could click on a link next to the item's name (such as "Minerals") which would take me to a market group summary page for that particular item.

- Longer term wish, being able to see an entire market group (i.e. "Minerals"), with the individual items down the left and the top 5 market regions identified as column headers with the 5% buy/sell prices as the cell contents. Ignoring issues with color blindness, if values where the individual region is 5% above/below the average of the top-5 market price was colored green/red, that might be useful. Prices listed would only need to have about 4-5 decimal places of precision. This means you could switch to "k", "M", "B", "T" suffixes to trim digits off the tail end. The average price in the entire grid should control which suffix to use (up to 50,000 use no divisor, up to 1M use the 'k', up to 1B use the 'M', up to 1T use the 'B'). So you would get numbers like 4385.20, 43850.20, 438.52k, 4.3852M, 43.852M, 438.52M, 4.3852B, 43.852B, 438.52B, 4.3852T, etc.

Yes, very feasible requests all. I'll see when I'll be able to incorporate them into the codebase. Currently incredibly busy with RL and being sick again.

UPDATE: Also very happy to hear that the uploader is still performing perfectly :)

UPDATE 2: Also, PERL and especially CPAN are absolutely terrible...

I am not getting any errors, but every so often I will open the uploaded and it will not upload anything (0.4). Restarting does not help and I do not have any other uploaders running. It was working last night before downtime, but today it is not uploading anything.


PS: I am disappointed that you didn't make a version 3D.

That was it, good to know. I cleared my cache just to see if that was it, and it was. I thought the uploader deleted the cache files after uploading them.

Hmm. I left and had the market scanner running for about 2-3 hours. I just got home and found that the uploader had only uploaded 20 things, and this is after I cleared my cache.


EDIT: The market scanner on you site seems to be going in circles, it is scanning the same things over and over.

When I left I saw a weathe blueprint and a quantum flux generator 3 go by, when I came back and noticed that it had uploaded 20 items I watched for a minute and saw the same things go by.

Hmm, for some reason mysql decided that it'd had enough. More, the server seems to have decided it was enough, and it has been rebooted by my hosting provider because it was unresponsive. (Now, that is awesome, except that mysql didn't work afterwards).

I am unable to pinpoint any issue that could have caused this hangup, other than me leaving the server, as it crashed about 5 minutes after I disconnected