These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
123Next pageLast page
 

RETURNED - EVE Marketeer - Market Data Aggregation & Information
Author
Previous Topic Next Topic
Callean Drevus
Perkone
Caldari State
#1 - 2011-09-06 18:16:56 UTC  |  Edited by: Callean Drevus
EMK IS BACK!!!

EVE Marketeer is a website in the spirit of EVE Central and EVE Marketdata, sadly, after I was out of the running for a few months, I'm sorry to say it's not better than both anymore. It may still be better than EC, but especially EMD has made large strides in useful features.

In any case, I'm back, and the way it stands won't do at all anymore. EMK's got to be the best market website that exists, and I will not stop before it's back to it's former glory.

Because I've run into some walls with the current version, that will require rewriting the system from scratch, which may take some time, but the universe will be a lot better for it.

Before I make lots of stupid design decisions, I'm very anxious to hear from you what exactly you used most on the current website, and what you would like to see after a rewrite. Anything goes, even things you think are impossible! Cool

Please just keep adding to this thread. Making a new one wouldn't really make any difference, but just be aware that the latest information is in the last posts ;)

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#2 - 2011-09-08 17:46:17 UTC
With the fixes/additions to the API, I hope that the your orders information is being updated correctly again (though I imagine it might still go wrong if your orders last more than 7 days). I'll fix that this weekend.

Due to RL time constrains since working fulltime (I think you can guess around what time that happened), I'll probably only be able to work on EM during the weekends, though I'll of course respond to posts here all the time.

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#3 - 2011-09-10 16:32:06 UTC  |  Edited by: Callean Drevus
Today, I made some modifications to how the item information page is loaded. It now loads all tabs dynamically to save on overal page loading time.

Overall I'm currently working on some optimization, since I've noticed the website become increasingly slower with an increasing amount of data.

In addition, I might be looking for people whom are interested in helping develop EVE Marketeer. I'm not certain yet, but since I noticed my own availability for actual work dropping, I am open to any interest people might have.

EDIT: Also hard at work on converting the website to the new API key system :)

Developer/Creator of EVE Marketeer
Turhan Bey
EVE University
Ivy League
#4 - 2011-09-10 18:59:53 UTC  |  Edited by: Turhan Bey
Just started getting these errors within the last hour:

Quote:
Debug: Retrieved new files
Debug: process: skipping unknown key_type GetRegionBest
Debug: 10000002
Debug: upload: uploading data_type=GetOrders; upload_type=orders;
Debug: upload: uploading to http://eve-marketdata.com/api/upload.php
Debug: upload: uploading to http://www.evemarketeer.com/api/upload
Debug: upload: uploader.send = 200, OK
Debug: upload: response=
Warning: mysql_connect(): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2) in /var/www/core/lib/adodb5/drivers/adodb-mysql.inc.php on line 362
1
Error: Upload unknown problem:
Warning: mysql_connect(): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2) in /var/www/core/lib/adodb5/drivers/adodb-mysql.inc.php on line 362
1
Debug: returned from upload function
Debug: removing the cachefile
Debug: Processed all files, clearing queue

EDIT: BTW, they are anomalous. It seems to fail for awhile, then work for awhile, then it starts to fail again. Connection issues with the database server?
Callean Drevus
Perkone
Caldari State
#5 - 2011-09-10 19:04:21 UTC  |  Edited by: Callean Drevus
It was a known problem. I had some issued upgrading MySQL. For some reason it determined that it shouldn't start anymore, and for just as obscure a reason, it suddenly works again. It should be stable now (if a bit slow).

UPDATE: Okey, **** me, it is NOT stable. I'll be working on fixing that. Until I say it's fixed, please don't worry if you have intermittent (or constant Roll) connection issues.

Developer/Creator of EVE Marketeer
Turhan Bey
EVE University
Ivy League
#6 - 2011-09-10 19:11:12 UTC  |  Edited by: Turhan Bey
Callean Drevus wrote:
In addition, I might be looking for people whom are interested in helping develop EVE Marketeer. I'm not certain yet, but since I noticed my own availability for actual work dropping, I am open to any interest people might have.

I'm interested in helping out in whatever way that I am able. I am familiar with all of the tech that you have linked at the bottom of the site, except that I have used neither PHEAL nor YAPEAL before. (I write my own libraries.)

Examples of my past work include various tools for EVE University. The ones still in active use:

- Hangars Automated Inventory System (HAIs), *internal use only*
- Agent Rangefinder - http://util.eveuniversity.org/Missions/AgentRangefinder/
- Planetary Interaction Taskforce Webtools - http://util.eveuniversity.org/PiBear/
- simple test mapping engine, not currently used in any production sites - http://util.eveuniversity.org/JSMapEngine/
Callean Drevus
Perkone
Caldari State
#7 - 2011-09-11 07:42:25 UTC  |  Edited by: Callean Drevus
I would be mostly looking at people whom can develop stuff. In the end, I'm aiming to make EVE Marketeer the best, but that will probably happen faster with some more people to share the load with.

Are you familiar with mercurial repositories? And do you have any ideas of what you would/could built into EVE Marketeer, or what it should be in the long term?


Different note, it has been in EMK for some time already, but I"ve never really come around to building an interface element for it. It is a view to allow you to look at the price levels of PI components and determine whether it's really worth it to develop it to that level 4 item. http://www.evemarketeer.com/item/piprice/Enriched_Uranium

You'll have to enter the item names manually (substitute underscores for spaces). I'll eventually add this in a tab under the item screen.

Oh, and the database should be functional again now. It took a rather long while and some rebuilding, but everything is as before :)

Developer/Creator of EVE Marketeer
Domi Etymology
Violent Alternatives
#8 - 2011-09-15 03:43:34 UTC
I think the sql server might have just died :P

Oh and I'd be happy to help with development where/when I can. Haven't got the foggiest idea what a mercurial repositories is though :P
Turhan Bey
EVE University
Ivy League
#9 - 2011-09-15 17:37:19 UTC  |  Edited by: Turhan Bey
Mercurial is a version control system. I've never used it myself (I use Git), but wouldn't imagine it'd be difficult to adapt to its commands if you've used any other kind of version control (RCS, CVS, Subversion, Git, etc.)

EDIT: Oh yes, and confirming, the site still seems to be down. :)
Callean Drevus
Perkone
Caldari State
#10 - 2011-09-15 19:00:24 UTC  |  Edited by: Callean Drevus
Ok :) I'm using mercurial for the EM versioning so you'd have to use it. Not that my versioning is exceptionally decent (in fact, it's horrible, but at least it's versioning), but it allows for easy updating of the website (and using it for that is bad practice too, but it's a hobby project, so it's allowed). I'll see whether I can create a general account for EM developers on my hosted repository, otherwise I might migrate it to the server itself.

In any case, it must've been something I was doing to the server, it never let me down like that before... it does seem to have killed all the tables though. That'll be repairing myisam tables for the rest of the night.

UPDATE: Got an account for co conspirators set up. I'll send you the details tomorrow by ingame mail :)

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#11 - 2011-09-17 23:17:32 UTC
This needs to be on top!

And I've got a good excuse, I added the utilization of customizable keys. Now you guys all need to enter your information again, but it's worth it. Everything is done automatically. Mainly thanks to Dragonaire and Yapeal though :)

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#12 - 2011-09-20 21:17:08 UTC  |  Edited by: Callean Drevus
Ah, guys/gals, I think I've come up with a really nice feature now (or well, it existed elsewhere of course, but now I bring it to the masses).

It's called 'My Blueprints', and it simply shows you a list of all blueprints you have, with their material levels (as based on the industry jobs you've started/completed) and based on the prices in your current region, whether it is worth it to build them. Nice red and green row backgrounds show you what is worthwhile at a glance.

I'm going to be using this one often :)

Also, the order uploads have finally caught up to reality, so all market prices should be current again now. I also made the checking of false or idiotic orders MUCH more robust, taking into account such things as the most common prices, excluding outrageous orders, while retaining a margin of flexibility which should allow for prices to change (and be played with quite a bit). In the future this may be refined to not simply throw the odd orders away, but flag them and hide them until someone wants to see them (and even search for them specifically, who knows what nice stuff might be there, it's also excluding honest mistakes now Roll).

Oh, and last but not least, the site now remembers what region you had selected last time you were there, so no more automatically switching back to Jita!

Developer/Creator of EVE Marketeer
Muscaat
EVE Markets
#13 - 2011-09-20 23:30:26 UTC
As of about 15 minutes ago uploads were failing:

Quote:
2011-09-21 00:19:48.016 WARN: [EVEMarketeerUploader] EVE Marketeer upload failed with error
Fatal error: Call to a member function metadata() on a non-object in /var/www/mod/global/global.php on line 20


(First line of the log is mine)

Sad
Callean Drevus
Perkone
Caldari State
#14 - 2011-09-21 05:48:50 UTC
Me knows, it is horrible. Fix under way.

Developer/Creator of EVE Marketeer
Callean Drevus
Perkone
Caldari State
#15 - 2011-09-21 16:08:53 UTC
Should be fixed now.

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#16 - 2011-09-22 02:17:53 UTC
The API is throwing errors all day again.

LOGSQL Insert Failed: insert into adodb_logsql (created,sql0,sql1,params,tracer,timer) values( NOW(),?,?,?,?,?)
No database selected

Warning: Cannot modify header information - headers already sent by (output started at /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/adodb5/adodb.inc.php:482) in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/api.php on line 151
Callean Drevus
Perkone
Caldari State
#17 - 2011-09-22 06:46:34 UTC  |  Edited by: Callean Drevus
Where exactly do you get these errors? The whole site runs on the same database, and the site seems to be running fine.

Update: My guess is you're using an outdated version of the uploader or an API reference to the old site. Try using www.evemarketeer.com instead of evemarketeer.com.

Developer/Creator of EVE Marketeer
Scrapyard Bob
EVE University
Ivy League
#18 - 2011-09-22 15:30:47 UTC
That was indeed it, my ImportXML() was still pulling from "evemarketeer.com" instead of "www.evemarketeer.com".
Callean Drevus
Perkone
Caldari State
#19 - 2011-09-24 13:08:50 UTC
BIG update today!

I added pretty much everything that you could do to yourself for corporations. That means you can now view assets, orders, transactions and blueprints (profitability) for your corporation.

This information is ATM only accessible when you are the corporation director.

Of course, to make it all work, you need to have added a corporation key to your account.

Developer/Creator of EVE Marketeer
Emma Royd
Maddled Gommerils
#20 - 2011-09-25 06:53:13 UTC
All I get when I go to http://www.evemarketeer.com/ is a blank page atm. Cry
123Next pageLast page