These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Jump Gate Database
Author
Previous Topic Next Topic
Carb Bulby
Science and Trade Institute
Caldari State
#1 - 2012-05-10 01:38:11 UTC
I'm trying to create my own personal program to determine the best trading routes, but I need to get my hands on two data sets.

Firstly, I would like a data set of all the jump paths between systems. I downloaded the .bak file from http://community.eveonline.com/community/toolkit.asp but I don't know how to use that format. Could anyone direct me to a better format or how to use .bak files?

Secondly, is there a way to get my hands on a database of Solar systems and their respective ID's?

Thanks!
Louis Vitton
Viziam
Amarr Empire
#2 - 2012-05-10 07:28:00 UTC
the .bak is a MS SQL back up file.
If you look in this forum you will find statis data dumps which are MYSQL compatible if thats what you want.
Here is a good starting point for the api and data dump to point you in the right locations.
http://wiki.eve-id.net/CCP_Static_Data_Dump ---- data dump
http://wiki.eve-id.net/APIv2_Page_Index ----- API stuff.
If you need specific help you can ask here and there are heaps of people to help you out but from what your saying about a trad tool you want to pull xml data from somewhere like eve central and compare it to find good trade routes.
Osku Rei
Pixel 6
#3 - 2012-05-11 15:16:58 UTC
Carb Bulby wrote:

Secondly, is there a way to get my hands on a database of Solar systems and their respective ID's?


mapSolarSystems ?

Next generation of lottery tracker coming soon! http://evelotterytracker.com/

Please like my post if it has helped you :)
Trenker
#4 - 2012-05-11 15:31:48 UTC
Carb Bulby wrote:
Firstly, I would like a data set of all the jump paths between systems


As Osku Rei already mentioned: The table mapSolarSytems contains all Systems with their names and IDs. The connections (the stargate connections) between them can be found in mapSolarSystemJumps.

There is no table which includes all the "jump paths", you will need some path search algorithm. Just search the forum for it, this is an often hit problem.
EveDataRules
World Domination Inc
#5 - 2012-05-12 11:48:08 UTC  |  Edited by: EveDataRules
I had a need to cache this in the past so here is a dump of my cache: http://www.evedata.org/jumps.sql.gz

Only highsec jumps are completed. I never left the script running to build all the low and null sec routes.

Quote:
SELECT toSolarSystemID, secureJumps AS jumps
FROM jumps
WHERE fromSolarSystemID = 30000142 AND secureJumps <= 5 AND secureJumps > 0


Gives you

Quote:
toSolarSystemID, Jumps
30000119, 2
30000120, 3
30000121, 3
30000122, 4
30000123, 3
30000124, 3
...
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#6 - 2012-05-13 17:50:15 UTC
https://github.com/fuzzysteve/Eve-Route-Plan may be of interest.

It's a very basic route planner.

EveDataRules's table is probably more use at this point though.

If you're doing what I think you're doing, be prepared for it to be a /slow/ process. Route planing with multiple pickups is a massively complex thing to do. With a significant degree of recursion.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Osku Rei
Pixel 6
#7 - 2012-05-13 22:15:30 UTC
Steve Ronuken wrote:

Route planing with multiple pickups is a massively complex thing to do. With a significant degree of recursion.


not really ;)

Next generation of lottery tracker coming soon! http://evelotterytracker.com/

Please like my post if it has helped you :)
Callean Drevus
Perkone
Caldari State
#8 - 2012-05-13 22:21:47 UTC
Osku Rei wrote:
Steve Ronuken wrote:

Route planing with multiple pickups is a massively complex thing to do. With a significant degree of recursion.


not really ;)

That you think it is easy doesn't automatically make it so Blink

Developer/Creator of EVE Marketeer
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#9 - 2012-05-13 23:16:40 UTC  |  Edited by: Steve Ronuken
Osku Rei wrote:
Steve Ronuken wrote:

Route planing with multiple pickups is a massively complex thing to do. With a significant degree of recursion.


not really ;)


If you're dealing with only a few, it's simple enough. But it doesn't scale well. It's an NP Hard problem, much like the travelling salesman problem. People write math papers on this kind of thing, and can get paid big bucks. Smile

Of course, you may be working with something simpler than the general case. Such as looking for things to pick up along a route (say, within 2 jumps of your regular path, from start to finish). That massively drops the complexity of the problem, by limiting your data set.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Liana Fehrnah
Imperial Academy
Amarr Empire
#10 - 2012-05-14 13:36:57 UTC
keep us informed of this :) people can use this
Osku Rei
Pixel 6
#11 - 2012-05-15 07:23:15 UTC  |  Edited by: Osku Rei
Steve Ronuken wrote:
Osku Rei wrote:
Steve Ronuken wrote:

Route planing with multiple pickups is a massively complex thing to do. With a significant degree of recursion.


not really ;)


If you're dealing with only a few, it's simple enough. But it doesn't scale well. It's an NP Hard problem, much like the travelling salesman problem. People write math papers on this kind of thing, and can get paid big bucks. Smile

Of course, you may be working with something simpler than the general case. Such as looking for things to pick up along a route (say, within 2 jumps of your regular path, from start to finish). That massively drops the complexity of the problem, by limiting your data set.


The tool I made a little while ago could do any number of waypoints / pickups (although past about 10 or 11 it would start getting slow) scattered anywhere in eve. It would find the quickest route possible no matter what order you entered the waypoints.
Full security status support, you could basically do >= <= any security status. You could add a 'hard' start and end point. It would also find 'outliers', so if a handful of systems where next to each and they where close to your end point and another system 30 jumps away from the group it would tell you to do the group -> endpoint then do the outlier separately, this was mainly for trade/hauling.

I was working on a method being able to do any number of waypoints by splitting the total count into 10 waypoint chucks, can't remember how far I got with that.

This only took 2 evenings :) So its easy in my scale of things. :)

http://pastebin.com/wZfCGyGT (some, probably, meaningless info)
Waypoints put in (but not in this order): GE-8JV, Agil, Amarr, Rens, Dodixie, Renyn, Jita (endpoint)

Next generation of lottery tracker coming soon! http://evelotterytracker.com/

Please like my post if it has helped you :)