These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Retribution - MySQL Static Data Export SDE - Individual Tables ( sql / gz / bz2 / zip formats)

Author
Icy One
The Executives
#1 - 2012-04-06 23:12:15 UTC  |  Edited by: Icy One
For a little while now I have been creating exports from MySQL in a table by table format since I don't want to always import the whole database if I am just using a few tables. You can also find the full single .sql export.

You can download the table by table extracts by individual table ( sql / gz / bz2 / zip ) or all sql files in one file ( gz / bz2 / zip ) from here:

http://evedump.icyone.net/

Latest: http://evedump.icyone.net/retribution-1.0.7-463858/


As soon as I notice a new export release I will try to keep this updated.
Ewo Deveraux
Care Bear Stare IP
#2 - 2012-04-13 04:07:30 UTC
Hmm, broken links?
Icy One
The Executives
#3 - 2012-04-15 16:47:42 UTC
Just checked and they work...
Icy One
The Executives
#4 - 2012-04-29 23:22:16 UTC
Updated for Escalation.
Icy One
The Executives
#5 - 2012-05-25 14:37:05 UTC
Updated for Inferno.
Leopold Jakuard
State Of Unrest
#6 - 2012-06-09 23:43:57 UTC
Thanks for sharing.
sephlaire
Federal Navy Academy
Gallente Federation
#7 - 2012-08-11 01:42:54 UTC
Are you still keeping this up to date?
Darrien Hawkins
Doomheim
#8 - 2012-08-11 05:15:54 UTC  |  Edited by: Darrien Hawkins
sephlaire wrote:
Are you still keeping this up to date?


I'm not sure of the status of the dump in the OP, but I was looking for these today and found: http://www.fuzzwork.co.uk/ (props to Steve Ronuken and his corp)

In the bottom right corner click the "DIR" link which will bring you to a list of files; he has done a dump of Inferno 1.2, so it is completely up-to-date. You can also use the CSV file on the main page, which will give you all of the item type_ids in a more readable format.
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#9 - 2012-08-11 15:58:00 UTC
Darrien Hawkins wrote:
sephlaire wrote:
Are you still keeping this up to date?


I'm not sure of the status of the dump in the OP, but I was looking for these today and found: http://www.fuzzwork.co.uk/ (props to Steve Ronuken and his corp)

In the bottom right corner click the "DIR" link which will bring you to a list of files; he has done a dump of Inferno 1.2, so it is completely up-to-date. You can also use the CSV file on the main page, which will give you all of the item type_ids in a more readable format.



Oops. I knew I'd forgotten something. typeids.csv is now up to date with 1.2

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Icy One
The Executives
#10 - 2012-08-25 19:57:20 UTC
Updated for Inferno 1.2 (and 1.1 for anyone that wants the previous version).

Have been a little inactive over the past month or so and missed these two.
Sharpey Lafisques
The Scope
Gallente Federation
#11 - 2012-11-07 11:17:36 UTC  |  Edited by: Sharpey Lafisques
I have been trying to load the latest SDD for a couple of days now...

I am using Heidi to process the files and from what I can tell, across several sources of mysql files, there are different table counts and where tablenames match, there are differing row counts.

Trying Fuzzworks file atm and Heidi seems to hang but it appears to be processing in the background because when I do a refresh in phpMyAdmin, there are fluctuating rowcounts for the whole db. I am interested to know why there seems to be no evelocations table in the Fuzzworks file? Is this table now deprecated or something?

Any pointers would be appreciated, thanks.
Evrus
#12 - 2012-12-12 07:24:35 UTC
Dear Icy One.

Please make trnTranslations with normal encode for column 'text'.

Reference:
http://wiki.eve-id.net/Talk:CCP_Static_Data_Dump

Sorry for my English and thank you very much.



Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#13 - 2012-12-12 15:32:43 UTC
Evrus wrote:
Dear Icy One.

Please make trnTranslations with normal encode for column 'text'.

Reference:
http://wiki.eve-id.net/Talk:CCP_Static_Data_Dump

Sorry for my English and thank you very much.





Try: http://www.fuzzwork.co.uk/dump/retribution-1.0.2-82708/trnTranslations.sql.bz2

It /should/ be utf8 encoded, which should work with pretty much any language/character set.

I'd suggest doing it into a different database to see if it meets your needs first, of course.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Evrus
#14 - 2012-12-13 06:01:00 UTC  |  Edited by: Evrus
Hi Steve, and sorry for my English.

Another failure :(

Something wrong with the column 'text' .

I will provide two screenshots.
On the first screenshot dump is from my DB. The source was yours. Unfortunately I can not find url and version of the database (it seems Crucible or Inferno).

My dump http://img.sc/img/4f239ffce789230efed5d8ba3771874d.png
As You see Japan and China looks good, like a Russian (that I need).

Second sreenshot:
http://img.sc/img/ca46934c0456f1f75402d3490c9b9f54.png

That's the problem. looks as if the column is encoded in cp1251 or similar.
Maybe problem in utf8_general_ci?

All the same, thank you very much for taking the time for me.
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#15 - 2012-12-13 11:10:33 UTC
Evrus wrote:
Hi Steve, and sorry for my English.

Another failure :(

Something wrong with the column 'text' .

I will provide two screenshots.
On the first screenshot dump is from my DB. The source was yours. Unfortunately I can not find url and version of the database (it seems Crucible or Inferno).

My dump http://img.sc/img/4f239ffce789230efed5d8ba3771874d.png
As You see Japan and China looks good, like a Russian (that I need).

Second sreenshot:
http://img.sc/img/ca46934c0456f1f75402d3490c9b9f54.png

That's the problem. looks as if the column is encoded in cp1251 or similar.
Maybe problem in utf8_general_ci?

All the same, thank you very much for taking the time for me.



I've just checked it in my copy (imported from that file) and it looks right. ( Многие люди Khanid хотят, чтобы их солдаты оставались конкурентоспособными, но единственным способом достичь этого в современном мире является массовое совершенствование тела. Обширные познания в киберимплантатах, которыми обладают Amarr, оказались крайне полезными в данном отношении. Некоторые Khanid все еще стараются достичь совершенства в бою путем физического развития, в то время как сторонники прогресса пытаются стать специалистами по современным приёмам ведения войны)

I suspect the issue is the encoding in your text editor. if you force it to utf8, rather than ansi as utf8 it should work fine.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Evrus
#16 - 2012-12-13 11:45:57 UTC  |  Edited by: Evrus
Steve Ronuken wrote:
Evrus wrote:
Hi Steve, and sorry for my English.

Another failure :(

Something wrong with the column 'text' .

I will provide two screenshots.
On the first screenshot dump is from my DB. The source was yours. Unfortunately I can not find url and version of the database (it seems Crucible or Inferno).

My dump http://img.sc/img/4f239ffce789230efed5d8ba3771874d.png
As You see Japan and China looks good, like a Russian (that I need).

Second sreenshot:
http://img.sc/img/ca46934c0456f1f75402d3490c9b9f54.png

That's the problem. looks as if the column is encoded in cp1251 or similar.
Maybe problem in utf8_general_ci?

All the same, thank you very much for taking the time for me.



I've just checked it in my copy (imported from that file) and it looks right. ( Многие люди Khanid хотят, чтобы их солдаты оставались конкурентоспособными, но единственным способом достичь этого в современном мире является массовое совершенствование тела. Обширные познания в киберимплантатах, которыми обладают Amarr, оказались крайне полезными в данном отношении. Некоторые Khanid все еще стараются достичь совершенства в бою путем физического развития, в то время как сторонники прогресса пытаются стать специалистами по современным приёмам ведения войны)

I suspect the issue is the encoding in your text editor. if you force it to utf8, rather than ansi as utf8 it should work fine.

In MySQL admin tool:

Screenshot: http://img.sc/img/99f5cc1b08f8a88661cc8bd061cef391.png Cry

and from terminal same result.
Evrus
#17 - 2012-12-14 04:44:33 UTC  |  Edited by: Evrus
We test your dump in three different machine (two windows and one ubuntu) and one terminal (Debian).
What kind of soft do you use?

Sorry for my English.
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#18 - 2012-12-14 11:19:51 UTC
I'm using a centos 6 server.

Table creation sql is:
CREATE TABLE `trnTranslations` (
`tcID` smallint(6) NOT NULL,
`keyID` int(11) NOT NULL,
`languageID` varchar(50) NOT NULL,
`text` text,
PRIMARY KEY (`tcID`,`keyID`,`languageID`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8


If you're not seeing the 'CHARSET=utf8' when you do an show create table trnTranslations, that might explain it. Otherwise, I'm pretty much stumped.

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter

Evrus
#19 - 2012-12-14 12:53:22 UTC
i all done. Thank you very much.