These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Help Restoring the Rubicon database
Author
Previous Topic Next Topic
Gizznitt Malikite
Agony Unleashed
Agony Empire
#1 - 2013-11-29 00:26:02 UTC

I'm fairly newbian in regards to using SQL Server, and have relied on tutorials to install the EvE database in the past. I've had previous success loading the EvE data dump into a database and communicating (using VBA) with it to import blueprint construction information into Excel. However, I'm stumped on how to import the current "data dump" for rubicon 1.0 93082.

Previously:

Using MS SQL Server 2012 on Windows 7 Enterprise SP1 (64 bit)
Open SQL & Connect to SQL Server.
Right click on "Databases" and "Restore Database".
A wizard pops up, with the General "page" open.
Choose Device, select file and point it toward the "DatadumpXXXXXXX.bak" file.

The file is read, the database "ebs_DATADUMP" is loaded,
I can then name the database to be restored, the restore file is auto-checked, and hitting "OK" creates & loads the database.
Shortly thereafter, I can query to my hearts content.

I've done the above successfully with the Datadump201309081118.bak file for pre-Rubicon information.

Unfortunately, the new datadump doesn't seem to work like this. When I point to the Rubicon DATADUMP201311141511.bak file, no "ebs_Datadump" database is found/loaded, thereby no-longer letting me "restore" the database.

How do I "restore" the rubicon datadump file (which is about 1/4th the size, btw) to create an up-to-date database?
Rob Crowley
State War Academy
#2 - 2013-11-29 07:12:03 UTC
As far as I'm aware nothing important has changed, so the way you describe should still work for the Rubicon data and it does work for me. Filesize sounds about right too. Do you get any error messages?
Hel O'Ween
Men On A Mission
#3 - 2013-11-29 11:04:12 UTC
As Rob said: nothing has changed from previous SDDs. Have you verified the archives integrity after downloading it? Just to kame sure your download didn't go south ...

If in doubt, clear your browser's cache and download it again.

EVEWalletAware - an offline wallet manager.
Steve Ronuken
Fuzzwork Enterprises
Vote Steve Ronuken for CSM
#4 - 2013-11-29 13:20:23 UTC
extracted Rubicon DB should be around 128,928 KB

I get an md5 of 10a533dc0f90f7d21b82dba52c03d55d for the .bak file, using winmd5free

Woo! CSM XI!

Fuzzwork Enterprises

Twitter: @fuzzysteve on Twitter
Gizznitt Malikite
Agony Unleashed
Agony Empire
#5 - 2013-11-30 16:50:28 UTC
Steve Ronuken wrote:
extracted Rubicon DB should be around 128,928 KB

I get an md5 of 10a533dc0f90f7d21b82dba52c03d55d for the .bak file, using winmd5free


I ran a checksum, and get the same md5.

I noticed they said the datadump is now MS SQL Server 2012 instead of 2008. Is it possible there's some setting somewhere that specifies I'm looking fro MS SQL 2008 DB's instead of 2012?

I'm using MS SQL Server 2012 withthe following components:
Microsoft SQL Server Management Studio 11.0.3000.0
Microsoft Data Access Components (MDAC) 6.1.7601.17514
Microsoft MSXML 3.0 4.0 6.0
Microsoft Internet Explorer 9.0.8112.16421
Microsoft .NET Framework 4.0.30319.1008
Operating System 6.1.7601
Rob Crowley
State War Academy
#6 - 2013-11-30 21:09:30 UTC
I have almost the same setup, only slightly newer MSSQL and .Net versions, but that should be negligible I would guess. Here are the differences:
Microsoft SQL Server Management Studio 11.0.3128.0
Microsoft Analysis Services Client Tools 11.0.3128.0
Microsoft .NET Framework 4.0.30319.18052

So you can add the .bak file, right? In the "Select backup devices" dialog can you check out "Contents" when selecting the added file? It shows basically a preview of the contained backup metadata for me.

Also have you tried the new 1.0.4 SDE?
Gizznitt Malikite
Agony Unleashed
Agony Empire
#7 - 2013-11-30 21:43:16 UTC
Rob Crowley wrote:
I have almost the same setup, only slightly newer MSSQL and .Net versions, but that should be negligible I would guess. Here are the differences:
Microsoft SQL Server Management Studio 11.0.3128.0
Microsoft Analysis Services Client Tools 11.0.3128.0
Microsoft .NET Framework 4.0.30319.18052

So you can add the .bak file, right? In the "Select backup devices" dialog can you check out "Contents" when selecting the added file? It shows basically a preview of the contained backup metadata for me.

Also have you tried the new 1.0.4 SDE?


I believe so...

There has only been one previous datadump I've done this with:

The DATADUMP201309021118.bak file works. When I'm working with this "older" file, this is my results:
Choose device, select the file, add the file, and hit ok. The file is then read, and the info below pops up:
Below the device choice, it autopopulates the Database field with ebs_DATADUMP
Under Destination: It auto-selects ebs_DATADUMP, which I can change to create this database under a more descriptive name.
The Restore to field is auto-filled with "The latest Backup taken (Monday, Sept 2, 2013 at 11:19:42 AM). "
The Restore plan, backup sets to restore, has a checkmarked box with a full list of backup information.

If I attempt this with the current datadump file (DATADUMP201311141511.bak) nothing gets "autopopulated." No database is found.

Interesting... I see what you mean by "contents" (you can view the contents of the file when you select it).

When I try this with my older Datadump, It gives the same information that appears in the Restore Plan.

When I attempt this with the current datadump, I get the following Error message:

"Object cannot be cast from DBNull to other types. (mscorlib)"

Hitting ok on this error completely closes or exits the restore database window.

This gives me a starting point to continue looking for solutions... thank you!


Rob Crowley
State War Academy
#8 - 2013-11-30 23:44:53 UTC
Gizznitt Malikite wrote:
the current datadump file (DATADUMP201311141511.bak)
The current Rubicon 1.0.4 SDE available since yesterday is called DATADUMP201311291354.bak. I guess it's not likely to solve your problem, but might as well use the latest data.

Quote:
When I attempt this with the current datadump, I get the following Error message:

"Object cannot be cast from DBNull to other types. (mscorlib)"
Quick search says this might get fixed by running the SQL Server Management Studio (SSMS.exe) with admin rights or by repairing/reinstalling MSSQL.
Gizznitt Malikite
Agony Unleashed
Agony Empire
#9 - 2013-12-02 22:40:04 UTC

I have nothing so far...

I've attempted running MS SQL Server Management Studio as admin... no change.
I've repair'ed the MS Sql Server with no change.

I've just tried a Restore VerifyOnly command, and get the following error:
Msg 3241, Level 16, State 13, Line 1
The media family on device 'D:\EvE\DB\Rubicon_1.0.4_93577_db\DATADUMP201311291354.bak' is incorrectly formed. SQL Server cannot process this media family.

If I attempted the Restore VerifiyOnly command on my Nov 2, 2013 Datadump file, it tells me the file is valid.

My checksum on theRubicon_1.0.4_93577_db file DATADUMP201311291354.bak is:
81c6139a34b4fa03607120cea2f540bb

I really am at a loss for solving this... The most common error seems to be incompatible versions of MS SQL. I noticed my version numbers are still slightly different, and wonder if that's the cause.
Gizznitt Malikite
Agony Unleashed
Agony Empire
#10 - 2013-12-03 22:03:18 UTC

I tried to apply a hot-fix, but it didn't seem to alter my SQL version number. I then completely uninstalled all MS SQL Server components and did a complete reinstall.

I can now read & restore the rubicon databases. I could be wrong, but I believe the issue was my Server Management Studio version. It is now 11.0.3128.0. (That, or else I needed to have the Microsoft Analysis Services Client Tools 11.0.3128.0 installed).

My current versions that work.
Microsoft SQL Server Management Studio 11.0.3128.0
Microsoft Analysis Services Client Tools 11.0.3128.0
Microsoft Data Access Components (MDAC) 6.1.7601.17514
Microsoft MSXML 3.0 4.0 6.0
Microsoft Internet Explorer 9.10.9200.16736
Microsoft .NET Framework 4.0.30319.18408
Operating System 6.1.7601


Thank you for your help,

/thread.
Hel O'Ween
Men On A Mission
#11 - 2013-12-04 17:05:14 UTC
I don't hink the SMS is the problem, I'm still using the 2008 version along with SQL Server Express 2012 and have no problem with restoring the dump.

Microsoft SQL Server Management Studio: 10.50.2500.0
Microsoft Analysis Services Client Tools: 10.50.2500.0
Microsoft Data Access Components (MDAC): 6.1.7601.17514
Microsoft MSXML: 3.0 4.0 6.0
Microsoft Internet Explorer: 9.10.9200.16736
Microsoft .NET Framework: 2.0.50727.5472
Operating System: 6.1.7601

EVEWalletAware - an offline wallet manager.
Gizznitt Malikite
Agony Unleashed
Agony Empire
#12 - 2013-12-04 17:57:44 UTC

I guess what caused the problem remains a mystery.
Elmore Jones
New Eden Mining Organisation
The Craftsmen
#13 - 2013-12-06 23:39:21 UTC
I tried getting this going this evening, but also no luck. Running RESTORE HEADERONLY FROM DISK = 'C:\Temp\dump.bak' on a copy of the db gave response

*** INCOMPLETE *** for back up name. position was 1 rest were NULL

Looks like CCP have a corrupt file there :(

+++ Reality Error 404 - Reboot Cosmos +++
Nnaem Kvorr
Fleet-Up.com
Keep It Simple Software Group
#14 - 2013-12-07 08:44:53 UTC
Previous data dumps were SQL 2008 compatible. Rubicon data dump is 2012.

I know this because my test server was running 2008 and of course could not restore the rubicon db.

Not sure this explains OP issue because you are already using 2012 but I just wanted to state the above in case it helps.

Fleet-Up.com - Your fleet operations, on steroids.
Elmore Jones
New Eden Mining Organisation
The Craftsmen
#15 - 2013-12-07 11:37:55 UTC
Yeah I know bud, thanks for the reminder though. I'm using mssql express 2012 my end. The call I posted above was actually to return the db version to check my install wasn't still pointing to some old code and therefore causing my problem :)

+++ Reality Error 404 - Reboot Cosmos +++
Gizznitt Malikite
Agony Unleashed
Agony Empire
#16 - 2013-12-07 12:50:03 UTC
Elmore Jones wrote:
I tried getting this going this evening, but also no luck. Running RESTORE HEADERONLY FROM DISK = 'C:\Temp\dump.bak' on a copy of the db gave response

*** INCOMPLETE *** for back up name. position was 1 rest were NULL

Looks like CCP have a corrupt file there :(


I don't think it is a corrupt database issue. I had the same checksum as others that were successfully communicating with it, and the most common reason for the "Object cannot be cast from DBNull to other types. (mscorlib)" error seemed to be incompatible versions. I attempted repair-fixes and applied hotfixes to attempt to bring my SQL Server as up-to-date as possible to no success.

In the end, I uninstalled every component of MS SQL Server 2008 & 2012 from my comp, rebooted, and installed a fresh copy of the SQL Server. Then everything started working.

Elmore Jones
New Eden Mining Organisation
The Craftsmen
#17 - 2013-12-07 13:09:37 UTC  |  Edited by: Elmore Jones
Ok thanks will try that

EDIT : lovely, that did the job

+++ Reality Error 404 - Reboot Cosmos +++