These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

zKillboard.com

First post
Author
Previous Topic Next Topic
Karbowiak
Sacred Templars
Fraternity.
#321 - 2013-11-26 00:50:32 UTC
We did an upgrade today, moving zKillboard from our VM where EVE-KILL is also running, to a new VM, where yours truly, spent a couple of hours setting up HHVM and NGINX, including SSL and whatnots.

The end result was a few bugs that had to be fixed, and a vastly faster and more responsive zKillboard

Avg. load time on the frontpage went from 35-40ms to 10-15ms, on a 500 man supercap mail it went from ~1000ms to below 100ms etc. etc.

So enjoy :)
Karbowiak
Sacred Templars
Fraternity.
#322 - 2013-12-10 21:24:55 UTC
Bumpetybump

Might aswell keep this alive!
Squizz Caphinator
The Wormhole Police
#323 - 2013-12-18 16:05:37 UTC
And just to keep everyone updated on what I'm doing - I'm currently evaluating ways to reduce the size of the database. I just removed a 22 gig table and replaced it with a 1 gig table. I'm also looking into how to reduce the size of a 100+ gig table to possibly 30 gigs.

You might think that space is cheap, blah blah blah. Well, when you run on SSD drives space is premium. Also, the smaller the tables the less memory they require and the faster the site runs overall.

More updates coming!

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
imbaRabbit
Caldari Provisions
Caldari State
#324 - 2013-12-18 17:19:06 UTC
Squizz Caphinator wrote:
And just to keep everyone updated on what I'm doing - I'm currently evaluating ways to reduce the size of the database. I just removed a 22 gig table and replaced it with a 1 gig table. I'm also looking into how to reduce the size of a 100+ gig table to possibly 30 gigs.


Would be awesome to know what you have done and how did you reduce 22 GB to just 1 GB? Is it possible to get some details about that (private | public - doesn't matter)?
Karbowiak
Sacred Templars
Fraternity.
#325 - 2013-12-19 14:45:42 UTC
imbaRabbit wrote:
Squizz Caphinator wrote:
And just to keep everyone updated on what I'm doing - I'm currently evaluating ways to reduce the size of the database. I just removed a 22 gig table and replaced it with a 1 gig table. I'm also looking into how to reduce the size of a 100+ gig table to possibly 30 gigs.


Would be awesome to know what you have done and how did you reduce 22 GB to just 1 GB? Is it possible to get some details about that (private | public - doesn't matter)?


He removed the zz_items table, and used the item data already stored in the raw json files that we store.

As for the big table, it's just indexes that'll be removed, maybe a row or two of data that isn't used that much. :)
Squizz Caphinator
The Wormhole Police
#326 - 2013-12-19 16:06:31 UTC
Karbowiak wrote:

He removed the zz_items table, and used the item data already stored in the raw json files that we store.


You're half right. I remapped the items data into daily values and integrated the data from each particular kill's JSON.

Karbowiak wrote:

As for the big table, it's just indexes that'll be removed, maybe a row or two of data that isn't used that much. :)


No indexes are going to be removed - that would make some things worse. I am looking at columns that can be removed and the information can be used pulled from JSON. I might also rework indexes entirely - while keeping the existing indexes. Or I might do something else, I have a few options to look at that may be useful.

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Brain Gehirn
Macabre Votum
Northern Coalition.
#327 - 2013-12-20 04:15:12 UTC  |  Edited by: Brain Gehirn
Im missing the "all time" top history from players/corps
Its interesting to have it montly but add the option to see the "all time" too!


Edit: Ranks arent updating too.
Squizz Caphinator
The Wormhole Police
#328 - 2013-12-20 14:56:14 UTC
Brain Gehirn wrote:
Im missing the "all time" top history from players/corps
Its interesting to have it montly but add the option to see the "all time" too!


Edit: Ranks arent updating too.


You aren't missing all time, it was removed and monthly put into place. All time put a bit of strain on the db and I'm currently looking into efficient ways to present that properly.

Ranks *are* updating. What makes you think they're not?

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Brain Gehirn
Macabre Votum
Northern Coalition.
#329 - 2013-12-20 18:40:20 UTC
Alltime and recent rank - at least for my char - are static for some days now!


Its not important but I took the topic to comment
Reilleen Kawahara Haginen
Doomheim
#330 - 2013-12-21 10:53:50 UTC
I'm sure this may have been asked before but cannot see it in the replies.

Is it possible to just display a certain corp or alliance or is it an all or nothing?

Thanks
Karbowiak
Sacred Templars
Fraternity.
#331 - 2013-12-21 11:55:30 UTC
Reilleen Kawahara Haginen wrote:
I'm sure this may have been asked before but cannot see it in the replies.

Is it possible to just display a certain corp or alliance or is it an all or nothing?

Thanks


You can use the tracker feature, to set it up to just your liking :)

zKB is pr. user for now, we'll add ability to share tracker settings via links later.
Reilleen Kawahara Haginen
Doomheim
#332 - 2013-12-21 13:37:34 UTC  |  Edited by: Reilleen Kawahara Haginen
Karbowiak wrote:
Reilleen Kawahara Haginen wrote:
I'm sure this may have been asked before but cannot see it in the replies.

Is it possible to just display a certain corp or alliance or is it an all or nothing?

Thanks


You can use the tracker feature, to set it up to just your liking :)

zKB is pr. user for now, we'll add ability to share tracker settings via links later.


Thanks for explaining, will wait until it can be set to one alliance "globally" before trying it.

A lot of alliance members are simply lazy "in general" when it comes to stuff like this so the ability to setup like EKB will be great.

Edit: The readme file says you need root access so will there be an option to install via a cpanel "ftp files and create Db" etc.?
Karbowiak
Sacred Templars
Fraternity.
#333 - 2013-12-22 15:54:20 UTC
Reilleen Kawahara Haginen wrote:
Karbowiak wrote:
Reilleen Kawahara Haginen wrote:
I'm sure this may have been asked before but cannot see it in the replies.

Is it possible to just display a certain corp or alliance or is it an all or nothing?

Thanks


You can use the tracker feature, to set it up to just your liking :)

zKB is pr. user for now, we'll add ability to share tracker settings via links later.


Thanks for explaining, will wait until it can be set to one alliance "globally" before trying it.

A lot of alliance members are simply lazy "in general" when it comes to stuff like this so the ability to setup like EKB will be great.

Edit: The readme file says you need root access so will there be an option to install via a cpanel "ftp files and create Db" etc.?


Chances are that the global thing won't happen, atleast not if i have it they way i want it. Squizz might still veto me on it Ugh

Installation wise, you can skip over the stuff with setting up symlinks to the cli and such. You can do the install itself without running the installer in a cli aswell, but it's more complicated, and involves piecing the config together yourself, from config.new.php, and importing all the database tables and such. Not IMPOSSIBLE, but not ~easy~ either Smile
Squizz Caphinator
The Wormhole Police
#334 - 2013-12-23 13:04:22 UTC
Brain Gehirn wrote:
Alltime and recent rank - at least for my char - are static for some days now!


Its not important but I took the topic to comment


Hrm, I'll check into it

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Karbowiak
Sacred Templars
Fraternity.
#335 - 2014-01-17 00:21:07 UTC
bumplelump
Herzog Wolfhammer
Sigma Special Tactics Group
#336 - 2014-01-17 20:31:41 UTC  |  Edited by: Herzog Wolfhammer
Squizz Caphinator wrote:
zKillboard is a new approach by EveKill to killboards using fresh ideas and modern technologies. It's different, but it's a good different. The developers are Karbowiak and Squizz Caphinator, with insight and directions from many others.

Please keep in mind zKB is currently beta and there are lots of things to be done yet.

Issues:
- No campaigns yet.
- Other various minor things which you may or may not notice :)

zKillboard is open source and can be found here:

https://github.com/EVE-KILL/zKillboard

Please feel free to give your constructive feedback.

API Documentation: http://zkillboard.com/information/api/



Outstanding! I saw it here


And it's open source - you guys kick the ass. Even DUSTbunny kills show up if a capsuleer did it.

Bring back DEEEEP Space!
Herzog Wolfhammer
Sigma Special Tactics Group
#337 - 2014-01-18 00:45:42 UTC
Ok one slight problem with zkillboard.com - I looked up a loss from 2008 and one of the modules is listed as "Rapid Light Missile Launcher".

I don't recall the time travel. Lol

Bring back DEEEEP Space!
Karbowiak
Sacred Templars
Fraternity.
#338 - 2014-01-19 08:53:51 UTC
Herzog Wolfhammer wrote:
Squizz Caphinator wrote:
zKillboard is a new approach by EveKill to killboards using fresh ideas and modern technologies. It's different, but it's a good different. The developers are Karbowiak and Squizz Caphinator, with insight and directions from many others.

Please keep in mind zKB is currently beta and there are lots of things to be done yet.

Issues:
- No campaigns yet.
- Other various minor things which you may or may not notice :)

zKillboard is open source and can be found here:

https://github.com/EVE-KILL/zKillboard

Please feel free to give your constructive feedback.

API Documentation: http://zkillboard.com/information/api/



Outstanding! I saw it here


And it's open source - you guys kick the ass. Even DUSTbunny kills show up if a capsuleer did it.



Herzog Wolfhammer wrote:
Ok one slight problem with zkillboard.com - I looked up a loss from 2008 and one of the modules is listed as "Rapid Light Missile Launcher".

I don't recall the time travel. Lol


Thanks for the kind words, and yes, it is indeed open source, under aGPLv3 however, which was picked to make sure that any and all changes made to it, would be available to everyone in the EVE community.
As for the DUST integration, yes, we plan on extending it once CREST comes out, and if it has more stats for battles where DUST players participate. So, lets hope! :)

In regards to the time machine, it works by IDs, a major part of the mails was moved over from EVE-KILL, and we used ID translation as much as possible, which led to modules that were called something else back then, were updated to the new names today :)

But if it's a manual mail with a bogus item that didn't exist back then, feel free to report it as false, and it'll get deleted :)
Karbowiak
Sacred Templars
Fraternity.
#339 - 2014-01-21 19:01:46 UTC
Yesterday Peter Powers introduced us to Scrutinize-ci, a service that looks through the source code, finds errors, bugs, proposes fixes and what have you.

We added zKillboard to it, expecting it to be extremely bad, because we're sloppy with comments, but were somewhat supriced to see we were in the middle of the pack.

But we wan't to hit above 9 on the score, instead of the ~5.5 we get now.
So over the next few days / weeks / months / years you'll see our documentation issue getting solved, a lot of bugs getting squashed and the board maybe / hopefully running a little faster as a thanks to it.

At the same time, we're just waiting for HHVM to release version 2.4, with a lot of fastcgi fixes, so we can finally switch back to it full time, and get those delightfully lovely high speeds that we got used to with our brief time running it! Big smile

As always our git repo is at https://github.com/EVE-KILL/zKillboard and you are all more than welcome to pitch in.
The Scrutinize site is here https://scrutinizer-ci.com/g/EVE-KILL/zKillboard/ and it also lists all the bugs/errors/whathaveyous that we have in zKB.
Arch Stanton's Neighbour
Forceful Resource Acquisition Inc
#340 - 2014-01-27 01:47:06 UTC  |  Edited by: Arch Stanton's Neighbour
i found an issue with the code: it's written in php, do you plan to fix that?

PHP: A fractal of bad design

http://www.reddit.com/r/lolphp