These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

zKillboard.com

First post
Author
Previous Topic Next Topic
Bildz0r
Viziam
Amarr Empire
#261 - 2013-06-11 08:24:37 UTC  |  Edited by: Bildz0r
Site seems to be down for me.
Quote:
500 - Internal Server Error


Edit: Seems to be working again now.
Karbowiak
Sacred Templars
Fraternity.
#262 - 2013-06-12 13:24:09 UTC
Bildz0r wrote:
Site seems to be down for me.
Quote:
500 - Internal Server Error


Edit: Seems to be working again now.


It goes down from time to time, for unknown reasons.

Mostly during backup times tho, we hope that we can fix that with some database modifications, but we're pretty restricted in how much we can do atm, so it'll have to wait till be go ahead and launch zKB officially Smile
Squizz Caphinator
The Wormhole Police
#263 - 2013-06-13 14:05:31 UTC
It also seems the Top 10 page was severely raping our database for regions, ship types, etc. I've temporarily disabled the Top 10 pages while I come up with a better solution.

This has already improved the overall speed of the site.

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Kristoffon Ellecon
The Scope
Gallente Federation
#264 - 2013-06-20 16:15:18 UTC
Squizz Caphinator wrote:
It also seems the Top 10 page was severely raping our database for regions, ship types, etc. I've temporarily disabled the Top 10 pages while I come up with a better solution.

This has already improved the overall speed of the site.

Congrats on the awesome work you've been doing, do allow me to suggest putting a message to that effect on the top 10 page because right now it just comes up empty and I reload the page 2 or 3 times until I figure out it's not a connectivity issue or whatever.
Medusa The Gorgon
Temple of the Serpent
The Gorgon Empire
#265 - 2013-06-25 10:51:21 UTC
Is it possible to fetch killmails my timestamp they are posted to killboard database?
According to api page I see no way to create normal feed that is not hammering zKillboard server or mine to process data with overhead. The idea is not to use pages or count killmails or request lastseconds with already posted stuff. I have feed from custom killboard with this principle, it works very nice.
Squizz Caphinator
The Wormhole Police
#266 - 2013-06-26 12:52:51 UTC  |  Edited by: Squizz Caphinator
Medusa The Gorgon wrote:
Is it possible to fetch killmails my timestamp they are posted to killboard database?
According to api page I see no way to create normal feed that is not hammering zKillboard server or mine to process data with overhead. The idea is not to use pages or count killmails or request lastseconds with already posted stuff. I have feed from custom killboard with this principle, it works very nice.


Yes, it is possible. But no, we aren't doing it at this time. Why? Such a query would require a join between two tables that are tens of millions of rows, each. The code within zKB is designed in such a way to avoid joins as much as possible. Joins are what almost killed Eve-Kill before we implemented split tables, and these same joins are still trying to kill Eve-Kill even with the split tables.

Please note I did say "at this time". This might happen in the future as we discover better ways to do things and better database engines to work with that can handle the sheer size of our tables and the types of queries we throw at them.

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
SmallFatCat
The Fifth Ace
#267 - 2013-06-27 19:29:28 UTC
The documentation says JSONP is available but untested, but I can't find a format modifier for JSONP. Is this not working or am I being dumb?

I am trying to query the api using jquery, currently getting round the JSONP problem by using YQL but they have a 1.5MB limit which the api queries often exceed.

Thanks
Karbowiak
Sacred Templars
Fraternity.
#268 - 2013-06-27 21:46:51 UTC
SmallFatCat wrote:
The documentation says JSONP is available but untested, but I can't find a format modifier for JSONP. Is this not working or am I being dumb?

I am trying to query the api using jquery, currently getting round the JSONP problem by using YQL but they have a 1.5MB limit which the api queries often exceed.

Thanks


The JSONP should just work if you pass js stuff along with it, as you normally do with JSONP, but yeah, i have no idea.
Afaik you can just use regular JSON requests, since we allow cross site access with any request (even XML) Smile
SmallFatCat
The Fifth Ace
#269 - 2013-06-28 00:33:20 UTC
Karbowiak wrote:
SmallFatCat wrote:
The documentation says JSONP is available but untested, but I can't find a format modifier for JSONP. Is this not working or am I being dumb?

I am trying to query the api using jquery, currently getting round the JSONP problem by using YQL but they have a 1.5MB limit which the api queries often exceed.

Thanks


The JSONP should just work if you pass js stuff along with it, as you normally do with JSONP, but yeah, i have no idea.
Afaik you can just use regular JSON requests, since we allow cross site access with any request (even XML) Smile


Thankyou, I was being dumb. It works great now I realised my mistake. :)
Karbowiak
Sacred Templars
Fraternity.
#270 - 2013-06-28 22:55:27 UTC
So, i got bored today, and this is usually how everything bad starts.

So i decided to implement jabber, and that has now been done.
Everyone with an account on zKillboard is welcome to use it, information is as follows.

server: jabber.eve-kill.net
port: 5222
username: your zkillboard username
password: your zkillboard password

You can also just logout and login to zKillboard to get the new key set properly for it to login.

There isn't much going on on the server yet, but i have plans of adding stuff to the main channel called esc, such as bots and whatnot.

If you want to use it for your corp or alliance, go for it. I might be able to implement some sort of mass broadcast system, that only does it for YOUR group Smile

We'll see. Cool
Karbowiak
Sacred Templars
Fraternity.
#271 - 2013-06-29 23:52:04 UTC  |  Edited by: Karbowiak
Small changes to jabber.

First up, the server address has changed.

New address: eve-kill.net (Incase your client doesn't understand the srv dns, and refuses to connect, use jabber.eve-kill.net)
Port, username and password is the same.

Also, once you're logged in, go and input your API key, and wait till it lists characters under Me (My API Characters). Then click on Comms Setup, and select which character you want to use on Jabber.

~5 minutes later it'll have added you to the correct groups based on the character you select.
After that all you have to do is relog to jabber, and you'll be visible in the new groups Smile

There is still a lot of work to do, such as adding the ability for director/ceo's to send out pings to their group(s), and i still have to add the ESCBot, with various commands.
But the most important bits now work, enjoy it!

Next up, mumble Lol
Bildz0r
Viziam
Amarr Empire
#272 - 2013-07-01 08:15:17 UTC
Karbowiak wrote:
Bildz0r wrote:
Site seems to be down for me.
Quote:
500 - Internal Server Error


Edit: Seems to be working again now.


It goes down from time to time, for unknown reasons.

Mostly during backup times tho, we hope that we can fix that with some database modifications, but we're pretty restricted in how much we can do atm, so it'll have to wait till be go ahead and launch zKB officially Smile

Seems to be down consistently around this time. Is this when you run your backups?
Mostly have time to play around with it around this time of the day but alas it should not be :(
Karbowiak
Sacred Templars
Fraternity.
#273 - 2013-07-01 16:28:10 UTC
Bildz0r wrote:
Karbowiak wrote:
Bildz0r wrote:
Site seems to be down for me.
Quote:
500 - Internal Server Error


Edit: Seems to be working again now.


It goes down from time to time, for unknown reasons.

Mostly during backup times tho, we hope that we can fix that with some database modifications, but we're pretty restricted in how much we can do atm, so it'll have to wait till be go ahead and launch zKB officially Smile

Seems to be down consistently around this time. Is this when you run your backups?
Mostly have time to play around with it around this time of the day but alas it should not be :(


Might very well be that the backup occurs at that time, i'll see if i can't find where it's hiding, and change it to happen a little later P
Karbowiak
Sacred Templars
Fraternity.
#274 - 2013-07-09 23:08:47 UTC
small bump to keep this from getting locked Cool
Ashnazg
The Tuskers
The Tuskers Co.
#275 - 2013-07-10 19:22:53 UTC
We've been using zkb as our main kb for some months now and it's still excellent.

One thing I'll never get my head around tho is the display of dropped & destroyed items on kill details. like red numbers = destroyed, red background = dropped? :logic: ?

Perhaps handle it similarly to eve-kill where green background is dropped and everything else is destroyed. Seems to me to be far more intuitive (especially bearing in mind that eve-kill is THE killboard used so far so it should be a goal to not implement useless changes compared to its layout)

good stuff, keep trucking!

Blog: [URL="http://www.ilikefalcons.wordpress.com"]White Knights and Manly Explosions[/URL]
Karbowiak
Sacred Templars
Fraternity.
#276 - 2013-07-11 18:58:25 UTC  |  Edited by: Karbowiak
Update to all of you who are using the zKB API.

We have altered the scrape checker to work differently, and added a few new headers and error pages.
Go read the documentation again.

but if you're really lazy, the new headers are: X-Time-Between-Req to see how many seconds you have to wait between requesting new data, and Retry-After, for when you hit one of those fabled 403 pages.

For now it's set to 1 second, to give you all time to adjust, but after the weekend, it will go up again. Now you're warned! Shocked

Ashnazg wrote:
We've been using zkb as our main kb for some months now and it's still excellent.

One thing I'll never get my head around tho is the display of dropped & destroyed items on kill details. like red numbers = destroyed, red background = dropped? :logic: ?

Perhaps handle it similarly to eve-kill where green background is dropped and everything else is destroyed. Seems to me to be far more intuitive (especially bearing in mind that eve-kill is THE killboard used so far so it should be a goal to not implement useless changes compared to its layout)

good stuff, keep trucking!


The overall look isn't nailed down yet, we're still looking for people who can do stuff on the templates, but it's rare to find people who will do this for free P
Ashnazg
The Tuskers
The Tuskers Co.
#277 - 2013-07-11 20:55:40 UTC
Karbowiak wrote:
The overall look isn't nailed down yet, we're still looking for people who can do stuff on the templates, but it's rare to find people who will do this for free P


If I wasnt utterly useless in that area I would gladly help you. :D

Blog: [URL="http://www.ilikefalcons.wordpress.com"]White Knights and Manly Explosions[/URL]
Karbowiak
Sacred Templars
Fraternity.
#278 - 2013-07-14 12:48:54 UTC
Ashnazg wrote:
Karbowiak wrote:
The overall look isn't nailed down yet, we're still looking for people who can do stuff on the templates, but it's rare to find people who will do this for free P


If I wasnt utterly useless in that area I would gladly help you. :D

Blink <3
jentaki
Hardcore Industries
#279 - 2013-07-22 02:07:36 UTC
Customizable rss feeds or something similar.
Sable Blitzmann
24th Imperial Crusade
Amarr Empire
#280 - 2013-07-24 04:07:54 UTC
You know what feature I've been hoping for from killboards? Custom 'related kills'. It'd be simple, really: Present a slider with a min/max time, so that users can customize the actual fleet fight without picking up JoeSchmo from an hour earlier. This can easily be given a unique URL as well to share. ;)