These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

zKillboard.com

First post
Author
Previous Topic Next Topic
Zaeran Jita
Doomheim
#461 - 2015-04-20 09:19:43 UTC  |  Edited by: Zaeran Jita
Hey,

Trying to do a pull via groovy, tried pulling directly to json via a jsonSlurper as well as just pulling raw text from the website.
Using the URL

"https://zkillboard.com/api/kills/shipID/23917,23913,22852,23919,11567,3764,23773,671/afterKillID/46098986/orderDirection/desc"

Returns the script a 406

Whereas visiting the URL via a browser results in a return as expected, any insight?


Edit - Seems this was caused due to not adding accept-encoding : Gzip to my header (Seriously couldn't find this in the docs, found this in a reddit post...) now I just get nothing returning, yay.
Brain Gehirn
Macabre Votum
Northern Coalition.
#462 - 2015-04-21 08:25:40 UTC  |  Edited by: Brain Gehirn
Error getting data:
HTTP 304, URL: https://zkillboard.com/api/corporationID/98221864/api-only/startTime/201307061931/orderDirection/asc/, Start time = 2013-07-06 21:31:00

- Trying to set up a new kb for some friends
- Worked for the first few attempts but its now stuck in this one - changing the date for some days ahead doesnt work either... but if I change it backwards it works for some reason


Edit: Looks like its more a fuckup from the fetcher than your side... but this is ******* him up for some reason
Squizz Caphinator
The Wormhole Police
#463 - 2015-04-21 20:07:51 UTC
Zaeran Jita wrote:
Hey,

Trying to do a pull via groovy, tried pulling directly to json via a jsonSlurper as well as just pulling raw text from the website.
Using the URL

"https://zkillboard.com/api/kills/shipID/23917,23913,22852,23919,11567,3764,23773,671/afterKillID/46098986/orderDirection/desc"

Returns the script a 406

Whereas visiting the URL via a browser results in a return as expected, any insight?


Edit - Seems this was caused due to not adding accept-encoding : Gzip to my header (Seriously couldn't find this in the docs, found this in a reddit post...) now I just get nothing returning, yay.


Correct, the 406 is a custom error code for the API. Believe it or not it knocked down a full terabyte of outgoing traffic per month when I implemented that. Sorry its missing from the doc, I'll get that fixed up.

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Squizz Caphinator
The Wormhole Police
#464 - 2015-04-21 20:09:52 UTC
Brain Gehirn wrote:
Error getting data:
HTTP 304, URL: https://zkillboard.com/api/corporationID/98221864/api-only/startTime/201307061931/orderDirection/asc/, Start time = 2013-07-06 21:31:00

- Trying to set up a new kb for some friends
- Worked for the first few attempts but its now stuck in this one - changing the date for some days ahead doesnt work either... but if I change it backwards it works for some reason


Edit: Looks like its more a fuckup from the fetcher than your side... but this is ******* him up for some reason


I really, really hate that I had to implement this and the reason: some folks were hitting the API with the same request every 15 seconds despite absolutely nothing changing in that 15 seconds. Yea, granted, nothing changed, but that's what the 304 is for.

Btw, 304 means use the cached version of your request, browsers understand this, but most CLI tools do not. It is up to the programmer to make their tool understand how to handle a 304 response code :)

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Svarii
Acclimatization
#465 - 2015-04-22 04:32:34 UTC
This link used to show all of the pods that I had killed. https://zkillboard.com/character/276758740/group/29/kills/

Now it does not. Had to have happened rather recently. What changed?

I like being able to look a long list of pirates I podded in highsec.

Deny Pirates the Use of Implants
Zaeran Jita
Doomheim
#466 - 2015-04-22 08:51:11 UTC
Squizz Caphinator wrote:
Zaeran Jita wrote:
Hey,

Trying to do a pull via groovy, tried pulling directly to json via a jsonSlurper as well as just pulling raw text from the website.
Using the URL

"https://zkillboard.com/api/kills/shipID/23917,23913,22852,23919,11567,3764,23773,671/afterKillID/46098986/orderDirection/desc"

Returns the script a 406

Whereas visiting the URL via a browser results in a return as expected, any insight?


Edit - Seems this was caused due to not adding accept-encoding : Gzip to my header (Seriously couldn't find this in the docs, found this in a reddit post...) now I just get nothing returning, yay.


Correct, the 406 is a custom error code for the API. Believe it or not it knocked down a full terabyte of outgoing traffic per month when I implemented that. Sorry its missing from the doc, I'll get that fixed up.


Cool :)

Next fun one -
Visit a fully formed URL in my browser and it will always display json as expected.
Connect to, and pull that content via groovy script and it ~sometimes~ have content, and once it starts returning nothing, i have to pull another webpage a few times before I can start getting content from the original again.

(*This is only the observed behaviour over a very brief period, 10 minutes before I went to bed, so I'll dig into it more tonight to confirm this is the scenario)
Brain Gehirn
Macabre Votum
Northern Coalition.
#467 - 2015-04-22 13:16:44 UTC
Squizz Caphinator wrote:
Brain Gehirn wrote:
Error getting data:
HTTP 304, URL: https://zkillboard.com/api/corporationID/98221864/api-only/startTime/201307061931/orderDirection/asc/, Start time = 2013-07-06 21:31:00

- Trying to set up a new kb for some friends
- Worked for the first few attempts but its now stuck in this one - changing the date for some days ahead doesnt work either... but if I change it backwards it works for some reason


Edit: Looks like its more a fuckup from the fetcher than your side... but this is ******* him up for some reason


I really, really hate that I had to implement this and the reason: some folks were hitting the API with the same request every 15 seconds despite absolutely nothing changing in that 15 seconds. Yea, granted, nothing changed, but that's what the 304 is for.

Btw, 304 means use the cached version of your request, browsers understand this, but most CLI tools do not. It is up to the programmer to make their tool understand how to handle a 304 response code :)



Yeah, it is not bad for you to have it tho.
I might try to fix the fetcher by myself but :effort:
Its the zkb fetcher from edk and he seen to act a bit strange as he keeps poking the same date/time for whatever reason.
Squizz Caphinator
The Wormhole Police
#468 - 2015-04-22 18:25:46 UTC
Svarii wrote:
This link used to show all of the pods that I had killed. https://zkillboard.com/character/276758740/group/29/kills/

Now it does not. Had to have happened rather recently. What changed?

I like being able to look a long list of pirates I podded in highsec.


I made some changes to the API the other day which I haven't documented yet (they aren't complete), when they are complete you will be able to drill down in a more intuitive manner (I hope).

To obtain the data you're looking for:

https://zkillboard.com/character/276758740/kills/victim/group/29/
In short, using your character's kill look for victims of the group 29

Please keep in mind these changes are ongoing and need a few more tweaks. Then the documentation will receive a full over haul.

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Squizz Caphinator
The Wormhole Police
#469 - 2015-04-22 18:27:39 UTC
Zaeran Jita wrote:


Cool :)

Next fun one -
Visit a fully formed URL in my browser and it will always display json as expected.
Connect to, and pull that content via groovy script and it ~sometimes~ have content, and once it starts returning nothing, i have to pull another webpage a few times before I can start getting content from the original again.

(*This is only the observed behaviour over a very brief period, 10 minutes before I went to bed, so I'll dig into it more tonight to confirm this is the scenario)


Without knowing the IP address the requests are coming from using the groovy script and checking my logs I can't really tell you what's going wrong here.

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Salvoxia
Free Carpenters Union
#470 - 2015-04-22 19:30:24 UTC
Brain Gehirn wrote:

Yeah, it is not bad for you to have it tho.
I might try to fix the fetcher by myself but :effort:
Its the zkb fetcher from edk and he seen to act a bit strange as he keeps poking the same date/time for whatever reason.



About that: The zKB API seems to behave strange itself.
Take the reply to this request:
https://zkillboard.com/api/corporationID/98221864/api-only/startTime/201307061931/orderDirection/asc/
This request should get a list of kills starting at 2013-07-06 19:31:00 and it should be sorted in ascending order.
But when looking at the actual output, the first kill is from 2013-06-27 06:34:00, which is BEFORE the start date. In fact, the last kill is from 2013-07-06 21:31:00, which, corrected for possible timezone differences/DST is exactly the start time.
So it seems starttime is confused with endTime by zKB.

Also, if the sorting modifier is left out completely, the startTime is ignored completely and kills from 2015 are returned.
https://zkillboard.com/api/corporationID/98221864/api-only/startTime/201307061931/

If I'm not missing something, there seems to be a problem on zKB's side?
Since the EDK zKB fetcher relies on the results getting returned in ascending order, sorted by timestamp, it somewhat misbehaves as well.
And granted, it isn't equipped to handle HTTP 304 as of yet.



Kind Regards,
Salvoxia
Squizz Caphinator
The Wormhole Police
#471 - 2015-04-22 19:51:58 UTC
Salvoxia wrote:
Brain Gehirn wrote:

Yeah, it is not bad for you to have it tho.
I might try to fix the fetcher by myself but :effort:
Its the zkb fetcher from edk and he seen to act a bit strange as he keeps poking the same date/time for whatever reason.



About that: The zKB API seems to behave strange itself.
Take the reply to this request:
https://zkillboard.com/api/corporationID/98221864/api-only/startTime/201307061931/orderDirection/asc/
This request should get a list of kills starting at 2013-07-06 19:31:00 and it should be sorted in ascending order.
But when looking at the actual output, the first kill is from 2013-06-27 06:34:00, which is BEFORE the start date. In fact, the last kill is from 2013-07-06 21:31:00, which, corrected for possible timezone differences/DST is exactly the start time.
So it seems starttime is confused with endTime by zKB.

Also, if the sorting modifier is left out completely, the startTime is ignored completely and kills from 2015 are returned.
https://zkillboard.com/api/corporationID/98221864/api-only/startTime/201307061931/

If I'm not missing something, there seems to be a problem on zKB's side?
Since the EDK zKB fetcher relies on the results getting returned in ascending order, sorted by timestamp, it somewhat misbehaves as well.
And granted, it isn't equipped to handle HTTP 304 as of yet.



Kind Regards,
Salvoxia


grumble grumble... both fixed, thanks for pointing them out

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Brain Gehirn
Macabre Votum
Northern Coalition.
#472 - 2015-04-23 02:12:12 UTC
Ohh awesome! Thanks a lot to both of you!
Joseph Emmagen
The Scope
Gallente Federation
#473 - 2015-05-07 21:41:12 UTC  |  Edited by: Joseph Emmagen
Hi,

It has been over a month since the monthly top lists and the stats for systems on the right side of the screen went away. Can you estimate how much longer until they are back?

Thanks!
Dwaigon Aumer
Hostile.
PURPLE HELMETED WARRIORS
#474 - 2015-05-12 10:04:08 UTC
Sadly trying to fetch kills by regioID doesn't work with the API :(
https://zkillboard.com/api/kills/regionID/10000016/

Minmatar FTW!!
Squizz Caphinator
The Wormhole Police
#475 - 2015-05-12 14:05:08 UTC
Joseph Emmagen wrote:
Hi,

It has been over a month since the monthly top lists and the stats for systems on the right side of the screen went away. Can you estimate how much longer until they are back?

Thanks!


There are a few things that need to be completed and corrected that have a higher priority than who's got top epeen in a system. It'll happen, its just not near the top of my list atm :)

Dwaigon Aumer wrote:
Sadly trying to fetch kills by regioID doesn't work with the API :(
https://zkillboard.com/api/kills/regionID/10000016/


I had actually disabled the regionID api last year because it was being abused, I've gone ahead and re-enabled it now but I'll be keeping an eye to see if people are abusing it again.

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Xerathul Muur
The Scope
Gallente Federation
#476 - 2015-05-13 20:57:42 UTC  |  Edited by: Xerathul Muur
Brain Gehirn
Macabre Votum
Northern Coalition.
#477 - 2015-05-15 18:56:18 UTC
zKB isnt showing the weapon that have been used, just the ship.

ps.: I know that CCP sometimes do that in killmails but its not the case recently
Squizz Caphinator
The Wormhole Police
#478 - 2015-05-15 20:20:42 UTC
Brain Gehirn wrote:
zKB isnt showing the weapon that have been used, just the ship.

ps.: I know that CCP sometimes do that in killmails but its not the case recently


Could you link somewhere specific? Is this in a killmail itself or elsewhere?

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Harri Hinken
Caldari Provisions
Caldari State
#479 - 2015-05-15 20:51:03 UTC
Squizz Caphinator wrote:
Brain Gehirn wrote:
zKB isnt showing the weapon that have been used, just the ship.

ps.: I know that CCP sometimes do that in killmails but its not the case recently


Could you link somewhere specific? Is this in a killmail itself or elsewhere?


https://zkillboard.com/kill/46604261/
http://eve-kill.net/?a=kill_detail&kll_id=28879540
e.g.
Squizz Caphinator
The Wormhole Police
#480 - 2015-05-16 14:15:28 UTC
Harri Hinken wrote:
Squizz Caphinator wrote:
Brain Gehirn wrote:
zKB isnt showing the weapon that have been used, just the ship.

ps.: I know that CCP sometimes do that in killmails but its not the case recently


Could you link somewhere specific? Is this in a killmail itself or elsewhere?


https://zkillboard.com/kill/46604261/
http://eve-kill.net/?a=kill_detail&kll_id=28879540
e.g.


aha! thanks for pointing that out, looks like it was a leftover bug from when I switched to the new database backend

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com