These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
 

evewho.com - Showing more than I want to show. No privacy !

First post First post
Author
Previous Topic Next Topic
Squizz Caphinator
The Wormhole Police
#81 - 2011-09-20 18:20:36 UTC
Hi guys, thanks for checking out EveWho. I was asked to come here and clarify a couple of things.

1) I am NOT scraping the API.
2) All information I've retrieved is publicly available somewhere.
3) I am NOT scraping the API.

I am well aware of CCP's policies per using the API and I have no intention of abusing them. I built the initial database by getting a character dump from Eve-Kill, scraping some forums, scraping a few hundred other killboards, and from a couple of donations of character name lists.

I am NOT scraping the API.

I built this site by using resources available to everyone. That includes you. I saw another site similar to EveWho a few months ago and thought I could do a better job. I believe I did. If you think you can do a better job, you just might be able to do so :)

I am NOT scraping the API.

Once again let me restate that I am not scraping the API. I might cause an error or two every few minutes but no where near enough to get myself Scotty'ed or even banned. I like getting along with Scotty anyway.

I am NOT scraping the API.

Please continue to enjoy EveWho for good or bad, whichever you prefer.

Fly dangerous,
Squizz

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
Miilla
Hulkageddon Orphanage
#82 - 2011-09-20 18:21:46 UTC
Othran wrote:
Leona Elum wrote:
CCP Stillman wrote:
generating excess errors will get your IP blocked.


I can confirm this to be true, and also say that it is VERY VERY hard to get it unblocked again.
In my case it was excessively updating of a "scammer list", in combination with bad settings in Excel that did the trick.


This is likely to become more of a problem soon(ish). Reason being its quite likely that as IPv6 (finally) gets introduced in Europe/North America the more likely that all the legacy modems/routers consumers have will be proxied through a gateway.

For anyone in the UK, all your mobile phone stuff works like this - its all proxied and logged due to rules about under 18s, more to do with contracts than morality IMHO ;)


All ISP's are gateways.

It says I am in A location but infact i am hundreds of miles away from that location.

All ISP's cache (Squid most likely) and log and route out, not just mobiles.
Miilla
Hulkageddon Orphanage
#83 - 2011-09-20 18:23:04 UTC  |  Edited by: Miilla
Squizz Caphinator wrote:
Hi guys, thanks for checking out EveWho. I was asked to come here and clarify a couple of things.

1) I am NOT scraping the API.
2) All information I've retrieved is publicly available somewhere.
3) I am NOT scraping the API.

I am well aware of CCP's policies per using the API and I have no intention of abusing them. I built the initial database by getting a character dump from Eve-Kill, scraping some forums, scraping a few hundred other killboards, and from a couple of donations of character name lists.

I am NOT scraping the API.

I built this site by using resources available to everyone. That includes you. I saw another site similar to EveWho a few months ago and thought I could do a better job. I believe I did. If you think you can do a better job, you just might be able to do so :)

I am NOT scraping the API.

Once again let me restate that I am not scraping the API. I might cause an error or two every few minutes but no where near enough to get myself Scotty'ed or even banned. I like getting along with Scotty anyway.

I am NOT scraping the API.

Please continue to enjoy EveWho for good or bad, whichever you prefer.

Fly dangerous,
Squizz



Provide an opt out mechanism and you wont be ganked non stop in game.




EveWho-Squizz Caphinator-A-GEDDON! Comming SOON!

Quote:

Once again let me restate that I am not scraping the API. I might cause an error or two every few minutes but no where near enough to get myself Scotty'ed or even banned. I like getting along with Scotty anyway.


Then you should get ZERO ERRORS if you are calling with VALID parameters.
Jack bubu
Caldari Provisions
Caldari State
#84 - 2011-09-20 18:26:22 UTC
oh my, Miilla **** posting, thats something new
Nyio
Federal Navy Academy
Gallente Federation
#85 - 2011-09-20 18:26:24 UTC
Squizz Caphinator wrote:
Hi guys, thanks for checking out EveWho. I was asked to come here and clarify a couple of things.

1) I am NOT scraping the API.
2) All information I've retrieved is publicly available somewhere.
3) I am NOT scraping the API.

I am well aware of CCP's policies per using the API and I have no intention of abusing them. I built the initial database by getting a character dump from Eve-Kill, scraping some forums, scraping a few hundred other killboards, and from a couple of donations of character name lists.

I am NOT scraping the API.

I built this site by using resources available to everyone. That includes you. I saw another site similar to EveWho a few months ago and thought I could do a better job. I believe I did. If you think you can do a better job, you just might be able to do so :)

I am NOT scraping the API.

Once again let me restate that I am not scraping the API. I might cause an error or two every few minutes but no where near enough to get myself Scotty'ed or even banned. I like getting along with Scotty anyway.

I am NOT scraping the API.

Please continue to enjoy EveWho for good or bad, whichever you prefer.

Fly dangerous,
Squizz


Thanks for the great site, keep up the good work! Big smile

Golem • CCP In-Game Event 2011.11.23 • Nyio • Grenade?
Othran
Route One
#86 - 2011-09-20 18:26:47 UTC
CCP Stillman wrote:
I'm not saying it's acceptable. I'm saying that it's how the API was originally designed and that changing that shouldn't be done over night, as we don't want to break applications from functioning. We want to give people a heads up and make sure they can adjust their applications in time before a such change hits. Doing so in the Incarna patch would be too many changes at once.

I can't confirm exactly when we'd deploy a such change. But I'll have a talk with Elerhino and see what we can do.


Thank you for your honesty.

You are aware of how this makes you guys look - time after time its some other nonsense from someone who CLEARLY should not be doing the role. This example is so basic it makes me cringe and I'm a h/w engineer.

Anyway it needs sorting ASAP so whatever can be done to escalate a review of API calls which return character data with no key would be appreciated.
KaarBaak
Squirrel Team
#87 - 2011-09-20 18:26:55 UTC

OP: did you check API call logs? Mine show two hits every day from an IP that is part of a block assigned in China.

Dum Spiro Spero
Othran
Route One
#88 - 2011-09-20 18:27:42 UTC
Squizz Caphinator wrote:
Hi guys, thanks for checking out EveWho. I was asked to come here and clarify a couple of things.

1) I am NOT scraping the API.
2) All information I've retrieved is publicly available somewhere.
3) I am NOT scraping the API.

I am well aware of CCP's policies per using the API and I have no intention of abusing them. I built the initial database by getting a character dump from Eve-Kill, scraping some forums, scraping a few hundred other killboards, and from a couple of donations of character name lists.

I am NOT scraping the API.

I built this site by using resources available to everyone. That includes you. I saw another site similar to EveWho a few months ago and thought I could do a better job. I believe I did. If you think you can do a better job, you just might be able to do so :)

I am NOT scraping the API.

Once again let me restate that I am not scraping the API. I might cause an error or two every few minutes but no where near enough to get myself Scotty'ed or even banned. I like getting along with Scotty anyway.

I am NOT scraping the API.

Please continue to enjoy EveWho for good or bad, whichever you prefer.

Fly dangerous,
Squizz



Bullshit.
malaire
#89 - 2011-09-20 18:27:46 UTC
Squizz Caphinator wrote:
I am NOT scraping the API.

So what does this mean then (I added underlining)

Quote:

All numbers based on known characters and may differ from in game values. All characters found by scavenging killboards, eve-search, and finding holes in character id sequence data and filling them.

New to EVE? Don't forget to read: The Manual * The Wiki * The Career Options * and everything else
Othran
Route One
#90 - 2011-09-20 18:31:34 UTC
Miilla wrote:
Othran wrote:
Leona Elum wrote:
CCP Stillman wrote:
generating excess errors will get your IP blocked.


I can confirm this to be true, and also say that it is VERY VERY hard to get it unblocked again.
In my case it was excessively updating of a "scammer list", in combination with bad settings in Excel that did the trick.


This is likely to become more of a problem soon(ish). Reason being its quite likely that as IPv6 (finally) gets introduced in Europe/North America the more likely that all the legacy modems/routers consumers have will be proxied through a gateway.

For anyone in the UK, all your mobile phone stuff works like this - its all proxied and logged due to rules about under 18s, more to do with contracts than morality IMHO ;)


All ISP's are gateways.

It says I am in A location but infact i am hundreds of miles away from that location.

All ISP's cache (Squid most likely) and log and route out, not just mobiles.



Nope. Mobile companies in the UK proxy your internet access via a gateway. Your mobile has a valid local IP address (eg 10.x.x.x) but it has no routable IP address other than via the gateway. The upshot being all requests come from the same IP address.
Karbowiak
Sacred Templars
Fraternity.
#91 - 2011-09-20 18:31:37 UTC
Squizz is using the EVSCO API proxy, and if ur interested in knowing numbers and statistics on the EVE API as we see it, have at it! ;)

EVE API errors (how many errors we generate a day, this is for both EVE-KILL, EVEWho, EVEChatter and quite a few people who use our API proxy for various things (evemon for example))

http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/eveapi_errors_php.html

EVE API requests (How many requests we do each day, this is for both EVE-KILL, EVEWho, EVEChatter and quite a few people who use our API proxy for various things (evemon for example))
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/eveapi_requests_php.html

and if you want more stats then take a look here:
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/index.html#eve%20api
and
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/index.html#eve-kill

CCP are also welcome to keep a look at it, im sure you can use it for something.

also, <3 Squizz
Squizz Caphinator
The Wormhole Police
#92 - 2011-09-20 18:33:10 UTC
malaire wrote:
Squizz Caphinator wrote:
I am NOT scraping the API.

So what does this mean then (I added underlining)

Quote:

All numbers based on known characters and may differ from in game values. All characters found by scavenging killboards, eve-search, and finding holes in character id sequence data and filling them.


I have two characters ID's, 1 and 3. I know with absolute certainty that 2 is a character id. I fetch it.

Pretty simple really :)

Various projects I enjoy putting my free time into:

https://zkillboard.com | https://evewho.com
KaarBaak
Squirrel Team
#93 - 2011-09-20 18:34:47 UTC
KaarBaak wrote:

OP: did you check API call logs? Mine show two hits every day from an IP that is part of a block assigned in China.



These two IPs make calls at the exact same time every day:

222.63.187.102 (Beijing?)
80.52.150.214 (Poland?)

Dum Spiro Spero
Miilla
Hulkageddon Orphanage
#94 - 2011-09-20 18:34:58 UTC
Karbowiak wrote:
Squizz is using the EVSCO API proxy, and if ur interested in knowing numbers and statistics on the EVE API as we see it, have at it! ;)

EVE API errors (how many errors we generate a day, this is for both EVE-KILL, EVEWho, EVEChatter and quite a few people who use our API proxy for various things (evemon for example))

http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/eveapi_errors_php.html

EVE API requests (How many requests we do each day, this is for both EVE-KILL, EVEWho, EVEChatter and quite a few people who use our API proxy for various things (evemon for example))
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/eveapi_requests_php.html

and if you want more stats then take a look here:
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/index.html#eve%20api
and
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/index.html#eve-kill

CCP are also welcome to keep a look at it, im sure you can use it for something.

also, <3 Squizz


So IF we use EVSCO API proxy to generate a large number of errors, EVSCO API proxy gets the IP blocked.
malaire
#95 - 2011-09-20 18:41:43 UTC
Squizz Caphinator wrote:
malaire wrote:
Squizz Caphinator wrote:
I am NOT scraping the API.

So what does this mean then (I added underlining)

Quote:

All numbers based on known characters and may differ from in game values. All characters found by scavenging killboards, eve-search, and finding holes in character id sequence data and filling them.


I have two characters ID's, 1 and 3. I know with absolute certainty that 2 is a character id. I fetch it.

Pretty simple really :)

How do you know with absolute certainty that 2 is characterID, if you have never seen that characterID anywhere? Even if it might seem certain that it really is characterID, you really are doing API scraping by checking it if you have never seen it anywhere before.

New to EVE? Don't forget to read: The Manual * The Wiki * The Career Options * and everything else
Jack bubu
Caldari Provisions
Caldari State
#96 - 2011-09-20 18:43:11 UTC
KaarBaak wrote:
KaarBaak wrote:

OP: did you check API call logs? Mine show two hits every day from an IP that is part of a block assigned in China.



These two IPs make calls at the exact same time every day:

222.63.187.102 (Beijing?)
80.52.150.214 (Poland?)


I dont get this at all, only the calls i make via EFT or the daily check my alliance services do on my corporation status.

are you sure its not something similar for you aswell?
Karbowiak
Sacred Templars
Fraternity.
#97 - 2011-09-20 18:46:34 UTC
Miilla wrote:
Karbowiak wrote:
Squizz is using the EVSCO API proxy, and if ur interested in knowing numbers and statistics on the EVE API as we see it, have at it! ;)

EVE API errors (how many errors we generate a day, this is for both EVE-KILL, EVEWho, EVEChatter and quite a few people who use our API proxy for various things (evemon for example))

http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/eveapi_errors_php.html

EVE API requests (How many requests we do each day, this is for both EVE-KILL, EVEWho, EVEChatter and quite a few people who use our API proxy for various things (evemon for example))
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/eveapi_requests_php.html

and if you want more stats then take a look here:
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/index.html#eve%20api
and
http://91.215.157.114/munin/eureka.evsco.net/ronon.eureka.evsco.net/index.html#eve-kill

CCP are also welcome to keep a look at it, im sure you can use it for something.

also, <3 Squizz


So IF we use EVSCO API proxy to generate a large number of errors, EVSCO API proxy gets the IP blocked.




That is doable yes, but we have our own mechanism to block people who do many errors, and its more aggressive than anything you'd ever want to know about.

Plus it doesn't just ban you from the api proxy, also eve-kill and a whole slew of other stuff ;)
Also saying how many errors a minute you have to generate to get into the "you're out" zone wouldn't be in my own interest.

That said, you trying to get the EVSCO API banned by CCP, wouldn't be in anyones interest, since without it - EVE-KILL wouldn't recieve any mails via the API.

At which point, you hunting Squizz around ingame will be the least of your troubles :D
Lady Zarrina
New Eden Browncoats
#98 - 2011-09-20 18:47:20 UTC
So the guys who think they have super secret toons were probably sooo smart they entered that toon name into the search window? I wonder how they figured that name out.

EVE: All about Flying Frisky and Making Iskie
Nyio
Federal Navy Academy
Gallente Federation
#99 - 2011-09-20 18:50:06 UTC
Miilla wrote:
So IF we use EVSCO API proxy to generate a large number of errors, EVSCO API proxy gets the IP blocked.


I'd like to think that the proxy would never send a bad request to the EVE servers..

Golem • CCP In-Game Event 2011.11.23 • Nyio • Grenade?
malaire
#100 - 2011-09-20 18:51:42 UTC  |  Edited by: malaire
EDIT: removed my alarmist question about EVEMon. I just misread. Sad

New to EVE? Don't forget to read: The Manual * The Wiki * The Career Options * and everything else