These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

gateway error

First post
Author
Previous Topic Next Topic
Messenger Of Truth
Butlerian Crusade
#1 - 2015-04-08 13:24:55 UTC
Every now and then I get a connection failure like this when I am connecting via CREST:


{'status': '502', 'x-cache-status': 'BYPASS', 'transfer-encoding': 'chunked', 'server': 'nginx/1.2.0', 'connection': 'keep-alive', 'date': 'Wed, 08 Apr 2015 10:44:57 GMT', 'content-type': 'application/json; charset=utf-8'}
Gateway error communicating with EVE proxy


Is this a server error? Or is the server objecting to something I'm doing?

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
Pete Butcher
The Scope
Gallente Federation
#2 - 2015-04-08 15:11:21 UTC
It may have something in common with https://forums.eveonline.com/default.aspx?g=posts&t=411697

http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool
Messenger Of Truth
Butlerian Crusade
#3 - 2015-04-09 07:28:32 UTC
I didn't get another one for quite a long time, but sure enough it did eventually come:

{'status': '502', 'x-cache-status': 'BYPASS', 'transfer-encoding': 'chunked', 'server': 'nginx/1.2.0', 'connection': 'keep-alive', 'date': 'Thu, 09 Apr 2015 00:05:09 GMT', 'content-type': 'application/json; charset=utf-8'}
Gateway error communicating with EVE proxy

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
Pete Butcher
The Scope
Gallente Federation
#4 - 2015-04-09 07:48:16 UTC
Messenger Of Truth wrote:
I didn't get another one for quite a long time, but sure enough it did eventually come:

{'status': '502', 'x-cache-status': 'BYPASS', 'transfer-encoding': 'chunked', 'server': 'nginx/1.2.0', 'connection': 'keep-alive', 'date': 'Thu, 09 Apr 2015 00:05:09 GMT', 'content-type': 'application/json; charset=utf-8'}
Gateway error communicating with EVE proxy


As stated in that topic, you might be overloading the proxy.

http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool
Messenger Of Truth
Butlerian Crusade
#5 - 2015-04-09 14:53:49 UTC
I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it.

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
Pete Butcher
The Scope
Gallente Federation
#6 - 2015-04-09 15:17:06 UTC
Messenger Of Truth wrote:
I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it.


That theoretical limit is indeed high (for the time being), but the real limit is orders of magnitude lower (because of proxy), as explained later in that topic. Although it seems unlikely you reach it with a single thread, but who knows.

http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool
CCP FoxFour
C C P
C C P Alliance
#7 - 2015-04-09 15:47:20 UTC
Pete Butcher wrote:
Messenger Of Truth wrote:
I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it.


That theoretical limit is indeed high (for the time being), but the real limit is orders of magnitude lower (because of proxy), as explained later in that topic. Although it seems unlikely you reach it with a single thread, but who knows.


Could be unlucky and land on a proxy that another market scraper is hitting

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.
Pete Butcher
The Scope
Gallente Federation
#8 - 2015-04-09 16:02:33 UTC
CCP FoxFour wrote:
Pete Butcher wrote:
Messenger Of Truth wrote:
I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it.


That theoretical limit is indeed high (for the time being), but the real limit is orders of magnitude lower (because of proxy), as explained later in that topic. Although it seems unlikely you reach it with a single thread, but who knows.


Could be unlucky and land on a proxy that another market scraper is hitting


That's more likely. There's a ton of CREST apps out there nowadays.

http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool
Messenger Of Truth
Butlerian Crusade
#9 - 2015-04-10 10:22:03 UTC
Ah so this rate limit applies to the whole proxy then, rather than to individual clients? So regardless of the rate at which I pull data, I may run into this issue?

If that is the case then it seems like this is a standard behaviour that needs to be coded around (perhaps by pausing for some time then retrying).

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
Ortho Loess
Escalated.
OnlyFleets.
#10 - 2015-04-19 14:42:49 UTC
Messenger Of Truth wrote:
Ah so this rate limit applies to the whole proxy then, rather than to individual clients? So regardless of the rate at which I pull data, I may run into this issue?

If that is the case then it seems like this is a standard behaviour that needs to be coded around (perhaps by pausing for some time then retrying).


It's changing soon to have properly defined rate limits, which should kick in before the proxy gets overloaded.

In general, you'll want to get market data from public crest after then chage, not authed (no proxy to break, so slightly higher limit). Rate limit will be 150 req/s (should be able to get a whole region in around 3 minutes)