EVE Technology Lab

Re this endpoint: https://crest-tq.eveonline.com/market/10000043/orders/all/?page=1

I have some uncontroversial code shown below, but where 50,000 records in a 5mb payload will load in a browser in under ten seconds, it takes over two minutes. Anyone run into this?

public static string Load(string url)
{
    var req = (HttpWebRequest)WebRequest.Create(url);
    var response = req.GetResponse();
    using (var stream = response.GetResponseStream())
    {
        if (stream == null) return null;
        using (var buffer = new BufferedStream(stream))
        {
            var reader = new StreamReader(buffer);
            return reader.ReadToEnd();
         }
    }
}

You might want to check different options to the settings for HttpWebRequest. I noticed it was really slow until I figured maybe it was something with .Net instead of CCP.

Here are some settings that helped me with my CREST calls (in vb.net):

ServicePointManager.DefaultConnectionLimit = 20
ServicePointManager.UseNagleAlgorithm = False
ServicePointManager.Expect100Continue = False

Dim request As HttpWebRequest
request = DirectCast(WebRequest.Create(myUri), HttpWebRequest)

request.Method = "GET"
request.Proxy = nothing
request.PreAuthenticate = True
request.UnsafeAuthenticatedConnectionSharing = True

Hope it helps.

Bullseye: req.AutomaticDecompression = DecompressionMethods.GZip | DecompressionMethods.Deflate;

I looked at the traffic in wireshark and it looked identical, which pointed me to the browser must be receiving less data over the wire.