HTTP client for high latency requests

Maybe try GitHub - lpgauth/buoy: High-Performance Erlang HTTP 1.1 Client · GitHub … That’s what I usually use when I need performance, but I don’t think I ever make requests with such a high latency.

Note that it doesn’t implement the full http/1.1 spec: GitHub - lpgauth/buoy: High-Performance Erlang HTTP 1.1 Client · GitHub.

But it is the most performant http/1.1 client afaik: GitHub - lpgauth/httpc_bench: Erlang HTTP client benchmarks · GitHub.

I’ve often seen 200-300msec latency for HTTP client requests with httpc or hackney, so that’s about what I’d expect. I assume you’re using keep-alives, etc, as appropriate.

What kind of latency are you used to having from HTTP clients in other languages?

Edit: Or is it just the throughput that’s unexpected?

I’ve often seen 200-300msec latency for HTTP client requests

Oh, right. I wasn’t thinking straight. These are normal latencies indeed …

Thanks for suggesting! I tried buoy but encountered on strange behavior when remote endpoint became unresponsive – shackle application which buoy using under the hood stops and all requests fail

which numbers do you get with buoy and on which server spec? I think that 400 RPS for just outgoing http requests without any logic looks odd for 2 cores

which numbers do you get with buoy and on which server spec?

I’d need to measure it. Sorry, don’t have any numbers right now. The server was a preemtible alpine vm on google cloud, and the requests from it were made to google storage api, so latencies were pretty low.