Best way of consuming an external rate limited API

[hubertlepicki]

I believe we had similar thread on this forum. You may have find this relevant:

How to interface with a pool to handle request throttling?

https://github.com/jlouis/safetyvalve/ provides exactly these features. However sbroker master also provides a framework for building custom job regulators, there is even a property testing framework for the testing it. Its Erlang code but the simplest one limits the number of concurrent tasks: https://github.com/fishcakez/sbroker/blob/master/src/sregulator_open_valve.erl. The regulator process plugs together a valve, a queue and a meter, and has 3 different ways to request to run, blocking wit…