I have a rather expensive action (some PDF generation and upload to an other service) that occurs when related API endpoint is invoked. At the moment, there’s a pool of workers processing those requests and doing what they’re supposed to. However, this approach results in workers filling up their in…

Look at the buffering demand part of the GenStage docs https://hexdocs.pm/gen_stage/GenStage.html . It includes a QueueBroadcaster which shows how to manage demand and back pressure. In the case of a web API the caller can make calls any time they choose. You would need to provide some reply they …

There’s also an example in the gen_stage repo for rate limiting that you might want to check out.

I gave it a look before, it does show how to rate limit from consumer perspective, but didn’t help with the problem of informing the clients of that rate limit. Clients in this case come even before producer. Maybe I missed something, will give it another look. Thanks!

Elixir Programming Language Forum

Rate limiting API with GenStage?

Questions & Help Questions

elvanja May 9, 2017, 8:25pm 5

Excellent, seems to be on the right track.
Thank you very much!