Could you explain min_demand and max_demand in GenStage?

[peerreynders]

Welcome to the forum!

You are not storing remaining demand - so that you can release it later when it can be satisfied.

Have a look at:

My GenStage producer runs out of work to do, I buffer demand, but how do I know there is new work?

I’m writing a GenStage producer which is designed to scrape a bunch of RSS feed urls, and return a stream of all Articles. The set of urls it might scrape is fairly large, so it is given a UrlRepository module that it calls pop_url on to get the next url to parse. The UrlRepository (not coded yet) will presumably give it least recently parsed url. My current implementation of handle_demand is that I keep popping URLs and parsing them until I get enough articles to meet demand, and then I return…