Your description of the problem is very vague to say if GenStage or Flow is a good fit. I would first worry about writing the application and business domain. As an Elixir beginner, there are a couple things you would need to learn before dynamically managing GenStage pipelines, such as managing simple processes, and you can reevaluate later if you need the performance characteristics or the backpressure provided by GenStage.

To put it shortly, start with the simplest abstraction until you are familiar and you are sure you need more complex ones.

Not really. GenStage servers are just GenServers as well, but they have some extra functionality build on top for handling events in a chain of producers and consumers (or producer/consumers which do both things), reducing the boilerplate needed to set those up. Flow is another layer of abstraction on top of that which handles common cases like faning out to multiple processes and reducing those back at a later stage.

All this could be done using plain GenServers as well, but you’d need to write a ton more code to wire things up. Also each of those servers, be it a genserver or genstage instance still works syncronously on it’s own events. It’s multiple of those servers, which makes things async.

Thank you Jose, then I’ll do as you advice and go work on my basics before jumping into GenStage