I’m designing a system with recurrent long processing jobs from an API, and I wondering if GenStage or use multiple process (one process per request,i.e DynamicSupervisor) suite more for this kind of use case.
Is it better to use multiple process (one per request) or leverage the backpressure from genstage to support concurrent requests ?
Using Multiple process (ie. DynamicSupervisor)
API -> Job -> Job,Job,Job -> Job -> Job,Job,Job
API -> Producer -> ProducerConsumer -> Consumer