Hi! I am trying to build a solution and I need guidance as to what type of abstractions to use. I have a pool of users and operators connected to my Phoenix app via channels. I have entries in my database for each operator and user along with their current state. Now I need to implement a basic FIF…

That’s an interesting problem statement. At first reading it seems like it might be good to model this with processes (using either GenServer or Agent). Can you explain more why you need to persist the operators state in the database? Could that instead be stored entirely in memory? Based on my und…

It’s not really a producer consumer problem, I think it’s more related to limited resource access (where operators are those limited resources)… In which case I would look for design like poolboy, with checkin/checkout. There is Erlang :queue module to manage queue. If You want to be fast, You sho…

Thanks for the reply! Actually our business requires us to store various states in the Database because those will be used for deciding the billing and also analytics (I know for analytics we can use other approaches). The number of users can go upto 5000 at peak.

Thank you! Looking into ETS :slight_smile:

[image] axelson: Based on my understanding of your description, OPQ doesn’t seem like a good fit because it simply has generic worker processes, whereas you need to assign users from the queue to a specific available operator Oban too has generic workers which won’t fit in my use case.

Whenever an operator’s state is ‘available’, I need to allocate the first member of the user queue to this operator and pop him out of the queue. Operator sounds like a Rabbitmq consumer that can only handle 1 task at a time, and user queue is Rabbitmq messages queued up under a certain topic (ch…

What abstraction to use for Producer - consumer model with queue implementation

Questions & Help Questions

dimitarvp September 8, 2019, 5:33pm 2

Have you looked at Oban?

Or Broadway?