smanza

smanza

Bounded queue, Semaphore, GenStage relationship

Hello .

I’m analyzing the concurrency principles for the Erlang processes and their mailbox.
So I know each message is processed one by one which seems a bit like a mutex in the concurrency language.

However there are some limitation regarding the maximum size of the mailbox and its message queue.

I found an article and lib proposed by Discord using semaphore to ensure the non overloading of the mailbox queue. Which seems like back pressure for Erlang processes . So this would mean to implement for each GenServer message an update of a counter using atomic updates and from the client verifying if there are some space for it.

But I know this concept of backpressure is already managed by GenStage , so a consumer is not overloaded by a list of messages. Nevertheless, from a producer perspective, it will be possible to overflow some pushed events and the GenStage mailbox and internal queue. This may causes event dropping.

So do you know if GenStage manages this ? Should we using semaphore concept to protect processes ? Or maybe using pooling to resolve this issue ?

Thanks

Where Next?

Popular in Questions Top

nobody
Hi! In PHP: $_SERVER[‘SERVER_ADDR’] - in Elixir? Searched the docs for ip address and the web, no good results. Thanks!
New
minhajuddin
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
Emily
I have VueJS GUIs with the project generated using Webpack. I have Elixir modules that will need to be used by the VueJS GUIs. I forese...
New
lastday4you
I wanted to check elixir version in phoenix because i found that my elixir is 1.5 but when i use Enum.chunk_by it said the function is un...
New
alice
Hey, Just curious what are the main benefits of Elixir compared to Clojure? When is Elixir more useful than Clojure and vice versa? Th...
New
marius95
Hello everyone, I try to use an Javascript Event Handler in my root.html.leex file. Therefore I created a function in the app.js file: ...
New
JorisKok
I have a server on AWS, and was running a load test using artillery. When looking at the Phoenix dashboard I see the Ports going to 100% ...
New

Other popular topics Top

Brian
What is the proper way to load a module from a file in to IEX? In the python world, doing something like this pretty standard: from ....
New
jononomo
For some reason my phoenix channels are working for me in my local dev environment, but as soon as I deploy via Docker, I get a 403 error...
New
Darmani72
If I have a post route which an argument: post /my_post_route/:my_param1, MyController.my_post_handler How would get the post params ...
New
msaraiva
Surface is an experimental library built on top of Phoenix LiveView and its new LiveComponent API that aims to provide a more declarative...
564 44167 214
New
dblack
I’ve got an issue with an app and I’ve no idea of how to troubleshoot it. I’m hoping someone here might have seen something similar. I p...
New
senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New