ausimian

ausimian

Connecting via WebRTC to PipeWire

Hi, been looking at Membrane for a few days now and it seems pretty great. I don’t have any prior experience in this area so the guides have been very helpful.

I want to relay some web-rtc audio (in both directions) from a browser into a server (e.g. a membrane server) and then into pipewire nodes running on the same server. My default approach is to use Membrane for the signalling and then a Membrane pipeline to get the packets into raw audio frames, which I will then push into pipewire, through either a couple of pipewire ‘Unix FIFO’ modules, or a ‘Simple Protocol’ module. These modules are then linked to the ‘real’ pipewire nodes. Does this sound like a sane approach?

Follow up question:

My other thought when I looked at the available pipewire modules, was to use the pipewire RTP modules and then just advertise their endpoints during signalling (in Membrane). But I don’t know if this is feasible, as even ex_webrtc seems to want own the rtp endpoints after setup?

Thx!

Most Liked

mat-hek

mat-hek

Membrane Core Team

Hi @ausimian, the approach sounds valid, but it involves sending raw audio between processes. I don’t think it’s ever a bottleneck, but you may consider reducing the overhead by sending it via RTP, since Pipewire accepts it (WebRTC → Membrane → RTP → PipeWire). BTW, I think you could replace Membrane with Boombox here, both in your current solution and the RTP approach.

I don’t think it’s possible to make RTP go to Pipewire directly when using WebRTC, mainly because of how WebRTC handles sockets and encryption. And even after magically solving that, there would be a 1000 more quirks and corner cases :wink:

ausimian

ausimian

Yeah, thx for reply. I think I’ll have to look at the SAP module for Pipewire to get the most optimal solution working.

Thx for the feedback.

Where Next?

Popular in Questions Top

mgjohns61585
Could someone help me? I'm making my first elixir program, number guessing game. I can't figure out how to convert the user's guess from ...
New
9mm
I am constructing a JSON object (map) and I need to conditionally set a field. I’m trying to write proper elixir-way code… and I’m at a l...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New
greenz1
I have a phoenix application from which a user can download multiple(5-6) files of size 1MB. I couldn’t find anything related to sending ...
New
JulienCorb
I am trying to implement my new.html.eex file to create new posts on my website. new.html.eex: <h1>Create Post</h1> <...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
johnnyicon
Hi all, I've just started learning Elixir and Phoenix Framework, so please pardon my n00bness at this stage. I'm trying to use Postg...
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
sergio_101
I am VERY much an elixir newbie. I have taken one elixir course and one phoenix course on Udemy. During that course, I saw the instructor...
New
PeterCarter
There are pre-rolled solutions for other frameworks that do work. However, Phoenix does not seem to have these. Have people had good expe...
New

Other popular topics Top

danschultzer
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch. This project took far...
548 29305 241
New
stefanchrobot
What’s the safe way to decode a JSON string into a struct? I want to avoid calling String.to_atom. Jason.decode can give me a map with st...
New
JeremM34
Hello, how can I check the Phoenix version ? Thanks !
New
ovidiubadita
Hey all, I discovered Elixir and I love it. I always wanted to learn a functional programming and I intended to go for Haskell, but afte...
New
grych
Hi folks, Few months ago I have announced the proof-of-concept of the library to manipulate the browsers DOM objects directly from Elixi...
639 52238 488
New
Lily
In templates/appointment/index.html.eex: <%= for appointment <- @appointments do %> <tr> <td><%= appoi...
New
fayddelight
I tried installing elixir 1.11.2 erlang 23.3.4 via asdf in my zsh shell. Enabled the versions locally and globally. When I list them ...
New
AngeloChecked
What learn first? Rust or Elixir Hi Elixir community! I’m here because i want learn a new language. I’m a junior developer and mainly i ...
New
klo
Got a question about when to concat vs. prepending items to list then reversing to achieve appending. So i know lists boil down to [1 | ...
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 record...
New

We're in Beta

About us Mission Statement