Jeykey

Jeykey

I’m currently doing some research about live streaming and live video (like Twitch, YouTube Live, etc.). There are a lot of different technologies and tools out there for implementing real time video & audio in the web and mobile.

I found WebRTC and originally thougth it was a good fit. But after learning the details, I found a lot of complications with things like TURN servers and the overall need for a lot of different servers and services. As far as I understand it, the sending client could actually be more demanded with more viewers which is a no-go for this type of application.
Looking for simpler solutions I found protocols like HLS and RTP but I found issues with delay and a lack of Elixir implementations for both of them.

Looking around I also found a tutorial using NodeJS and normal websockets, just sending the raw images in Base64 (or other encoding) over the websocket. I have some performance concerns about this, but I have no data to know how fast Websockets and more specifically Phoenix Channels perform.
Since I saw that UDP seems to be the better option, I looked into :gen_utp, but it seems like a lot of the inifrastructure would have to be implemented, since there aren’t any frameworks.

Does anybody have any experience using Elixir or Phoenix for video live streams could give me some advice?

Showing Posts 1 to 10

peck

peck

you may want to take a look at mux and their competitors. They’ve solved a lot of these problems and will let you focus on the goals of your product vs getting bogged down in the details of video streaming.

Also, be sure to do your math. Bandwidth gets very expensive very quickly with video at level of scale, you don’t want to be hit with a giant bill at the end of the month that your customers payments aren’t able to cover.

mat-hek

mat-hek

Membrane Core Team

Hi @Jeykey, Membrane has a pure elixir implementation of RTP - see the demo and we recently created a bunch of components for streaming via HLS. We’re now documenting and polishing them, so they should be available shortly :wink: We’re also preparing an article about building a Twitch-like app with Membrane, watch the membrane tag if you’re interested.

Whatever solution you end up with, definitely don’t send raw images, especially in base64, as it will generate huge traffic and won’t scale at all (maybe unless you have very low resolution and framerate)

10
Post #2
Jeykey

Jeykey OP

From what I’ve read so far, HLS seems to have quite a high latency. Whats your experience and is it suitable for something like Twitch?

mat-hek

mat-hek

Membrane Core Team

I believe Twitch itself uses either DASH or HLS, and so does Youtube/Facebook live. That’s because of scaling - those protocols basically split the stream into small chunks and serve them via HTTP, so you can quite easily set up a CDN in between and handle thousands of viewers. But yes, that also introduces higher latency - usually about 10 seconds - and while I suppose you can get better, it is not going to be even close to RTP’s 200-500 milliseconds. If the lowest possible latency is required, the solution is to use RTP on both sides. I see two options there:

  1. Peer to peer - streamer sends directly to each viewer - can handle a few receivers and strains the sender, but is relatively easy to implement with WebRTC - requires only a signalling server, such as Membrane WebRTC server and JS clients
  2. RTP between streamer and server and RTP between server and each viewer - if you want to have browser clients you still need to use WebRTC, but this time via WebRTC gateway on the server. And this will not scale as easily as HLS/DASH.
Jeykey

Jeykey OP

In the Discord Blog I read that they use WebRTC but run all their traffic through a Gateway for moderation and for protecting the IP addresses of the users. Why would you want to use a technologie designed for P2P in a Client / Server architecture?

mat-hek

mat-hek

Membrane Core Team

For two main reasons

  • it’s widely supported, in particular by all the popular browsers
  • P2P and client-server scenarios don’t really differ in terms of the itermediary protocol - when you make server a peer, client-server is still P2P from that point of view
Jeykey

Jeykey OP

I understand some of the advantages of WebRTC, but I’m still somewhat confused about how to use it in a centralized server architecture, like the one described by Discord.

Routing audio/video through media servers offers other advantages as well, such as moderation.

Are they describing a TURN server, or another solution?
They also talk a lot about WebSockets end using Elixir, at least for their Signaling server.
What is the involvement of Elixir in their (or another WebRTC) application?
Could you also transfer video & audio through Websockets?

mat-hek

mat-hek

Membrane Core Team

Are they describing a TURN server, or another solution?

TURN stands for Traversal Using Relay NAT, so it seems they have something beyond TURN. Nevertheless, the architecture is probably similar.

They also talk a lot about WebSockets end using Elixir, at least for their Signaling server.

WebRTC doesn’t standardize technologies to be used in the signalling layer, so the use of WebSockets is absolutely valid.

What is the involvement of Elixir in their (or another WebRTC) application?

Don’t really understand this question. It’s possible to implement entire WebRTC stack in Elixir, we aim to do that at Membrane.

Could you also transfer video & audio through Websockets?

Video or audio is just a stream of data, so you can transfer (send and receive) them anyhow. The problem is that live streaming is way more complex than just sending and receiving data. You can see this talk by @mspanc to have some overview. Proper tooling can handle significant part of that complexity.

jayjun

jayjun

@mat-hek I look forward to your article. What do you think of this blog post’s approach?

mat-hek

mat-hek

Membrane Core Team

Well, that’s the article I was speaking of, it’s by my teammate and I reviewed it :stuck_out_tongue: So personally I think the approach is perfect :smiley: I posted about that in the membrane thread but it looks like it’s not visible enough there. @AstonJ can it be separated?

Where Next? Top

Trending in Questions Top

Hellowman
Hello everyone! I am new to coding with Elixir/Erlang. And i am looking for some utilities for fuzzing testing like AFL++. Does anyone ...
New
yarrichar
I’m very new to Elixir, so sorry if this is a silly question: I am wondering what happens to the mailbox of a process when the machine i...
New
pragdave
How do I tell Hologram not to escape HTML when substituting into templates? {Textile.render(@product.long_description)} escapes the HTM...
New
Fl4m3Ph03n1x
Background When trying to execute mix release on a Windows 11 machine for a Phoenix project I get the following error: * assembling mark...
New
mandar1045
I load tested a plain Phoenix chat app backed by Postgres with 100 million messages in it, everything on default settings, to see what br...
New
rlipscombe
I’d like to create a file with 600 permissions (rw-------), but there’s a race condition if I create it and then change the permissions. ...
New
saleyn
Is there a way to import record definitions in the iex shell for pretty printing (similar to the rr command in the erl shell)? This woul...
New

Other Trending Topics Top

GenericJam
Edit: 2026 May 15 - This post is archived. Mob is alive!! Main docs: mob v0.7.11 — Documentation A bit of explanation for the slightly c...
261 13183 112
New
OndrejValenta
(I just needed to vent somewhere and LinkedIn is full of hope, or hype, I’m not sure which exactly) AI dream has many faces, but general...
New
kip
Localize is the next generation localisation library for Elixir. Think of it as ex_cldr version 3.0. The first version will be released ...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
charlenopires
Hi everyone :waving_hand: I’ve been working on PhiaUI, an open-source UI component library for Phoenix LiveView, and I wanted to share i...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews