Playing with audio and video in Elixir - what do you lack?

Hello!

Have you every wanted to do something with audio or video in Elixir? What was your experience? Was it easy? If no, why? What was missing? What would you like to see?

We wonder what next steps we could take in Elixir WebRTC and are curious your experience when playing with multimedia in Elixir. We planned to create a bunch of media LiveView components that would make it easy to create various kinds of multimedia apps e.g.: streaming app, video conferencing app, AI convo bot, etc.

Any feedback is much appreciated!!

7 Likes

Can’t think of anything lacking but just want to say this sounds awesome… :star_struck:

Actually there is one thing that springs to mind - speech to text. Not sure if that’s the sort of thing you had in mind but here’s a thread about it:

1 Like

Well, it’s a very old post and since then, deepspeech stopped being developped…

But it has been replaced by Whisper. You can use it Python, in Elixir with Bumblebee.

I went last year to RTC ON in Krakow, and learned about Whisper.cpp from this conference

I am not using it for the web, but I’d like to run it as a wasip2 wasm component in Wasmex, not ready yet…

2 Likes