Video processing and editing in Elixir

[tomekowal]

Hi!

I have a project where I will need to process video, find some markers on it and output video with some additional information on top (for example draw the path that marker travelled on that video and calculate the distance).

Video formats are up to me to decide.

It doesn’t have to be online.

I couldn’t find any libraries that convert video into a stream of frames that I could use to calculate marker positions. Do you know any?
Do you think it is feasible to do in Elixir (since it is mine primary programming language) or should I switch to something else like Python?

[gon782]

I remember this talk that could point you in the right direction:

He outsources a lot of the work to FFMPEG.

[AstonJ]

This might also be of interest:

Video Streaming with Elixir (wiki)

To transcode the video there is FFMPEG. On Demand When a user uploads a video, the app renames and copy the file to a path, then call FFMPEG to transcode the video. Let’s say we are using HLS, we can use a script like this, to transcode the video to multiple resolutions, create a playlist file and sequences: https://github.com/shavit/Diana/blob/master/bin/create_sequence When a user requests a video, the server responds with m3u8 file, which contains a list of ts files. The creation of the s…

[tomekowal]

Thanks guys!

I’ve watched the presentation and did some more research. Looks like for marker detection it is better to go with opencv, aruco markers and Python bindings. I may still use Elixir if we decide to capture video online with mobile phone and process in on the server.