@mat-hek I’ve successfully wired up my first pipeline. It seems like it almost works, but i’ve ran into an issue. My stream only supports interleaving, however the membrane-element-rtp-h264 element does not support interleaving.
There is only one channel, so i tried to hack it together but just filtering out the interleaving packets with something along the lines of this:
defp process(state, buffer)
defp process(%{length: l} = state, buffer) when is_number(l) do
buffer = state.buffer <> buffer
if byte_size(buffer) >= l do
<<chunk::binary-size(l), rest::binary>> = buffer
actions = [buffer: {:output, %Buffer{payload: chunk}}, redemand: :output]
{{:ok, actions}, %{length: nil, buffer: rest}}
else
{{:ok, demand: {:input, state.length}}, %{state | buffer: buffer}}
end
end
defp process(state, <<36, channel::integer-8, length::integer-16, chunk::binary>>) do
actions = [buffer: {:output, %Buffer{payload: chunk}}, redemand: :output]
{{:ok, actions}, %{length: nil, buffer: rest}}
process(%{state | length: length}, rest)
end
but that didn’t seem to work. In the logs i can see:
[h264 @ 0x7fbee401ed00] non-existing PPS 0 referenced
[h264 @ 0x7fbee401ed00] decode_slice_header error
h264 @ 0x7fbee401ed00] no frame!
and then i get an error:
13:14:04.542 [error] GenServer #PID<0.281.0> terminating
** (Membrane.ActionError) Error while handling :split action:
Unknown error: :send_pkt
Callback: Membrane.Element.FFmpeg.H264.Decoder.handle_process_list
Action args: {:handle_process,
[
[
:input,
%Membrane.Buffer{
metadata: %{},
payload: <<0, 0, 0, 1, 101, 136, 128, 16, 0, 12, 255, 245, 154, 34, 103,
162, 245, 12, 56, 225, 60, 222, 189, 150, 153, 78, 16, 77, 254, 201,
165, 53, 240, 253, 3, 133, 170, 112, 0, 254, 178, 211, 19, ...>>
}
]
]}
I think my issue is my deinterleaver is actually only outputting RTP frames, and the h264 frames are being dropped? Is there plans to adding “official” support for interleaving? I’d be happy to help contribute it, but i’m having a hard time determining where to add it. wireshark calls it an rtsp interleave frame so i assumed it could be added to the rtsp source, but for the deinterleaver to work properly, it needs to decode the RTP and maybe even the h264 frames. Any help would be appreciated.
