Design a higher level wrapper around webrtcbin that handles a lot of stuff for you
Currently, with webrtcbin:
- you have to manually encode streams to the requested encoding
- you also have to manually decode streams
- something about payloading/depayloading, which I don't understand yet but am told is important
😄 - you have to manually keep track of which sdp m-line is which, and connect streams to the appropriate sink pad at the appropriate time, along with capsfiltering them with the appropriate pt values
It would be nice to have a higher level webrtcbin that does all this magically, and exposes an API that just uses raw streams.
05:26 < ystreet00> it would be useful though to have something (lib/plugin) that did all the
encoding/payloading/decoding/depayloading and stream routing for webrtc automatically for raw
audio/video streams
Ideally, it's just as powerful, but gives you the option to have things magically done for you. (For Servo, at least, we still need the ability to do custom transceivers and such)
Another option is to have an even higher level webrtcbin that behaves more like the WebRTC JS API, similar to gstplayer:
09:22 < nirbheek> Sounds doable, but maybe we want something like the gstplayer API but for webrtc, so people don't
necessarily need to understand how gstreamer works
09:22 < slomo> in that case you'd probably want something that looks like the JS APIs
There seem to be a bunch of ideas around this, filing this issue to keep track of them.