Skip to content

WIP: Spatial media support in isomp4

This MR adds some support in qtmux and qtdemux for handling the Spherical Video V2 metadata specified in https://github.com/google/spatial-media/

There's also a Matroska metadata specification that's not implemented yet, and there's a 'mesh projection' mode I didn't implement.

I have put the metadata information into a GstStructure in a caps field, which works since it's informative about interpretation of the frame contents, and not really open to negotiation. I'm not sure how to add support for negotiating something so complicated, or how the mesh projection mode would fit into caps at all.

My preference would be to put the information in a Meta, but it can't change per buffer so that's not quite right.

TL;DR - Here's some patches, I'm not sure what to do with them to get them ready to merge.

Merge request reports