Encoders will add the meta to every single buffer, but we cannot set partition IDs properly when the meta has temporal_scalability set
CC @hgr @meh