gstmsdk: vp8/vp9 HD (2K, 4K) clips will drop a lot of frames
This issue is happening on different platforms and behaves worse than using gstreamer-vaapi plugins. This is running on Fedora 29 with GnomeShell (wayland)
The setup includes:
mediasdk 18.4.0 intel-media-driver-18.4.0 gmmlib-18.4.1 libva-2.4.0
When using 2K, 4K content and bitrates above 10Mbps, frames will drop considerably.
A frame dropper pipeline
GST_GL_PLATFORM=egl LIBVA_DRIVER_NAME=iHD gst-launch-1.0 filesrc location=vp8orvp92k4k.webm ! matroskademux ! msdkvp9dec ! video/x-raw, format=NV12 ! glimagesink
GST_GL_PLATFORM=egl LIBVA_DRIVER_NAME=iHD gst-launch-1.0 filesrc location=vp8orvp92k4k.webm ! matroskademux ! msdkvp9dec ! video/x-raw, format=NV12 ! glimagesink sync=false
A working pipeline
GST_VAAPI_ALL_DRIVERS=1 GST_GL_PLATFORM=egl LIBVA_DRIVER_NAME=iHD gst-launch-1.0 filesrc location=vp8orvp92k4k.webm ! matroskademux ! vaapivp9dec ! video/x-raw, format=NV12 ! glimagesink sync=false
GST_VAAPI_ALL_DRIVERS=1 GST_GL_PLATFORM=egl LIBVA_DRIVER_NAME=iHD gst-launch-1.0 location=vp8orvp92k4k.webm ! matroskademux ! vaapivp9dec ! video/x-raw, format=NV12 ! glimagesink sync=false
This should help rule out a problem in iHD or glimagesink.