The frame width and height is rounded up to 128 and 32 since commit
8daac1c0, so the width, height for initialization should be rounded up to
128 and 32 too because the MSDK VP9 encoder will do some check on width
and height.

Sample pipeline:
gst-launch-1.0 videotestsrc ! \
video/x-raw,width=320,height=240,format=NV12 ! msdkvp9enc ! fakesink

Use boolean instead of GstFlowReturn as declared.
Note that since base class does not check return value of GstVideoDecoder::flush(),
this would not cause any change of behavior.

gstreamer/gst-plugins-bad!924
is trying to use video memory for decoding on Linux, which reveals a
hidden bug in msdkdec.

For video memory, it is possible that a locked mfx surface is not used
indeed and it will be un-locked later in MSDK, so we have to check the
associated MSDK surface to find out and free un-used surfaces, otherwise
it is easy to exhaust all pre-allocated mfx surfaces and get errors below:

0:00:00.777324879 27290 0x564b65a510a0 ERROR                default
gstmsdkvideomemory.c:77:gst_msdk_video_allocator_get_surface: failed to
get surface available
0:00:00.777429079 27290 0x564b65a510a0 ERROR         msdkbufferpool
gstmsdkbufferpool.c:260:gst_msdk_buffer_pool_alloc_buffer:<msdkbufferpool0>
failed to create new MSDK memory

Note the sample code in MSDK does similar thing in
CBuffering::SyncFrameSurfaces()

Sebastian Dröge authored Dec 12, 2019 and Sebastian Dröge committed Dec 31, 2019

Instead of always going through the file system API we allow the
application to modify the behaviour. For the playlist itself and
fragments, the application can provide a GOutputStream. In addition the
sink notifies the application whenever a fragment can be deleted.

Sebastian Dröge authored Dec 31, 2019 and Sebastian Dröge committed Dec 31, 2019

Fixes gstreamer/gst-plugins-bad#1042

... by seeking to target offset determined by new seek segment,
rather than that of the previous segment.  The latter would typically
seek back to start for a non-accurate seek, and lead to a lot
of skipping in case of an accurate seek.

Seungha Yang authored Dec 26, 2019 and GStreamer Marge Bot committed Dec 31, 2019

Some DPB management implementation is taken from gstreamer-vaapi

Seungha Yang authored Dec 20, 2019 and GStreamer Marge Bot committed Dec 31, 2019

Based on gstreamer-vaapi and Chromium implemetation.

Seungha Yang authored Dec 26, 2019 and GStreamer Marge Bot committed Dec 31, 2019

New decoder implementation based on dxva2 on d3d11 APIs. The DPB
management implementation is taken from Chromium.

Seungha Yang authored Dec 20, 2019 and GStreamer Marge Bot committed Dec 31, 2019

A ID3D11Texture2D memory can consist of multiple planes with array.
For array typed memory, GstD3D11Allocator will allocate new GstD3D11Memory
with increased reference count to the ID3D11Texture2D but different array index.

Stéphane Cerveau authored Dec 18, 2019 and Thibault Saunier committed Dec 30, 2019

Use helper method to get string from GValue.

Sebastian Dröge authored Dec 30, 2019 and Sebastian Dröge committed Dec 30, 2019

Only warn if pushing a buffer returns an actual error to not pollute
logs with confusing warnings.

Sebastian Dröge authored Dec 27, 2019 and Sebastian Dröge committed Dec 30, 2019

If one of the inputs is live, add a latency of 2 frames to the video
stream and wait on the clock for that much time to pass to allow for the
LTC audio to be ahead.

In case of live LTC, don't do any waiting but only ensure that we don't
overflow the LTC queue.

Also in non-live LTC audio mode, flush too old items from the LTC queue
if the video is actually ahead instead of potentially waiting forever.
This could've happened if there was a bigger gap in the video stream.

Even if one of downstream d3d11 elements can support dynamic-usage memory,
another one might not support it. Also, to support dynamic-usage,
both upstream and downstream d3d11device must be the same object.

If d3d11colorconvert element is configured, do color space conversion
regardless of the device type whether it's S/W emulation or real H/W.
Since d3d11colorconvert is no more a child of d3d11videosinkbin,
we don't need this behavior. Note that previous code was added to
avoid color space conversion from d3d11videosink if no hardware
device is available (S/W emulation of d3d11 is too slow).

d3d11upload should be able to support upstream d3d11 memory, not only system memory.

Fix for following pipeline
d3d11upload ! "video/x-raw(memory:D3D11Memory)" ! d3d11videosink

Since we might draw on partial area of backbuffer in case of force-aspect-ratio,
presenting only updated area is more efficient way.

See also https://docs.microsoft.com/ko-kr/windows/win32/direct3ddxgi/dxgi-1-2-presentation-improvements

Add d3d11overlaycompositor object to draw overlay image
on render target using Blend method.

Note that dxgi and d3d11 sdk debug will be enabled on debug build

Create CUDA context per device, instead of per codec and encoder/decoder.
Allocating CUDA context is heavy operation so we should reuse it
as much as possible.

Fixes: gstreamer/gst-plugins-bad#1130

Seungha Yang authored Dec 20, 2019 and GStreamer Marge Bot committed Dec 22, 2019

Posting any message to parent seems to be pointless. That might break
parent window.
Regardless of the posting, parent window can catch mouse event
and also any keyboard events will be handled by parent window by default.

Aaron Boxer authored Nov 11, 2019 and GStreamer Marge Bot committed Dec 22, 2019

Following the standard for low latency JPEG 2000 encoding
https://www.itu.int/rec/dologin_pub.asp?lang=e&id=T-REC-H.222.0-200701-S!Amd1!PDF-E&type=items
we divide the image into stripes of a specified height, and encode
each stripe as a self-contained JPEG 2000 image. This MR is based on
gstreamer/gst-plugins-base!429

Yeongjin Jeong authored Mar 23, 2019 and GStreamer Marge Bot committed Dec 20, 2019

The SVT-HEVC (Scalable Video Technology[0] for HEVC) Encoder is an
open source video coding technology[1] that is highly optimized for
Intel Xeon Scalable processors and Intel Xeon D processors.

[0] https://01.org/svt
[1] https://github.com/OpenVisualCloud/SVT-HEVC

Yeongjin Jeong authored Sep 30, 2019 and GStreamer Marge Bot committed Dec 20, 2019

It makes more simplifies the conversion between GstH265Profile and string.

Upload CPU memory to texture directly by using dynamic usage texture.
This will reduce at least one step of staging copy per frame.

Otherwise CPU cannot access texture via gst_memory_map()

The output of d3d11colorconvert would be used for rendering (i.e., shader resource)

Call DXGI API from window thread as much as possible

This is fork of win32-videooverlay in -base but more d3d11videosink specific one.

borderless top-most style full screen mode support.
Basically fullscreen toggle mode is disabled by default. To enable it
use "fullscreen-toggle-mode" property to allow fullscreen mode change
by user input and/or property.

In some cases, rendering and dxgi (e.g., swapchain) APIs should be
called from window message pump thread, but current design (dedicated d3d11 thread)
make it impossible. To solve it, change concurrency model to locking based one
from single-thread model.

flip-sequential is more efficient than discard

We don't need to hold it

That's recommended way from MS and CreateSwapChainForHwnd supports
more options than CreateSwapChain

As the recommendation from MS.

Disable full screen mode change until proper handling is implemented