Commit 740d3507 authored by Sebastian Dröge's avatar Sebastian Dröge 🍵

Release 1.8.0

parent e7403d08
=== release 1.8.0 ===
2016-03-24 Sebastian Dröge <slomo@coaxion.net>
* configure.ac:
releasing 1.8.0
2016-03-23 13:43:46 +0100 Thibault Saunier <tsaunier@gnome.org>
* ext/vulkan/vkinstance.c:
vulkan: Minor string fix
2016-03-23 22:13:47 +1100 Matthew Waters <matthew@centricular.com>
* ext/vulkan/vkinstance.c:
vulkan: VK_API_VERSION has been removed
In a stable release too, naughty.
Use VK_API_VERSION_1_0 instead
https://bugzilla.gnome.org/show_bug.cgi?id=764066
2016-03-22 07:20:59 +0000 Matthew Waters <matthew@centricular.com>
* gst-libs/gst/gl/glprototypes/sync.h:
gl/proto: sync operations are available on GLES 3.0
Without the GST_GL_API_GLES2 bit set, we will not even attempt to look
for the function pointers in the core library and will fallback to
glFlush/glFinish.
2016-03-22 07:16:34 +0000 Matthew Waters <matthew@centricular.com>
* configure.ac:
gl/build: add GST_GL_HAVE_DMABUF to gstglconfig.h
it's exposed in public API so hiding it in an AC_DEFINE for config.h only
works when building libgstgl itself. Attempting to use libgstgl (especially
on egl platforms) will throw a compilation error.
2016-03-21 15:22:15 +0900 Jimmy Ohn <yongjin.ohn@lge.com>
* gst/mxf/mxfdemux.c:
mxfdemux: Fix query memory leak
Peer query isn't being freed in case of GST_QUERY_SEEKING.
https://bugzilla.gnome.org/show_bug.cgi?id=763974
2016-03-18 19:45:09 +0200 Sebastian Dröge <sebastian@centricular.com>
* ext/vulkan/Makefile.am:
vulkan: Ship missing headers with tarballs
https://bugzilla.gnome.org/show_bug.cgi?id=763877
2016-03-17 19:24:32 +0000 Aleksander Wabik <awabik@opera.com>
* gst/videoparsers/gsth264parse.c:
* gst/videoparsers/gsth265parse.c:
h264parse, h265parse: fix handling of downstream force-key-unit events
The parser handles the downstream force-key-unit event incorrectly,
it tries to parse it as an upstream force-key-unit event, does not
check the return value, and then uses uninitialized memory in
"all_headers" boolean variable.
https://bugzilla.gnome.org/show_bug.cgi?id=763793
2016-03-17 22:43:12 +1100 Matthew Waters <matthew@centricular.com>
* gst-libs/gst/gl/gstglmemory.c:
glmemory: unset GL_UNPACK_ROW_LENGTH in opengl3
If the user uploads their own texture without setting the unpack length, then
then the result will have the appearance of stride mismanagement due to
an incorrect row length.
2016-03-17 16:34:42 +1100 Matthew Waters <matthew@centricular.com>
* tests/examples/gl/qt/mousevideooverlay/main.cpp:
* tests/examples/gl/qt/qglwidgetvideooverlay/main.cpp:
* tests/examples/gl/qt/qglwtextureshare/main.cpp:
gl/examples/qt: restrict the GL API to opengl where needed
Until the examples are ported to opengl3/gles2, they will not work with any
other GL api.
2016-03-17 16:31:52 +1100 Matthew Waters <matthew@centricular.com>
* tests/examples/gl/gtk/filtervideooverlay/Makefile.am:
* tests/examples/gl/gtk/filtervideooverlay/main.cpp:
* tests/examples/gl/gtk/fxtest/Makefile.am:
* tests/examples/gl/gtk/fxtest/fxtest.c:
* tests/examples/gl/gtk/fxtest/pixbufdrop.c:
* tests/examples/gl/gtk/gtkvideooverlay/Makefile.am:
* tests/examples/gl/gtk/gtkvideooverlay/main.cpp:
gl/examples/gtk: call XInitThreads
Fixes some sporadic X11 threading assertions.
2016-03-17 03:06:05 +1100 Matthew Waters <matthew@centricular.com>
* gst-libs/gst/gl/gstglutils.c:
glutils: remove custom code for setting caps features
Just use gst_caps_set_features() instead.
2016-03-17 01:52:00 +1100 Matthew Waters <matthew@centricular.com>
* gst-libs/gst/gl/gstglfilter.c:
glfilter: only allow the same src/sink caps when we are in passthrough mode
If we are given caps with extra features (like the overlay composition
features), we can only deal with that when we are in passthrough mode.
Previously we were bailing entirely and not allowing passthrough filter elements
with things like textoverlay.
Fixes the following pipeline (assuming glfilter supports passthrough):
gl ! textoverlay ! glfilter ! ... ! glimagesinkelement
https://bugzilla.gnome.org/show_bug.cgi?id=763756
2016-03-16 22:48:00 +1100 Matthew Waters <matthew@centricular.com>
* gst-libs/gst/gl/gstglupload.c:
glupload: deal with the ANY caps feature correctly
When transforming, xplode it out into the necessary caps features both
with and without the passthough features.
Fixes negotiation in the following class of pipelines:
gl ! textoverlay ! glupload ! glimagesinkelement
https://bugzilla.gnome.org/show_bug.cgi?id=763756
2016-03-16 22:19:25 +1100 Matthew Waters <matthew@centricular.com>
* ext/wayland/wldisplay.c:
wayland: fix null pointer dereference on error
gnome-shell doesn't the support wl_scaler interface which makes creating a
wayland display fail creation.
Found in the generic state changes test
2016-03-16 22:16:34 +1100 Matthew Waters <matthew@centricular.com>
* ext/gl/gstglstereomix.c:
* ext/gl/gstglstereosplit.c:
glstereo{mix,split}: allow running on GLES 2/3
It's mostly supported for GLES 2.x, fully supported on GLES 3.x
2016-03-16 12:03:53 +0200 Sebastian Dröge <sebastian@centricular.com>
* sys/opensles/openslesringbuffer.c:
openslesringbuffer: Warn if the position reported by OpenSL is higher than what we queued up so far
This would hint at wrong position reporting, and apparently sometimes happens
after a seek.
2016-03-16 11:34:46 +0200 Sebastian Dröge <sebastian@centricular.com>
* gst/mxf/mxfjpeg2000.c:
mxfmux: Fix typo in JPEG2000 colorspace
sRGC -> sRGB
=== release 1.7.91 ===
2016-03-15 Sebastian Dröge <slomo@coaxion.net>
2016-03-15 12:13:17 +0200 Sebastian Dröge <sebastian@centricular.com>
* ChangeLog:
* NEWS:
* RELEASE:
* configure.ac:
releasing 1.7.91
* docs/plugins/gst-plugins-bad-plugins.hierarchy:
* docs/plugins/inspect/plugin-accurip.xml:
* docs/plugins/inspect/plugin-adpcmdec.xml:
* docs/plugins/inspect/plugin-adpcmenc.xml:
* docs/plugins/inspect/plugin-aiff.xml:
* docs/plugins/inspect/plugin-asfmux.xml:
* docs/plugins/inspect/plugin-assrender.xml:
* docs/plugins/inspect/plugin-audiomixer.xml:
* docs/plugins/inspect/plugin-audiovisualizers.xml:
* docs/plugins/inspect/plugin-autoconvert.xml:
* docs/plugins/inspect/plugin-bayer.xml:
* docs/plugins/inspect/plugin-bz2.xml:
* docs/plugins/inspect/plugin-camerabin.xml:
* docs/plugins/inspect/plugin-chromaprint.xml:
* docs/plugins/inspect/plugin-coloreffects.xml:
* docs/plugins/inspect/plugin-curl.xml:
* docs/plugins/inspect/plugin-dataurisrc.xml:
* docs/plugins/inspect/plugin-debugutilsbad.xml:
* docs/plugins/inspect/plugin-dtsdec.xml:
* docs/plugins/inspect/plugin-dvb.xml:
* docs/plugins/inspect/plugin-dvbsuboverlay.xml:
* docs/plugins/inspect/plugin-dvdspu.xml:
* docs/plugins/inspect/plugin-faad.xml:
* docs/plugins/inspect/plugin-festival.xml:
* docs/plugins/inspect/plugin-fieldanalysis.xml:
* docs/plugins/inspect/plugin-flite.xml:
* docs/plugins/inspect/plugin-frei0r.xml:
* docs/plugins/inspect/plugin-gaudieffects.xml:
* docs/plugins/inspect/plugin-gdp.xml:
* docs/plugins/inspect/plugin-geometrictransform.xml:
* docs/plugins/inspect/plugin-gmedec.xml:
* docs/plugins/inspect/plugin-gsm.xml:
* docs/plugins/inspect/plugin-gstsiren.xml:
* docs/plugins/inspect/plugin-hls.xml:
* docs/plugins/inspect/plugin-id3tag.xml:
* docs/plugins/inspect/plugin-inter.xml:
* docs/plugins/inspect/plugin-interlace.xml:
* docs/plugins/inspect/plugin-jpegformat.xml:
* docs/plugins/inspect/plugin-mimic.xml:
* docs/plugins/inspect/plugin-mms.xml:
* docs/plugins/inspect/plugin-modplug.xml:
* docs/plugins/inspect/plugin-mpeg2enc.xml:
* docs/plugins/inspect/plugin-mpegpsdemux.xml:
* docs/plugins/inspect/plugin-mpegpsmux.xml:
* docs/plugins/inspect/plugin-mpegtsdemux.xml:
* docs/plugins/inspect/plugin-mpegtsmux.xml:
* docs/plugins/inspect/plugin-mplex.xml:
* docs/plugins/inspect/plugin-ofa.xml:
* docs/plugins/inspect/plugin-openal.xml:
* docs/plugins/inspect/plugin-pcapparse.xml:
* docs/plugins/inspect/plugin-pnm.xml:
* docs/plugins/inspect/plugin-rawparse.xml:
* docs/plugins/inspect/plugin-removesilence.xml:
* docs/plugins/inspect/plugin-resindvd.xml:
* docs/plugins/inspect/plugin-rfbsrc.xml:
* docs/plugins/inspect/plugin-rtmp.xml:
* docs/plugins/inspect/plugin-schro.xml:
* docs/plugins/inspect/plugin-sdp.xml:
* docs/plugins/inspect/plugin-segmentclip.xml:
* docs/plugins/inspect/plugin-shm.xml:
* docs/plugins/inspect/plugin-smooth.xml:
* docs/plugins/inspect/plugin-soundtouch.xml:
* docs/plugins/inspect/plugin-spandsp.xml:
* docs/plugins/inspect/plugin-speed.xml:
* docs/plugins/inspect/plugin-subenc.xml:
* docs/plugins/inspect/plugin-videoparsersbad.xml:
* docs/plugins/inspect/plugin-voaacenc.xml:
* docs/plugins/inspect/plugin-voamrwbenc.xml:
* docs/plugins/inspect/plugin-waylandsink.xml:
* docs/plugins/inspect/plugin-y4mdec.xml:
* docs/plugins/inspect/plugin-zbar.xml:
* gst-plugins-bad.doap:
* win32/common/config.h:
Release 1.7.91
2016-03-15 11:56:59 +0200 Sebastian Dröge <sebastian@centricular.com>
* po/af.po:
* po/az.po:
* po/bg.po:
* po/ca.po:
* po/cs.po:
* po/da.po:
* po/de.po:
* po/el.po:
* po/en_GB.po:
* po/eo.po:
* po/es.po:
* po/eu.po:
* po/fi.po:
* po/fr.po:
* po/gl.po:
* po/hr.po:
* po/hu.po:
* po/id.po:
* po/it.po:
* po/ja.po:
* po/ky.po:
* po/lt.po:
* po/lv.po:
* po/mt.po:
* po/nb.po:
* po/nl.po:
* po/or.po:
* po/pl.po:
* po/pt_BR.po:
* po/ro.po:
* po/ru.po:
* po/sk.po:
* po/sl.po:
* po/sq.po:
* po/sr.po:
* po/sv.po:
* po/tr.po:
* po/uk.po:
* po/vi.po:
* po/zh_CN.po:
Update .po files
2016-03-12 15:44:54 +0000 Tim-Philipp Müller <tim@centricular.com>
This is GStreamer 1.7.91
# GStreamer 1.8 Release Notes
**GStreamer 1.8.0 was released on 24 March 2016.**
The GStreamer team is proud to announce a new major feature release in the
stable 1.x API series of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and other
improvements.
See [https://gstreamer.freedesktop.org/releases/1.8/][latest] for the latest
version of this document.
*Last updated: Thursday 24 March 2016, 10:00 UTC [(log)][gitlog]*
[latest]: https://gstreamer.freedesktop.org/releases/1.8/
[gitlog]: https://cgit.freedesktop.org/gstreamer/www/log/src/htdocs/releases/1.8/release-notes-1.8.md
## Highlights
- **Hardware-accelerated zero-copy video decoding on Android**
- **New video capture source for Android using the android.hardware.Camera API**
- **Windows Media reverse playback** support (ASF/WMV/WMA)
- **New tracing system** provides support for more sophisticated debugging tools
- **New high-level GstPlayer playback convenience API**
- **Initial support for the new [Vulkan][vulkan] API**, see
[Matthew Waters' blog post][vulkan-in-gstreamer] for more details
- **Improved Opus audio codec support**: Support for more than two channels; MPEG-TS demuxer/muxer can now handle Opus;
[sample-accurate][opus-sample-accurate] encoding/decoding/transmuxing with
Ogg, Matroska, ISOBMFF (Quicktime/MP4), and MPEG-TS as container;
[new codec utility functions for Opus header and caps handling][opus-codec-utils]
in pbutils library. The Opus encoder/decoder elements were also moved to
gst-plugins-base (from -bad), and the opus RTP depayloader/payloader to -good.
[opus-sample-accurate]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiometa.html#GstAudioClippingMeta
[opus-codec-utils]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstpbutilscodecutils.html
- **GStreamer VAAPI module now released and maintained as part of the GStreamer project**
[vulkan]: https://www.khronos.org/vulkan
[vulkan-in-gstreamer]: http://ystreet00.blogspot.co.uk/2016/02/vulkan-in-gstreamer.html
## Major new features and changes
### Noteworthy new API, features and other changes
- New GstVideoAffineTransformationMeta meta for adding a simple 4x4 affine
transformation matrix to video buffers
- [g\_autoptr()](https://developer.gnome.org/glib/stable/glib-Miscellaneous-Macros.html#g-autoptr)
support for all types is exposed in GStreamer headers now, in combination
with a sufficiently-new GLib version (i.e. 2.44 or later). This is primarily
for the benefit of application developers who would like to make use of
this, the GStreamer codebase itself will not be using g_autoptr() for
the time being due to portability issues.
- GstContexts are now automatically propagated to elements added to a bin
or pipeline, and elements now maintain a list of contexts set on them.
The list of contexts set on an element can now be queried using the new functions
[gst\_element\_get\_context()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstElement.html#gst-element-get-context)
and [gst\_element\_get\_contexts()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstElement.html#gst-element-get-contexts). GstContexts are used to share context-specific configuration objects
between elements and can also be used by applications to set context-specific
configuration objects on elements, e.g. for OpenGL or Hardware-accelerated
video decoding.
- New [GST\_BUFFER\_DTS\_OR\_PTS()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstBuffer.html#GST-BUFFER-DTS-OR-PTS:CAPS)
convenience macro that returns the decode timestamp if one is set and
otherwise returns the presentation timestamp
- New GstPadEventFullFunc that returns a GstFlowReturn instead of a gboolean.
This new API is mostly for internal use and was added to fix a race condition
where occasionally internal flow error messages were posted on the bus when
sticky events were propagated at just the wrong moment whilst the pipeline
was shutting down. This happened primarily when the pipeline was shut down
immediately after starting it up. GStreamer would not know that the reason
the events could not be propagated was because the pipeline was shutting down
and not some other problem, and now the flow error allows GStreamer to know
the reason for the failure (and that there's no reason to post an error
message). This is particularly useful for queue-like elements which may need
to asynchronously propagate a previous flow return from downstream.
- Pipeline dumps in form of "dot files" now also show pad properties that
differ from their default value, the same as it does for elements. This is
useful for elements with pad subclasses that provide additional properties,
e.g. videomixer or compositor.
- Pad probes are now guaranteed to be called in the order they were added
(before they were called in reverse order, but no particular order was
documented or guaranteed)
- Plugins can now have dependencies on device nodes (not just regular files)
and also have a prefix filter. This is useful for plugins that expose
features (elements) based on available devices, such as the video4linux
plugin does with video decoders on certain embedded systems.
- gst\_segment\_to\_position() has been deprecated and been replaced by the
better-named gst\_segment\_position\_from\_running\_time(). At the same time
gst\_segment\_position\_from\_stream\_time() was added, as well as \_full()
variants of both to deal with negative stream time.
- GstController: the interpolation control source gained a new monotonic cubic
interpolation mode that, unlike the existing cubic mode, will never overshoot
the min/max y values set.
- GstNetAddressMeta: can now be read from buffers in language bindings as well,
via the new gst\_buffer\_get\_net\_address\_meta() function
- ID3 tag PRIV frames are now extraced into a new GST\_TAG\_PRIVATE\_DATA tag
- gst-launch-1.0 and gst\_parse\_launch() now warn in the most common case if
a dynamic pad link could not be resolved, instead of just silently
waiting to see if a suitable pad appears later, which is often perceived
by users as hanging -- they are now notified when this happens and can check
their pipeline.
- GstRTSPConnection now also parses custom RTSP message headers and retains
them for the application instead of just ignoring them
- rtspsrc handling of authentication over tunneled connections (e.g. RTSP over HTTP)
was fixed
- gst\_video\_convert\_sample() now crops if there is a crop meta on the input buffer
- The debugging system printf functions are now exposed for general use, which
supports special printf format specifiers such as GST\_PTR\_FORMAT and
GST\_SEGMENT\_FORMAT to print GStreamer-related objects. This is handy for
systems that want to prepare some debug log information to be output at a
later point in time. The GStreamer-OpenGL subsystem is making use of these
new functions, which are [gst\_info\_vasprintf()][gst_info_vasprintf],
[gst\_info\_strdup\_vprintf()][gst_info_strdup_vprintf] and
[gst\_info\_strdup\_printf()][gst_info_strdup_printf].
- videoparse: "strides", "offsets" and "framesize" properties have been added to
allow parsing raw data with strides and padding that do not match GStreamer
defaults.
- GstPreset reads presets from the directories given in GST\_PRESET\_PATH now.
Presets are read from there after presets in the system path, but before
application and user paths.
[gst_info_vasprintf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-vasprintf
[gst_info_strdup_vprintf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-strdup-vprintf
[gst_info_strdup_printf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-strdup-printf
### New Elements
- [netsim](): a new (resurrected) element to simulate network jitter and
packet dropping / duplication.
- New VP9 RTP payloader/depayloader elements: rtpvp9pay/rtpvp9depay
- New [videoframe_audiolevel]() element, a video frame synchronized audio level element
- New spandsp-based tone generator source
- New NVIDIA NVENC-based H.264 encoder for GPU-accelerated video encoding on
suitable NVIDIA hardware
- [rtspclientsink](), a new RTSP RECORD sink element, was added to gst-rtsp-server
- [alsamidisrc](), a new ALSA MIDI sequencer source element
### Noteworthy element features and additions
- *identity*: new ["drop-buffer-flags"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-identity.html#GstIdentity--drop-buffer-flags)
property to drop buffers based on buffer flags. This can be used to drop all
non-keyframe buffers, for example.
- *multiqueue*: various fixes and improvements, in particular special handling
for sparse streams such as substitle streams, to make sure we don't overread
them any more. For sparse streams it can be normal that there's no buffer for
a long period of time, so having no buffer queued is perfectly normal. Before
we would often unnecessarily try to fill the subtitle stream queue, which
could lead to much more data being queued in multiqueue than necessary.
- *multiqueue*/*queue*: When dealing with time limits, these elements now use the
new ["GST_BUFFER_DTS_OR_PTS"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstBuffer.html#GST-BUFFER-DTS-OR-PTS:CAPS)
and ["gst_segment_to_running_time_full()"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstSegment.html#gst-segment-to-running-time-full)
API, resulting in more accurate levels, especially when dealing with non-raw
streams (where reordering happens, and we want to use the increasing DTS as
opposed to the non-continuously increasing PTS) and out-of-segment input/output.
Previously all encoded buffers before the segment start, which can happen when
doing ACCURATE seeks, were not taken into account in the queue level calculation.
- *multiqueue*: New ["use-interleave"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-multiqueue.html#GstMultiQueue--use-interleave)
property which allows the size of the queues to be optimized based on the input
streams interleave. This should only be used with input streams which are properly
timestamped. It will be used in the future decodebin3 element.
- *queue2*: new ["avg-in-rate"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-queue2.html#GstQueue2--avg-in-rate)
property that returns the average input rate in bytes per second
- audiotestsrc now supports all audio formats and is no longer artificially
limited with regard to the number of channels or sample rate
- gst-libav (ffmpeg codec wrapper): map and enable JPEG2000 decoder
- multisocketsink can, on request, send a custom GstNetworkMessage event
upstream whenever data is received from a client on a socket. Similarly,
socketsrc will, on request, pick up GstNetworkMessage events from downstream
and send any data contained within them via the socket. This allows for
simple bidirectional communication.
- matroska muxer and demuxer now support the ProRes video format
- Improved VP8/VP9 decoding performance on multi-core systems by enabling
multi-threaded decoding in the libvpx-based decoders on such systems
- appsink has a new ["wait-on-eos"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-plugins/html/gst-plugins-base-plugins-appsink.html#GstAppSink--wait-on-eos)
property, so in cases where it is uncertain if an appsink will have a consumer for
its buffers when it receives an EOS this can be set to FALSE to ensure that the
appsink will not hang.
- rtph264pay and rtph265pay have a new "config-interval" mode -1 that will
re-send the setup data (SPS/PPS/VPS) before every keyframe to ensure
optimal coverage and the shortest possibly start-up time for a new client
- mpegtsmux can now mux H.265/HEVC video as well
- The MXF muxer was ported to 1.x and produces more standard conformant files now
that can be handled by more other software; The MXF demuxer got improved
support for seek tables (IndexTableSegments).
### Plugin moves
- The rtph265pay/depay RTP payloader/depayloader elements for H.265/HEVC video
from the rtph265 plugin in -bad have been moved into the existing rtp plugin
in gst-plugins-good.
- The mpg123 plugin containing a libmpg123 based audio decoder element has
been moved from -bad to -ugly.
- The Opus encoder/decoder elements have been moved to gst-plugins-base and
the RTP payloader to gst-plugins-good, both coming from gst-plugins-bad.
### New tracing tools for developers
A new tracing subsystem API has been added to GStreamer, which provides
external tracers with the possibility to strategically hook into GStreamer
internals and collect data that can be evaluated later. These tracers are a
new type of plugin features, and GStreamer core ships with a few example
tracers (latency, stats, rusage, log) to start with. Tracers can be loaded
and configured at start-up via an environment variable (GST\_TRACER\_PLUGINS).
Background: While GStreamer provides plenty of data on what's going on in a
pipeline via its debug log, that data is not necessarily structured enough to
be generally useful, and the overhead to enable logging output for all data
required might be too high in many cases. The new tracing system allows tracers
to just obtain the data needed at the right spot with as little overhead as
possible, which will be particularly useful on embedded systems.
Of course it has always been possible to do performance benchmarks and debug
memory leaks, memory consumption and invalid memory access using standard
operating system tools, but there are some things that are difficult to track
with the standard tools, and the new tracing system helps with that. Examples
are things such as latency handling, buffer flow, ownership transfer of
events and buffers from element to element, caps negotiation, etc.
For some background on the new tracing system, watch Stefan Sauer's
GStreamer Conference talk ["A new tracing subsystem for GStreamer"][tracer-0]
and for a more specific example how it can be useful have a look at
Thiago Santos's lightning talk ["Analyzing caps negotiation using GstTracer"][tracer-1]
and his ["GstTracer experiments"][tracer-2] blog post. There was also a Google
Summer of Code project in 2015 that used tracing system for a graphical
GStreamer debugging tool ["gst-debugger"][tracer-3].
This is all still very much work in progress, but we hope this will provide the
foundation for a whole suite of new debugging tools for GStreamer pipelines.
[tracer-0]: https://gstconf.ubicast.tv/videos/a-new-tracing-subsystem-for-gstreamer/
[tracer-1]: https://gstconf.ubicast.tv/videos/analyzing-caps-negotiation-using-gsttracer/
[tracer-2]: http://blog.thiagoss.com/2015/07/23/gsttracer-experiments/
[tracer-3]: https://git.gnome.org/browse/gst-debugger
### GstPlayer: a new high-level API for cross-platform multimedia playback
GStreamer has had reasonably high-level API for multimedia playback
in the form of the playbin element for a long time. This allowed application
developers to just configure a URI to play, and playbin would take care of
everything else. This works well, but there is still way too much to do on
the application-side to implement a fully-featured playback application, and
too much general GStreamer pipeline API exposed, making it less accessible
to application developers.
Enter GstPlayer. GstPlayer's aim is to provide an even higher-level abstraction
of a fully-featured playback API but specialised for its specific use case. It
also provides easy integration with and examples for Gtk+, Qt, Android, OS/X,
iOS and Windows. Watch Sebastian's [GstPlayer talk at the GStreamer Conference][gstplayer-talk]
for more information, or check out the [GstPlayer API reference][gstplayer-api]
and [GstPlayer examples][gstplayer-examples].
[gstplayer-api]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/player.html
[gstplayer-talk]: https://gstconf.ubicast.tv/videos/gstplayer-a-simple-cross-platform-api-for-all-your-media-playback-needs-part-1/
[gstplayer-examples]: https://github.com/sdroege/gst-player/
### Adaptive streaming: DASH, HLS and MSS improvements
- dashdemux now supports loading external xml nodes pointed from its MPD.
- Content protection nodes parsing support for PlayReady WRM in mssdemux.
- Reverse playback was improved to respect seek start and stop positions.
- Adaptive demuxers (hlsdemux, dashdemux, mssdemux) now support the SNAP_AFTER
and SNAP_BEFORE seek flags which will jump to the nearest fragment boundary
when executing a seek, which means playback resumes more quickly after a seek.
### Audio library improvements
- audio conversion, quantization and channel up/downmixing functionality
has been moved from the audioconvert element into the audio library and
is now available as public API in form of [GstAudioConverter][audio-0],
[GstAudioQuantize][audio-1] and [GstAudioChannelMixer][audio-2].
Audio resampling will follow in future releases.
- [gst\_audio\_channel\_get\_fallback\_mask()][audio-3] can be used
to retrieve a default channel mask for a given number of channels as last
resort if the layout is unknown
- A new [GstAudioClippingMeta][audio-4] meta was added for specifying clipping
on encoded audio buffers
- A new GstAudioVisualizer base class for audio visualisation elements;
most of the existing visualisers have been ported over to the new base class.
This new base class lives in the pbutils library rather than the audio library,
since we'd have had to make libgstaudio depend on libgstvideo otherwise,
which was deemed undesirable.
[audio-0]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-GstAudioConverter.html
[audio-1]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-GstAudioQuantize.html
[audio-2]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiochannels.html#gst-audio-channel-mix-new
[audio-3]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiochannels.html#gst-audio-channel-get-fallback-mask
[audio-4]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiometa.html#GstAudioClippingMeta
### GStreamer OpenGL support improvements
#### Better OpenGL Shader support
[GstGLShader][shader] has been revamped to allow more OpenGL shader types
by utilizing a new GstGLSLStage object. Each stage holds an OpenGL pipeline
stage such as a vertex, fragment or a geometry shader that are all compiled
separately into a program that is executed.
The glshader element has also received a revamp as a result of the changes in
the library. It does not take file locations for the vertex and fragment
shaders anymore. Instead it takes the strings directly leaving the file
management to the application.
A new [example][liveshader-example] was added utilizing the new shader
infrastructure showcasing live shader edits.
[shader]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/gst-plugins-bad-libs-gstglshader.html
[liveshader-example]: https://cgit.freedesktop.org/gstreamer/gst-plugins-bad/tree/tests/examples/gtk/glliveshader.c
#### OpenGL GLMemory rework
[GstGLMemory] was extensively reworked to support the addition of multiple
texture targets required for zero-copy integration with the Android
MediaCodec elements. This work was also used to provide IOSurface based
GLMemory on OS X for zero-copy with OS X's VideoToolbox decoder (vtdec) and
AV Foundation video source (avfvideosrc). There are also patches in bugzilla
for GstGLMemoryEGL specifically aimed at improving the decoding performance on
the Raspberry Pi.
[GstGLMemory]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/gst-plugins-bad-libs-gstglmemory.html
A texture-target field was added to video/x-raw(memory:GLMemory) caps to signal
the texture target contained in the GLMemory. Its values can be 2D, rectangle
or external-oes. glcolorconvert can convert between the different formats as
required and different elements will accept or produce different targets. e.g.
glimagesink can take and render external-oes textures directly as required for
effecient zero-copy on android.
A generic GL allocation framework was also implemented to support the generic
allocation of OpenGL buffers and textures which is used extensively by
GstGLBufferPool.
#### OpenGL DMABuf import uploader
There is now a DMABuf uploader available for automatic selection that will
attempt to import the upstream provided DMABuf. The uploader will import into
2D textures with the necesarry format. YUV to RGB conversion is still provided
by glcolorconvert to avoid the laxer restrictions with external-oes textures.
#### OpenGL queries
Queries of various aspects of the OpenGL runtime such as timers, number of
samples or the current timestamp are not possible. The GstGLQuery object uses a
delayed debug system to delay the debug output to later to avoid expensive calls
to the glGet\* family of functions directly after finishing a query. It is
currently used to output the time taken to perform various operations of texture
uploads and downloads in GstGLMemory.
#### New OpenGL elements
glcolorbalance has been created mirroring the videobalance elements.
glcolorbalance provides the exact same interface as videobalance so can be used
as a GPU accelerated replacement. glcolorbalance has been added to glsinkbin so
usage with playsink/playbin will use it automatically instead of videobalance
where possible.
glvideoflip, which is the OpenGL equiavalant of videoflip, implements the exact
same interface and functionality as videoflip.
#### EGL implementation now selects OpenGL 3.x
The EGL implementation can now select OpenGL 3.x contexts.
#### OpenGL API removal
The GstGLDownload library object was removed as it was not used by anything.
Everything is performed by GstGLMemory or in the gldownloadelement.
The GstGLUploadMeta library object was removed as it was not being used and we
don't want to promote the use of GstVideoGLTextureUploadMeta.
#### OpenGL: Other miscellaneous changes
- The EGL implementation can now select OpenGL 3.x contexts. This brings
OpenGL 3.x to e.g. wayland and other EGL systems.
- glstereomix/glstereosplit are now built and are usable on OpenGL ES systems
- The UYVY/YUY2 to RGBA and RGBA to UYVY/YUY2 shaders were fixed removing the
sawtooth pattern and luma bleeding.
- We now utilize the GL\_APPLE\_sync extension on iOS devices which improves
performance of OpenGL applications, especially with multiple OpenGL
contexts.
- glcolorconvert now uses a bufferpool to avoid costly
glGenTextures/glDeleteTextures for every frame.
- glvideomixer now has full glBlendFunc and glBlendEquation support per input.
- gltransformation now support navigation events so your weird transformations
also work with DVD menus.
- qmlglsink can now run on iOS, OS X and Android in addition to the already
supported Linux platform.
- glimagesink now posts unhandled keyboard and mouse events (on backends that
support user input, current only X11) on the bus for the application.
### Initial GStreamer Vulkan support
Some new elements, vulkansink and vulkanupload have been implemented utilizing
the new Vulkan API. The implementation is currently limited to X11 platforms
(via xcb) and does not perform any scaling of the stream's contents to the size
of the available output.
A lot of infrasctructure work has been undertaken to support using Vulkan in
GStreamer in the future. A number of GstMemory subclasses have been created for
integrating Vulkan's GPU memory handling along with VkBuffer's and VkImage's
that can be passed between elements. Some GStreamer refcounted wrappers for
global objects such as VkInstance, VkDevice, VkQueue, etc have also been
implemented along with GstContext integration for sharing these objects with the
application.
### GStreamer VAAPI support for hardware-accelerated video decoding and encoding on Intel (and other) platforms
#### GStreamer VAAPI is now part of upstream GStreamer
The GStreamer-VAAPI module which provides support for hardware-accelerated
video decoding, encoding and post-processing on Intel graphics hardware
on Linux has moved from its previous home at the [Intel Open Source Technology Center][iostc]
to the upstream GStreamer repositories, where it will in future be maintained
as part of the upstream GStreamer project and released in lockstep with the
other GStreamer modules. The current maintainers will continue to spearhead
the development at the new location:
[http://cgit.freedesktop.org/gstreamer/gstreamer-vaapi/][gst-vaapi-git]
[gst-vaapi-git]: http://cgit.freedesktop.org/gstreamer/gstreamer-vaapi/
GStreamer-VAAPI relies heavily on certain GStreamer infrastructure API that
is still in flux such as the OpenGL integration API or the codec parser
libraries, and one of the goals of the move was to be able to leverage
new developments early and provide tighter integration with the latest
developments of those APIs and other graphics-related APIs provided by
GStreamer, which should hopefully improve performance even further and in