vdpau: error in H.264 decoder reference frame handling [patch]

Submitted by Steven Robertson

Link to original bug (#664653)

Description

Created attachment 202008
Patch

The VDPAU H.264 decoder violates the spec in the way it handles marking frames as unused for short-term reference. This results in corruption and playback errors for some videos. Here's an example video:

http://isis.strobe.cc:8080/22402%3d11977.mkv

Patch attached.

Patch 202008, "Patch":
0001-vdpau-use-modular-arithmetic-for-frame-numbers.patch