Commit 7a4ffb49 authored by Robert Swain's avatar Robert Swain
Browse files

docs: Add an interlaced video design document

parent 17bd3da4
Interlaced Video
================
Video buffers have a number of states identifiable through a combination of caps
and buffer flags.
Possible states:
- Progressive
- Interlaced
- Plain
- One field
- Two fields
- Three fields - this should be a progressive buffer with a repeated 'first'
field that can be used for telecine pulldown
- Telecine
- One field
- Two fields
- Progressive
- Interlaced (a.k.a. 'mixed'; the fields are from different frames)
- Three fields - this should be a progressive buffer with a repeated 'first'
field that can be used for telecine pulldown
Note: it can be seen that the different between the plain interlaced and
telecine states is that in the telecine state, buffers containing two fields may
be progressive.
Tools for identification:
- Caps
- interlaced - boolean
- interlacing-method - string - "unknown"/"telecine"
- Flags - GST_VIDEO_BUFFER_...
- TFF
- RFF
- ONEFIELD
- PROGRESSIVE
Identification of Buffer States
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Note that flags are not necessarily interpreted in the same way for all
different states nor are they necessarily required nor make sense in all cases.
Progressive
...........
If the caps have no interlaced field, or have interlaced=false, then the buffer
is progressive. Note the possibility for progressive buffers in telecine streams
as well.
Plain Interlaced
................
If the caps have interlaced=true and either do not contain the
interlacing-method field or contain interlacing-method=unknown, then the buffer
is plain interlaced.
GST_VIDEO_BUFFER_TFF indicates whether the top or bottom field is to be
displayed first. The timestamp on the buffer corresponds to the first field.
(FIXME - is the duration of the buffer the duration of both fields; each field's
duration is half the buffer duration)
GST_VIDEO_BUFFER_RFF indicates that the first field (indicated by the TFF flag)
should be repeated. This is generally only used for telecine purposes but as the
telecine state was added long after the interlaced state was added and defined,
this flag remains valid for plain interlaced buffers.
GST_VIDEO_BUFFER_ONEFIELD means that only the field indicated through the TFF
flag is to be used. The other field should be ignored.
Telecine
........
If the caps have interlaced=true and interlacing-method=telecine then the
buffers are in some form of telecine state.
The TFF, RFF and ONEFIELD flags have the same semantics as for the plain
interlaced state, however, for the telecine state require one additional flag to
be able to identify progressive buffers.
GST_VIDEO_BUFFER_PROGRESSIVE means that the buffer containing two fields is a
progressive frame. The implication is that if this flag is not set, the buffer
is an 'interlaced' or 'mixed' buffer that contains two fields that, when
combined with fields from adjacent buffers, allow reconstruction of progressive
frames.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment