Low delay concept in multi-layered video coding

An encoder comprising a processor configured to encode video content into a plurality of layers of a multi-layered video data stream, the multi-layered video data stream including a sequence of network abstraction layer (NAL) units, which are divided into a sequence of access units,

• wherein each access unit includes a plurality of decoding units, with each decoding unit of the plurality of decoding units having at least one NAL unit corresponding to one layer of the plurality of layers,
• wherein the encoder is configured to encode first timing control information and second timing control information into the multi-layered video data stream,
• the first timing control information signaling a first decoder buffer retrieval time for an access unit from the sequence of access units,
• the second timing control information, separate from the first timing control information, signaling a second decoder buffer retrieval time for each decoding unit of a particular access unit according to a particular order of the respective decoding unit in the multi-layered video data stream.

A method for encoding video content into a plurality of layers of a multi-layered video data stream, the multi-layered video data stream including a sequence of network abstraction layer (NAL) units that are divided into a sequence of access units, comprising:

• encoding first timing control information and second timing control information into the multi-layered video data stream, wherein:
• each access unit includes a plurality of decoding units, with each decoding unit of the plurality of decoding units having at least one NAL unit corresponding to one layer of the plurality of layers,
• the first timing control information signals a first decoder buffer retrieval time for an access unit from the sequence of access units, and
• the second timing control information, separate from the first timing control information, signals a second decoder buffer retrieval time for each decoding unit of a particular access unit according to a particular order of the respective decoding unit in the multi-layered video data stream.