Broadcast Streaming of Panoramic Video for Interactive Clients

A stream demultiplexer, comprising:

• a data stream former configured to selectively extract at least two separate substreams from a group of separate substreams, the at least two separate substreams comprising encoded data coding different spatial segments or different groups of subsequent spatial segments of a video picture of a video stream, wherein the data stream former is configured to combine the at least two separate substreams to a data stream comprising the encoded data coding the different spatial segments or different groups of subsequent spatial segments of the video picture of the video stream;
• and
• an output interface configured to provide the data stream.

An encoder configured to encode a video picture of a video stream by encoding at least two different spatial segments or different groups of subsequent spatial segments of the video picture of the video stream such that the encoded data comprises at least two slices;

• wherein the encoder is configured to provide a signaling information indicating whether a coding constraint is fulfilled;
• wherein the coding constraint is fulfilled when removing at least one slice header of the at least two slices while maintaining a slice header of the first slice of the at least two slices with respect to a coding order and concatenating the at least two slices or a proper subset of the at least two slices using the first slice header results in a standard conformant data stream.

A method for stream multiplexing, the method comprising:

• receiving encoded data for each of at least two different spatial segments or different groups of subsequent spatial segments of video pictures of a video stream;
• and
• packetizing the encoded data for each of the at least two different spatial segments or different groups of spatial segments into separate substreams.

A method for stream demultiplexing, the method comprising:

• selectively extracting at least two separate substreams from a group of separate substreams, the at least two separate substreams comprising encoded data coding different spatial segments or different groups of subsequent spatial segments of a video picture of the video stream;
• and
• combining the at least two separate substreams to a data stream comprising the encoded data coding the different spatial segments or different groups of subsequent spatial segments of a video picture of the video stream.

A group of separate substreams, wherein each of the separate substreams comprise encoded data coding different spatial segments or different groups of subsequent spatial segments of a video picture of a video stream.

An encoded video stream, wherein the encoded video stream comprises encoded data coding at least two different spatial segments or different groups of subsequent spatial segments of the video picture of the video stream using at least two slices;

• wherein the encoded video stream comprises a signaling information indicating whether a coding constraint is fulfilled;
• wherein the coding constraint is fulfilled when removing at least one slice header of the at least two slices while maintaining a slice header of the first slice of the at least two slices with respect to a coding order and concatenating the at least two slices or a proper subset of the at least two slices using the first slice header results in a standard conformant data stream.

A data stream being composed of a sequence of NAL units, the sequence of NAL units comprising

• a first set of one or more NAL units which forms a self-contained data stream parameterized so as to encode a first picture, the NAL units of the first set being selected out of a first set of one or more NAL unit types, and
• a second set of one or more NAL units each of which is of one of a second set of one or more predetermined NAL unit types, disjoint to the first set, and determined to lead to an ignorance of the respective NAL unit by a legacy decoder.

An apparatus for generating a first data stream out of a second data stream, the second data stream having encoded thereinto a picture composed of a plurality of spatial segments, wherein the second data stream is composed of a sequence of NAL units, the sequence of NAL units comprising a first set of one or more NAL units parameterized so as to encode a predetermined spatial segment, the NAL units of the first set being selected out of a first set of one or more NAL unit types, wherein the apparatus is configured to

• cut-out the first set of one or more NAL units out of the second data stream so as to adopt same into the first data stream;
• re-parameterize the first set of one or more NAL units so as to encode the predetermined spatial segment as a self-contained picture;
• insert a second set of one or more NAL units into the first data stream each of which is of one of a second set of one or more predetermined NAL unit types, disjoint to the first set, and determined to lead to an ignorance of the respective NAL unit by a legacy decoder.

A method for generating a first data stream out of a second data stream, the second data stream having encoded thereinto a picture composed of a plurality of spatial segments, wherein the second data stream is composed of a sequence of NAL units, the sequence of NAL units comprising a first set of one or more NAL units parameterized so as to encode a predetermined spatial segment, the NAL units of the first set being selected out of a first set of one or more NAL unit types, wherein the method comprises

• cut-out the first set of one or more NAL units out of the second data stream so as to adapt same in the first data stream;
• re-parameterize the first set of one or more NAL units so as to encode the predetermined spatial segment as a self-contained picture;
• insert a second set of one or more NAL units into the first data stream each of which is of one of a second set of one or more predetermined NAL unit types, disjoint to the first set, and determined to lead to an ignorance of the respective NAL unit by a legacy decoder.

A non-transitory digital storage medium having stored thereon a computer program for performing a method for generating a first data stream out of a second data stream, the second data stream having encoded thereinto a picture composed of a plurality of spatial segments, wherein the second data stream is composed of a sequence of NAL units, the sequence of NAL units comprising a first set of one or more NAL units parameterized so as to encode a predetermined spatial segment, the NAL units of the first set being selected out of a first set of one or more NAL unit types, wherein the method comprises

• cut-out the first set of one or more NAL units out of the second data stream so as to adapt same in the first data stream;
• re-parameterize the first set of one or more NAL units so as to encode the predetermined spatial segment as a self-contained picture;
• insert a second set of one or more NAL units into the first data stream each of which is of one of a second set of one or more predetermined NAL unit types, disjoint to the first set, and determined to lead to an ignorance of the respective NAL unit by a legacy decoder, when said computer program is run by a computer.