Portioned video streaming concepts

Apparatus for recovering a video stream from a set of bit streams and an extractor, the set of bitstreams having encoded thereinto different portions of a video picture area, the apparatus configured to

• compile, using the extractor (20), a compiled bitstream out of the set of bitstreams by extracting, from each of the set of bitstreams, a picture portion relating to a current picture frame by parsing the respective bitstream and forming the compiled bitstream out of the extracted picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• decrypt a coding payload section of each subpicture portion of a subset of one or more of the subpicture portions of the compiled bitstream by using block-wise decryption by use of sequential variation of a plaintext mask and/or block-decryption key by reinitializing the sequential variation for each subpicture portion to be decrypted and finding a border of the coding payload section of each subpicture portion to be decrypted by
• parsing the coding payload section of the respective subpicture portion up to a currently decrypted position and/or
• deriving a length of the coding payload section of the respective subpicture portion from a header within the respective subpicture portion, and/or
• using a bitstream length or pointer indication signaled within the bitstream from which the picture portion is extracted which the respective subpicture portion belongs to.

Apparatus for recovering a video stream from a bitstream which comprises sub-picture portions for different portions of a video picture area, wherein the apparatus is configured to

• decrypt a coding payload section of each subpicture portion of a subset of one or more of the subpicture portions of the bitstream by using block-wise decryption by use of sequential variation of a plaintext mask and/or block-decryption key by reinitializing the sequential variation for each subpicture portion to be decrypted and
• finding a border of the coding payload section of each subpicture portion to be decrypted by
• parsing the coding payload section of the respective subpicture portion up to a currently decrypted position and/or
• deriving a length of the coding payload section of the respective subpicture portion from a header within the respective subpicture portion, and/or
• using a bitstream length or pointer indication signaled from outside for the respective subpicture portion.

Collection of data for downloading an ROI-specific video stream by tile-based video streaming, comprising bit streams each having encoded thereinto one of portions of a video picture area, so that each portion of the video picture area is encoded into a subset of the bit streams at different qualities;

• at least one extractor associated with an ROI of the video picture area;
• a manifest file identifying a set of bit streams having encoded thereinto different portions of a video picture area which focus on the ROI,
• wherein the extractor indicates a compilation of a compiled bitstream out of the set of bitstreams by identifying, for each of the subsets of bitstreams, out of a selected bitstream of the respective subset of bitstreams, a picture portion relating to a current picture frame and signaling a compilation of the compiled bitstream out of the identified picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of the selected bitstream of each of the subsets of bitstreams the compiled bitstream is formed of;
• and
• wherein a coding payload section of the picture portion of each bitstream of each subset of bitstreams out of an encrypted set of one or more of the subsets of bitstreams is encrypted by using block-wise encryption by use of sequential variation of a plaintext mask and/or block-encryption key by reinitializing the sequential variation for each picture portion.

Video stream, comprising

• a set of bit streams and an extractor,
• the set of bitstreams having encoded thereinto different portions of a video picture area,
• wherein the extractor indicates a compilation of a compiled bitstream out of the set of bitstreams by identifying, for each of the set of bitstreams, a picture portion relating to a current picture frame and signaling a compilation of the compiled bitstream out of the identified picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• wherein a coding payload section of the picture portion of each bitstream out of an encrypted set of one or more of the set of bitstreams is encrypted by using block-wise encryption by use of sequential variation of a plaintext mask and/or block-encryption key by reinitializing the sequential variation for each picture portion.

Apparatus for downloading an ROI-specific video stream by tile-based video streaming, configured to

• inspect a manifest file so as to, depending on an ROI, identify and download a set of bit streams along with an extractor, the set of bitstreams having encoded thereinto mutually different portions of a video picture area;
• compile, using the extractor, a compiled bitstream out of the set of bitstreams by extracting, from each of the set of bitstreams, a picture portion relating to a current picture frame by parsing the respective bitstream and forming the compiled bitstream out of the extracted picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• identify a predetermined subpicture portion out of the subpicture portions of the compiled bitstream on the basis of signaling in at least one of the extractor or the sub-picture portions,
• decrypt a coding payload section of the predetermined subpicture portion of the subpicture portions of the compiled bitstream by finding a border of the coding payload section of the predetermined subpicture portion to be decrypted by
• parsing the coding payload section up to a currently decrypted position and/or
• deriving a length of the coding payload section from a header within the one predetermined subpicture portion, and/or
• using a bitstream length or pointer indication signaled within the bitstream from which the picture portion is extracted which the predetermined subpicture portion belongs to.

Apparatus for recovering a video stream from a set of bitstreams and an extractor, the set of bitstreams having encoded thereinto different portions of a video picture area, the apparatus comprising

• compile, using the extractor, a compiled bitstream out of the set of bitstreams by extracting, from each of the set of bitstreams, a picture portion relating to a current picture frame by parsing the respective bitstream and forming the compiled bitstream out of the extracted picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• identify a predetermined subpicture portion out of the subpicture portions of the compiled bitstream on the basis of signaling in at least one of the extractor or the sub-picture portions,
• decrypt a coding payload section of the predetermined subpicture portion of the subpicture portions of the compiled bitstream by finding a border of the coding payload section of the predetermined subpicture portion to be decrypted by
• parsing the coding payload section up to a currently decrypted position and/or
• deriving a length of the coding payload section from a header within the one predetermined subpicture portion, or
• using a bitstream length or pointer indication signaled within the bitstream from which the picture portion is extracted which the predetermined subpicture portion belongs to.

Apparatus for recovering a video stream from a bitstream which comprises sub-picture portions for different portions of a video picture area, wherein the apparatus is configured to

• identify a predetermined subpicture portion out of the subpicture portions of the bitstream on the basis of signaling inbound from outside or signaling in the sub-picture portions,
• decrypt a coding payload section of the predetermined subpicture portion of the subpicture portions of the bitstream by finding a border of the coding payload section of the predetermined subpicture portion to be decrypted by
• parsing the coding payload section up to a currently decrypted position and/or
• deriving a length of the coding payload section from a header within the predetermined subpicture portion, and/or
• using a bitstream length or pointer indication signaled from outside for the predetermined subpicture portion.

Collection of data for downloading an ROI-specific video stream by tile-based video streaming, comprising

• bit streams each having encoded thereinto one of portions of a video picture area, so that each portion of the video picture area is encoded into a subset of the bit streams at different qualities;
• at least one extractor associated with an ROI of the video picture area;
• a manifest file identifying a set of bit streams having encoded thereinto different portions of a video picture area which focus on the ROI,
• wherein the extractor indicates a compilation of a compiled bitstream out of the set of bitstreams by identifying, for each of the subsets of bitstreams, out of a selected bitstream of the respective subset of bitstreams, a picture portion relating to a current picture frame and signaling a compilation of the compiled bitstream out of the identified picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of the selected bitstream of each of the subsets of bitstreams the compiled bitstream is formed of;
• and
• a predetermined subpicture portion is identified out of the subpicture portions of the compiled bitstream by identifying a predetermined subset of bitstreams out of the subsets of bitstreams so that the picture portion of the selected bitstream of the predetermined subset of bitstreams is the predetermined subpicture portion and by signaling contained in at least one of the extractor or the sub-picture portions,
• wherein a coding payload section of the picture portion of the bitstreams of the predetermined subset of bitstreams is encrypted.

An apparatus for video steam, the video stream comprising

• a set of bit streams and an extractor,
• the set of bitstreams having encoded thereinto different portions of a video picture area,
• wherein the extractor indicates a compilation of a compiled bitstream out of the set of bitstreams by identifying, for each of the set of bitstreams, a picture portion relating to a current picture frame and signaling a compilation of the compiled bitstream out of the identified picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• a predetermined subpicture portion is identified out of the subpicture portions of the compiled bitstream by signaling contained in at least one of the extractor or the sub-picture portions,
• wherein a coding payload section of the predetermined subpicture portion is encrypted.

Server configured to provide a manifest file to a client, the manifest file comprising

• first parameter sets (202) each defining one of picture-portion specific adaptation sets (200) of representations (12), the representations of each picture-portion specific adaptation set having encoded thereinto one of different picture portions (14) at different qualities, wherein each first parameter set (202) comprises a quality level (204) for each representation of the picture-portion specific adaptation set (200) defined by the respective first parameter set (202);
• at least one second parameter set (206) defining a preselection adaptation set (208) which assigns to each of regions (214) of an output picture area (216) one of the picture-portion specific adaptation sets,
• wherein
• the at least one second parameter set (206) comprises one or more parameters for each region (214) of the output picture area (216), indicating a quality level range (220) covering the quality levels (204) of the representations (12) of the picture-portion specific adaptation set (200) assigned to the respective region (214), and/or the manifest file (24) comprises an indication whether the quality levels (204) indicated by the first parameter sets (202) are defined on a common ordinal scale (222) so as to be ordinally scaled across different ones of the first parameter sets (202), or the quality levels (204) indicated by the first parameter sets (202) are defined on separate ordinal scales (224), individual for the first parameter sets (202);
• and/or
• the at least one second parameter set (206) comprises one or more parameters indicating, for each region (214) of the output picture area (216), a quality level hint for the respective region and an indication whether the quality level hint for the respective region (214) and the quality levels (204) defined by the first parameter set (202) of the picture-portion specific adaptation set (200) assigned to the respective region (214), are defined on a common ordinal scale so as to be ordinally scaled thereacross, or the quality level hint and the quality levels (204) defined by the first parameter set (202) of the picture-portion specific adaptation set (200) assigned to the respective region are defined on separate ordinal scales (224), and/or
• the at least one second parameter set (206) comprises one or more parameters indicating, for the regions (214) of the output picture area (216), quality ranking among the regions (214).

Client device configured to

• inspect a manifest file comprising
• first parameter sets (202) each defining one of picture-portion specific adaptation sets (200) of representations (12), the representations of each picture-portion specific adaptation set having encoded thereinto one of different picture portions (14) at different qualities, wherein each first parameter set (202) comprises a quality level (204) for each representation of the picture-portion specific adaptation set (200) defined by the respective first parameter set (202);
• at least one second parameter set (206) defining a preselection adaptation set (208) which assigns to each of regions (214) of an output picture area (216) one of the picture-portion specific adaptation sets,
• wherein
• the at least one second parameter set (206) comprises one or more parameters for each region (214) of the output picture area (216), indicating a quality level range (220) covering the quality levels (204) of the representations (12) of the picture-portion specific adaptation set (200) assigned to the respective region (214), and/or
• the manifest file (24) comprises an indication whether the quality levels (204) indicated by the first parameter sets (202) are defined on a common ordinal scale (222) so as to be ordinally scaled across different ones of the first parameter sets (202), or the quality levels (204) indicated by the first parameter sets (202) are defined on separate ordinal scales (224), individual for the first parameter sets (202);
• and/or
• the at least one second parameter set (206) comprises one or more parameters indicating, for each region (214) of the output picture area (216), a quality level hint for the respective region and an indication whether the quality level hint for the respective region (214) and the quality levels (204) defined by the first parameter set (202) of the picture-portion specific adaptation set (200) assigned to the respective region (214), are defined on a common ordinal scale so as to be ordinally scaled thereacross, or the quality level hint and the quality levels (204) defined by the first parameter set (202) of the picture-portion specific adaptation set (200) assigned to the respective region are defined on separate ordinal scales (224), and/or
• the at least one second parameter set (206) comprises one or more parameters indicating, for the regions (214) of the output picture area (216), quality ranking among the regions (214), and
• change, based on the quality level range and/or the indication, a streaming strategy in adaptively streaming a video from a server.

Server configured to provide a manifest file to a client, the manifest file comprising a first parameter set for a region-wise compiled adaptation set defining a set of representations coinciding in a subdivision of a video picture area in regions, the representations having encoded thereinto the regions of video picture area at different quality level tuples assigning a region-specific quality level to each region,

• the first parameter set comprising
• an adaptation set quality level indication for all regions, and
• for each representation, a representation-specific quality level indication
• wherein, for each representation, the quality level tuple of the respective representation is derivable from a combination of the adaptation set quality level indication and the representation-specific quality level indication for the respective representation.

Client device configured to

• inspect a manifest file comprising
• a first parameter set for a region-wise compiled adaptation set defining a set of representations coinciding in a subdivision of a video picture area in regions, the representations having encoded thereinto the regions of video
• picture area at different quality level tuples assigning a region-specific quality level to each region,
• the first parameter set comprising
• an adaptation set quality level indication for all regions, and
• for each representation, a representation-specific quality level indication
• wherein, for each representation, the quality level tuple of the respective representation is derivable from a combination of the adaptation set quality level indication and the representation-specific quality level indication for the respective representation, and
• use the quality level tuples of the representations in a streaming strategy for adaptively streaming a video from a server.

Method for generating a manifest file, the method comprising

• providing the manifest with first parameter sets (202) each defining one of picture-portion specific adaptation sets (200) of representations (12), the representations of each picture-portion specific adaptation set having encoded thereinto one of different picture portions (14) at different qualities, wherein each first parameter set (202) comprises a quality level (204) for each representation of the picture-portion specific adaptation set (200) defined by the respective first parameter set (202);
• providing the manifest with at least one second parameter set (206) defining a preselection adaptation set (208) which assigns to each of regions (214) of an output picture area (216) one of the picture-portion specific adaptation sets,
• wherein
• the at least one second parameter set (206) comprises one or more parameters for each region (214) of the output picture area (216), indicating a quality level range (220) covering the quality levels (204) of the representations (12) of the picture-portion specific adaptation set (200) assigned to the respective region (214), and/or
• the manifest file (24) comprises an indication whether the quality levels (204) indicated by the first parameter sets (202) are defined on a common ordinal scale (222) so as to be ordinally scaled across different ones of the first parameter sets (202), or the quality levels (204) indicated by the first parameter sets (202) are defined on separate ordinal scales (224), individual for the first parameter sets (202);
• and/or
• the at least one second parameter set (206) comprises one or more parameters indicating, for each region (214) of the output picture area (216), a quality level hint for the respective region and an indication whether the quality level hint for the respective region (214) and the quality levels (204) defined by the first parameter set (202) of the picture-portion specific adaptation set (200) assigned to the respective region (214), are defined on a common ordinal scale so as to be ordinally scaled thereacross, or the quality level hint and the quality levels (204) defined by the first parameter set (202) of the picture-portion specific adaptation set (200) assigned to the respective region are defined on separate ordinal scales (224), and/or
• the at least one second parameter set (206) comprises one or more parameters indicating, for the regions (214) of the output picture area (216), quality ranking among the regions (214).

Method for downloading an ROI-specific video stream (40) by tile-based video streaming, the method comprising:

• inspecting a manifest file (24) so as to, depending on a region of interest (ROI) (22), identify and download a set (32) of bit streams (12) along with an extractor (20), the set (32) of bitstreams (12) having encoded thereinto different portions (14) of a video picture area (16);
• compiling, using the extractor (20), a compiled bitstream (40) out of the set (32) of bitstreams by extracting, from each of the set (32) of bitstreams, a picture portion (34) relating to a current picture frame (30) by parsing the respective bitstream and forming the compiled bitstream (40) out of the extracted picture portions (34) so that the compiled bitstream (40) comprises a sub-picture portion (44) for the picture portion (34) of each of the set of bitstreams the compiled bitstream (40) is formed of;
• and
• decrypting a coding payload section (48) of each subpicture portion (44) of a subset of one or more of the subpicture portions (44) of the compiled bitstream (40) by using block-wise decryption by use of sequential variation of a plaintext mask and/or block-decryption key by reinitializing the sequential variation for each subpicture portion to be decrypted and finding a border of the coding payload section (48) of each subpicture portion (44) to be decrypted by
• parsing (102) the coding payload section (48) of the respective subpicture portion (44) up to a currently decrypted position and/or
• deriving a length of the coding payload section of the respective subpicture portion from a header (46) within the respective subpicture portion (44), and/or
• using a bitstream length or pointer indication signaled within the bitstream from which the picture portion is extracted which the respective subpicture portion belongs to.

Method for recovering a video stream from a set of bit streams and an extractor file, the set of bitstreams having encoded thereinto different portions of a video picture area, the method comprising:

• compiling, using the extractor file, a compiled bitstream out of the set of bitstreams by extracting, from each of the set of bitstreams, a picture portion relating to a current picture frame by parsing the respective bitstream and forming the compiled bitstream out of the extracted picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• decrypting a coding payload section of each subpicture portion of a subset of one or more of the subpicture portions of the compiled bitstream by using block-wise decryption by use of sequential variation of a plaintext mask and/or block-decryption
• key by reinitializing the sequential variation for each subpicture portion to be decrypted and finding a border of the coding payload section of each subpicture portion to be decrypted by
• parsing the coding payload section of the respective subpicture portion up to a currently decrypted position and/or
• deriving a length of the coding payload section of the respective subpicture portion from a header within the respective subpicture portion, and/or
• using a bitstream length or pointer indication signaled within the bitstream from which the picture portion is extracted which the respective subpicture portion belongs to.

Method for recovering a video stream from a bitstream which comprises sub-picture portions for different portions of a video picture area, the method comprising:

• decrypting a coding payload section of each subpicture portion of a subset of one or more of the subpicture portions of the bitstream by using block-wise decryption by use of sequential variation of a plaintext mask and/or block-decryption key by reinitializing the sequential variation for each subpicture portion to be decrypted and finding a border of the coding payload section of each subpicture portion to be decrypted by
• parsing the coding payload section of the respective subpicture portion up to a currently decrypted position and/or
• deriving a length of the coding payload section of the respective subpicture portion from a header within the respective subpicture portion, and/or
• using a bitstream length or pointer indication signaled from outside for the respective subpicture portion.

Method for downloading an ROI-specific video stream by tile-based video streaming, the method comprising:

• inspecting a manifest file so as to, depending on an ROI, identify and download a set of bit streams along with an extractor file, the set of bitstreams having encoded thereinto mutually different portions of a video picture area;
• compiling, using the extractor file, a compiled bitstream out of the set of bitstreams by extracting, from each of the set of bitstreams, a picture portion relating to a current picture frame by parsing the respective bitstream and forming the compiled bitstream out of the extracted picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• identifying a predetermined subpicture portion out of the subpicture portions of the compiled bitstream on the basis of signaling in at least one of the extractor file or the sub-picture portions,
• decrypting a coding payload section of the predetermined subpicture portion of the subpicture portions of the compiled bitstream by finding a border of the coding payload section of the predetermined subpicture portion to be decrypted by
• parsing the coding payload section up to a currently decrypted position and/or
• deriving a length of the coding payload section from a header within the one predetermined subpicture portion, and/or
• using a bitstream length or pointer indication signaled within the bitstream from which the picture portion is extracted which the predetermined subpicture portion belongs to.

Method for recovering a video stream from a set of bitstreams and an extractor file, the set of bitstreams having encoded thereinto different portions of a video picture area, the method comprising:

• compiling, using the extractor file, a compiled bitstream out of the set of bitstreams by extracting, from each of the set of bitstreams, a picture portion relating to a current picture frame by parsing the respective bitstream and forming the compiled
• bitstream out of the extracted picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of;
• and
• identifying a predetermined subpicture portion out of the subpicture portions of the compiled bitstream on the basis of signaling in at least one of the extractor file or the sub-picture portions,
• decrypting a coding payload section of the predetermined subpicture portion of the subpicture portions of the compiled bitstream by finding a border of the coding payload section of the predetermined subpicture portion to be decrypted by
• parsing the coding payload section up to a currently decrypted position and/or
• deriving a length of the coding payload section from a header within the one predetermined subpicture portion, or
• using a bitstream length or pointer indication signaled within the bitstream from which the picture portion is extracted which the predetermined subpicture portion belongs to.

Method for recovering a video stream from a bitstream which comprises sub-picture portions for different portions of a video picture area, the method comprising:

• identifying a predetermined subpicture portion out of the subpicture portions of the bitstream on the basis of signaling inbound from outside or signaling in the sub-picture portions,
• decrypting a coding payload section of the predetermined subpicture portion of the subpicture portions of the bitstream by finding a border of the coding payload section of the predetermined subpicture portion to be decrypted by
• parsing the coding payload section up to a currently decrypted position and/or
• deriving a length of the coding payload section from a header within the predetermined subpicture portion, and/or
• using a bitstream length or pointer indication signaled from outside for the predetermined subpicture portion.