# US 2024/0187470 A1 · Portioned video streaming concepts

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0187470 A1
- Document ID: US20240187470A1
- Status: Published application
- Kind: A1
- Application number: 18/438,035
- Filed: 2024-02-09
- Published: 2024-06-06
- Earliest claimed: 2017-07-06
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Robert Philipp SKUPIN; Cornelius HELLGE; Thomas SCHIERL; Yago SÁNCHEZ DE LA FUENTE; Dimitri PODBORSKI
- Web page: https://patentgrep.com/patent/US20240187470A1

## CPC

- H04L 65/70: Media network packetisation
- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04L 63/0457: {wherein the sending and receiving network entities apply dynamic encryption, e.g. stream encryption (cryptographic mechanisms or cryptographic arrangements for stream encryption H04L9/065)}
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/172: the region being a picture, frame or field
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/2347: involving video stream encryption
- H04N 21/23476: {by partially encrypting, e.g. encrypting the ending portion of a movie}
- H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04L 2209/60: Digital content management, e.g. content distribution
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Portion- or tile-based video streaming concepts are described.

## Claims

### Claim 1

Apparatus for recovering a video stream from a bitstream which comprises sub-picture portions for different portions of a video picture area, wherein the apparatus is configured to
decrypt a coding payload section of each subpicture portion of a subset of one or more of the subpicture portions of the bitstream by using block-wise decryption by use of sequential variation of a plaintext mask and/or block-decryption key by reinitializing the sequential variation for each subpicture portion to be decrypted and finding a border of the coding payload section of each subpicture portion to be decrypted by
parsing the coding payload section of the respective subpicture portion up to a currently decrypted position and/or
deriving a length of the coding payload section of the respective subpicture portion from a header within the respective subpicture portion, and/or
using a bitstream length or pointer indication signaled from outside for the respective subpicture portion.

### Claim 2 (depends on 1)

Apparatus according to claim 1, configured to perform the re-initialization for each subpicture portion to be decrypted by deriving mutually different initialization states for the subset of one or more subpicture portions.

### Claim 3 (depends on 2)

Apparatus according to claim 2, configured to perform the deriving mutually different initialization states for the subset of one or more subpicture portions by applying mutually different modifications to a base initialization state for the current picture frame.

### Claim 4 (depends on 3)

Apparatus according to claim 3, configured to derive the mutually different modifications for each subpicture portion depending on the portion of the video picture area which the respective subpicture portion relates to or
depending on an index of the respective subpicture portion.

### Claim 5 (depends on 1)

Apparatus according to claim 1, configured to perform the re-initialization for each subpicture portion to be decrypted by deriving an initialization state for each of the subset of one or more subpicture portions from an initialization state list in the extractor file.

### Claim 6 (depends on 1)

Apparatus according to claim 1, configured to perform the parsing the coding payload section, the deriving the length of the coding payload section, or the use of the bitstream length or pointer indication for the finding with disregarding explicit border location information in the extractor file.
wherein a coding payload section of the picture portion of each bitstream of each subset of bitstreams out of an encrypted set of one or more of the subsets of bitstreams is encrypted by using block-wise encryption by use of sequential variation of a plaintext mask and/or block-encryption key by reinitializing the sequential variation for each picture portion.

### Claim 7

Video stream, comprising
a set of bit streams and an extractor,
the set of bitstreams having encoded thereinto different portions of a video picture area,
wherein the extractor indicates a compilation of a compiled bitstream out of the set of bitstreams by identifying, for each of the set of bitstreams, a picture portion relating to a current picture frame and signaling a compilation of the compiled bitstream out of the identified picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of; and
wherein a coding payload section of the picture portion of each bitstream out of an encrypted set of one or more of the set of bitstreams is encrypted by using block-wise encryption by use of sequential variation of a plaintext mask and/or block-encryption key by reinitializing the sequential variation for each picture portion.

### Claim 8 (depends on 7)

Video stream according to claim 7, wherein the re-initialization for each picture portion within the current picture frame is based on mutually different initialization states.

### Claim 9 (depends on 7)

Video stream according to claim 7, the mutually different initialization states are the result of applying mutually different modifications to a base initialization state for the current picture frame.

### Claim 10 (depends on 9)

Video stream according to claim 9, wherein the mutually different modifications for each picture portion
depend on the portion of the video picture area which is encoded into the bitstream the respective picture portion belongs to, or
depend on an index of the respective picture portion by which the respective picture portion is referred to in the extractor file.

### Claim 11 (depends on 7)

Video stream according to claim 7, wherein the extractor file comprises an initialization state list signaling an initialization state for each picture portion within the current picture frame.

### Claim 12

Apparatus for recovering a video stream from a bitstream which comprises sub-picture portions for different portions of a video picture area, wherein the apparatus is configured to
identify a predetermined subpicture portion out of the subpicture portions of the bitstream on the basis of signaling inbound from outside or signaling in the sub-picture portions,
decrypt a coding payload section of the predetermined subpicture portion of the subpicture portions of the bitstream by finding a border of the coding payload section of the predetermined subpicture portion to be decrypted by
parsing the coding payload section up to a currently decrypted position and/or
deriving a length of the coding payload section from a header within the predetermined subpicture portion, and/or
using a bitstream length or pointer indication signaled from outside for the predetermined subpicture portion.

### Claim 13 (depends on 12)

Apparatus according to claim 12, wherein the decryption involves block-decryption by use of sequential variation of a plaintext mask and/or block-decryption key.

### Claim 14 (depends on 12)

Apparatus according to claim 12, configured to perform the identification of the predetermined subpicture portion for several picture frames in manner so that
the several picture frames comprise picture frames for which the predetermined subpicture portion correspond to different ones of the different portions, and/or
the several picture frames comprise first picture frames for which the exactly one subpicture portion is identified to be the predetermined subpicture portion and second picture frames, interspersed between the first picture frames, for which no subpicture portion is identified to be the predetermined subpicture portion.

### Claim 15

Video stream, comprising
a set of bit streams and an extractor file,
the set of bitstreams having encoded thereinto different portions of a video picture area,
wherein the extractor file indicates a compilation of a compiled bitstream out of the set of bitstreams by identifying, for each of the set of bitstreams, a picture portion relating to a current picture frame and signaling a compilation of the compiled bitstream out of the identified picture portions so that the compiled bitstream comprises a sub-picture portion for the picture portion of each of the set of bitstreams the compiled bitstream is formed of; and
a predetermined subpicture portion is identified out of the subpicture portions of the compiled bitstream by signaling comprised in at least one of the extractor file or the sub-picture portions,
wherein a coding payload section of the predetermined subpicture portion is encrypted.

### Claim 16 (depends on 15)

Video stream according to claim 15 wherein the encryption involves block-wise encryption by use of sequential variation of a plaintext mask and/or block-encryption key.

### Claim 17

Client device configured to
inspect a manifest file comprising
first parameter sets each defining one of picture-portion specific adaptation sets of representations, the representations of each picture-portion specific adaptation set having encoded thereinto one of different picture portions at different qualities, wherein each first parameter set comprises a quality level for each representation of the picture-portion specific adaptation set defined by the respective first parameter set;
at least one second parameter set defining a preselection adaptation set which assigns to each of regions of an output picture area one of the picture-portion specific adaptation sets,
wherein
the at least one second parameter set comprises one or more parameters for each region of the output picture area, indicating a quality level range covering the quality levels of the representations of the picture-portion specific adaptation set assigned to the respective region, and/or
the manifest file comprises an indication whether the quality levels indicated by the first parameter sets are defined on a common ordinal scale so as to be ordinally scaled across different ones of the first parameter sets, or the quality levels indicated by the first parameter sets are defined on separate ordinal scales, individual for the first parameter sets; and/or
the at least one second parameter set comprises one or more parameters indicating, for each region of the output picture area, a quality level hint for the respective region and an indication whether the quality level hint for the respective region and the quality levels defined by the first parameter set of the picture-portion specific adaptation set assigned to the respective region, are defined on a common ordinal scale so as to be ordinally scaled thereacross, or the quality level hint and the quality levels defined by the first parameter set of the picture-portion specific adaptation set assigned to the respective region are defined on separate ordinal scales, and/or
the at least one second parameter set comprises one or more parameters indicating, for the regions of the output picture area, quality ranking among the regions, and
change, based on the first parameter set and the at least one second parameter set, a streaming strategy in adaptively streaming a video from a server.

### Claim 18 (depends on 17)

Client device of claim 17 configured to use quality levels, quality level ranges, quality level hints and/or the indication, in order to rank the preselection adaptation sets with respect to a wished viewport.

### Claim 19 (depends on 17)

Client device of claim 17 configured to determine a location of a ROI comprising increased quality in an output picture area of a preselection adaptation set based on quality information in the manifest file and compare the location of the ROI with a wished viewport in order to determine the streaming strategy.
