# US 2025/0159220 A1 · Concept for picture/video data streams allowing efficient reducibility or efficient random access

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0159220 A1
- Document ID: US20250159220A1
- Status: Published application
- Kind: A1
- Application number: 19/026,243
- Filed: 2025-01-16
- Published: 2025-05-15
- Earliest claimed: 2016-02-09
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Robert SKUPIN; Yago SÁNCHEZ DE LA FUENTE; Thomas SCHIERL; Cornelius HELLGE; Karsten GRUENEBERG; Thomas WIEGAND
- Web page: https://patentgrep.com/patent/US20250159220A1

## CPC

- H04N 19/33: in the spatial domain
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/146: Data rate or code amount at the encoder output
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/34: Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/88: involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined subarea of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.

## Claims

### Claim 1

A non-transitory digital storage medium having stored thereon a representing a video comprising
a parameter set portion indicating coding parameter settings;
a payload portion into which pictures of the video are coded in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by indices comprised by the payload portion,
wherein the video data stream comprises an information comprising
an indication of a predetermined subarea of the pictures, and
replacement parameters for adjusting the first set of coding parameter settings so as to result in a second set of coding parameter settings, wherein the coding parameter settings define buffer size and timing,
wherein the second set of coding parameters are selected so that a reduced video data stream modified compared to the video data stream by
removing portions of the payload portion referring to an area of the pictures outside the predetermined subarea, and
changing location indications in the payload portion so to indicate a location in a manner measured from a circumference of the predetermined subarea instead of the pictures,
comprises a reduced payload portion having encoded thereinto subarea-specific pictures showing the predetermined subarea of the pictures in a manner parameterized using the second set of coding parameter settings,
wherein the video data stream and the reduced video data stream are conforming to HEVC, and
wherein the payload portion has the pictures of the video coded thereinto in units of tiles into which the pictures are subdivided and which are arranged in a tile array of columns and rows, wherein the indication indicates the predetermined subarea as a set of the tiles.

### Claim 2 (depends on 1)

The non-transitory digital storage medium according to claim 1 wherein the parameter set portion is comprised by at least one of SPS NAL units and VPS NAL units and PPS NAL units.

### Claim 3 (depends on 1)

The non-transitory digital storage medium according to claim 1 wherein the indices are comprised in slice headers of slices of the payload portion, each slice having encoded thereinto a corresponding area of a picture which does not cross a boundary of the predetermined subarea.

### Claim 4 (depends on 1)

The non-transitory digital storage medium according to claim 1 wherein the payload portion has the pictures of the video coded thereinto in units of tiles such that the payload portion is subdivided in units of slices, each slice having encoded thereinto a corresponding area of a picture which does not cross a tile border between the tiles.

### Claim 5 (depends on 1)

The non-transitory digital storage medium according to claim 1 wherein
a portion of the first set of coding parameter settings indexed by the indices from which the redirection by the replacement indices is to be performed, and/or which is replaced by the replacement parameters, pertains one or more of
picture size,
tile structure,
buffer size and timing.

### Claim 6

An encoder for encoding a video into a video data stream, comprising
a parameter setter configured to determine coding parameter settings and generate a parameter set portion of the video data stream indicating the coding parameter settings;
a coding core configured to encode pictures of the video into a payload portion of the video data stream in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by indices comprised by the payload portion,
wherein the encoder is configured to provide the video data stream with an information comprising
an indication of a predetermined subarea of the pictures, and
replacement parameters for adjusting the first set of coding parameter settings so as to result in a second set of coding parameter settings, wherein the coding parameter settings define buffer size and timing,
wherein the second set of coding parameters are selected so that a reduced video data stream modified compared to the video data stream by
removing portions of the payload portion referring to an area of the pictures outside the predetermined subarea, and
changing location indications in the payload portion so to indicate a location in a manner measured from a circumference of the predetermined subarea instead of the pictures,
comprises a reduced payload portion having encoded thereinto subarea-specific pictures showing the subarea of the pictures in a manner parameterized using the second set of coding parameter settings,
wherein the video data stream and the reduced video data stream are conforming to HEVC, and
the encoder is configured to encode into the payload portion the pictures of the video coded in units of tiles into which the pictures are subdivided and which are arranged in a tile array of columns and rows, wherein the indication indicates the predetermined subarea as a set of the tiles.

### Claim 7 (depends on 6)

The encoder according to claim 6 wherein the parameter set portion is comprised by one or more of SPS NAL units and VPS NAL units and PPS NAL units.

### Claim 8 (depends on 6)

The encoder according to claim 6 wherein the encoder is configured to insert the indices into slice headers of slices of the payload portion, and to encode into each slice a corresponding area of a picture which does not cross a boundary of the predetermined subarea.

### Claim 9 (depends on 6)

The encoder according to claim 6 wherein the encoder is configured to encode into the payload portion the pictures of the video coded in units of tiles into which the pictures are subdivided and which are arranged in a tile array of columns and rows, wherein the indication indicates the predetermined subarea as a set of the tiles.

### Claim 10 (depends on 6)

The encoder according to claim 6 wherein the encoder is configured to encode into the payload portion the pictures of the video coded in units of tiles such that the payload portion is subdivided in units of slices, each slice having encoded thereinto a corresponding area of a picture which does not cross a tile border between the tiles.

### Claim 11 (depends on 6)

The encoder according to claim 6 wherein
a portion of the first set of coding parameter settings indexed by the indices from which the redirection by the replacement indices is to be performed, and/or which is replaced by the replacement parameters, pertains one or more of
picture size,
tile structure,
buffer timing.

### Claim 12

A device for processing a video data stream so as to be forwarded to a video decoder, the video data stream comprising
a parameter set portion indicating coding parameter settings;
a payload portion into which pictures of the video are coded in a manner parameterized using a first set of the coding parameter settings, the first set being indexed by indices comprised by the payload portion,
wherein the device is configured to
read from the video data stream an information comprising
an indication of a predetermined subarea of the pictures, and
replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings, wherein the coding parameter settings define buffer size and timing,
reduce the video data stream to a reduced video data stream modified by
performing the redirection and/or adjustment so that the second set of coding parameter settings is indexed by the payload portion's indices;
removing portions of the payload portion referring to an area of the pictures outside the predetermined subarea, and
changing location indications in the payload portion so to indicate a location measured from a circumference of the predetermined subarea instead of the pictures,
so that the reduced video data stream comprises a reduced payload portion which has encoded thereinto subarea-specific pictures showing the predetermined subarea of the pictures in a manner parameterized using the second set of coding parameter settings,
wherein the video data stream and the reduced video data stream are conforming to HEVC and
wherein the payload portion has the pictures of the video coded thereinto in units of tiles into which the pictures are subdivided and which are arranged in a tile array of columns and rows, wherein the indication indicates the predetermined subarea as a set of the tiles.

### Claim 13 (depends on 12)

The device according to claim 12 wherein the parameter set portion is comprised by one or more of SPS NAL units and VPS NAL units and PPS NAL units.

### Claim 14 (depends on 12)

The device according to claim 12 wherein the device is configured to locate the indices in slice headers of slices of the payload portion, each slice having encoded thereinto a corresponding area of a picture which does not cross a boundary of the predetermined subarea.

### Claim 15 (depends on 12)

The device according to claim 12 wherein the payload portion has the pictures of the video coded thereinto in units of tiles such that the payload portion is subdivided in units of slices, each slice having encoded thereinto a corresponding area of a picture which does not cross a tile border between the tiles.

### Claim 16 (depends on 12)

The device according to claim 12 wherein
a portion of the first set of coding parameter settings indexed by the indices from which the redirection by the replacement indices is to be performed, and/or which is replaced by the replacement parameters, pertains one or more of
picture size,
tile structure,
buffer size and timing.

### Claim 17 (depends on 12)

The device according to claim 12 wherein the device is one of
a video decoder capable of decoding the video data stream and the reduced video data stream,
a video decoder a profile level of which suffices for the video decoder to be capable of decoding the reduced video data stream, but the profile level of which is insufficient so that the video decoder is unable to decode the video data stream, and
a network device configured to forward, depending on a control signal, one of the video data stream and the reduced video data stream to a video decoder.

### Claim 18 (depends on 12)

The device according to claim 12, wherein the video data stream comprises a displacing information which indicates for a set of at least one predetermined subregions of the pictures a displacement of the set of at least one predetermined subregions within a target picture area relative to an undisplaced copying of the set of at least one predetermined subregions into the target picture area, and
the device is configured to modify the displacing information into modified displacing information so that the subarea-specific pictures, copied into the target picture area with having predetermined subregions of the subarea-specific pictures displaced according to the modified displacing information, coincides within the target picture area with the predetermined subarea of the pictures copied into the target picture area with the set of at least one predetermined subregion of the pictures displaced according to the displacing information, and, in reducing the video data stream, replace the displacing information with the modified displacing information, or
the modified displacing information is comprised by the video data stream associated with the predetermined subarea of the pictures and the displacing information is comprised by the video data stream associated with the pictures and the device is configured to, in reducing the video data stream, remove the displacing information and carry over the modified displacing information into the reduced video data stream so as to be associated with the subarea-specific pictures.

### Claim 19

A video decoder configured to
receive a data stream into which a picture of a video is coded, and
read, as part of displacing information in the data stream, read, as part the displacing information, from the data stream
a count of predetermined subregions within the picture,
size parameters defining a size of a target picture area, the target picture area representing a cubic projection of the panoramic scene,
for each predetermined subregion of the predetermined subregions of the picture,
a width, a height, a top sample row and a left-most sample column of the respective predetermined subregion in the target region and
a further width, a further height, a further top sample row and a further left-most sample column of the respective predetermined region within the picture, and
wherein the displacing information allows for
deriving the target picture area from the picture by
displacing each of the predetermined subregions of the picture according to the width, the height, the top sample row and the left-most sample column of the respective predetermined subregion of the picture within the target picture and the further width, the further height, the further top sample row and the further left-most sample column of the respective predetermined subregion of the picture within the picture, as read for the respective predetermined subregion, and
filling, according to default filling information comprised in the data stream, a portion of the target picture area where none of the predetermined subregions of the picture is displaced to according to the displacing information.

### Claim 20 (depends on 19)

The decoder according to claim 19, wherein the set of at least one subregion of the picture is a subset of a gapless and overlap-free spatial partitioning of the picture into an array of subregions.

### Claim 21 (depends on 19)

The decoder according to claim 19, wherein the displacing information comprises
for each predetermined subregion of the set of at least one predetermined subregion of the picture,
information on a rotation and information on a mirroring when mapping the respective predetermined subregion between the target region and the picture.

### Claim 22 (depends on 19)

The decoder according to claim 19, wherein the data stream has a sequence of pictures encoded thereinto, wherein the displacing information is valid for the sequence of pictures.
