# US 2023/0065580 A1 · Video encoder, video decoder, methods for encoding and decoding and video data stream for realizing advanced video coding concepts

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0065580 A1
- Document ID: US20230065580A1
- Status: Published application
- Kind: A1
- Application number: 17/982,015
- Filed: 2022-11-07
- Published: 2023-03-02
- Earliest claimed: 2020-05-22
- Assignees: Ge Video Compression, LLC
- Applicants: GE Video Compression, LLC
- Inventors: Yago SANCHEZ DE LA FUENTE; Karsten SÜHRING; Cornelius HELLGE; Thomas SCHIERL; Robert SKUPIN; Thomas WIEGAND
- Web page: https://patentgrep.com/patent/US20230065580A1

## CPC

- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/503: involving temporal prediction (adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109)
- H04N 19/172: the region being a picture, frame or field
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit}
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus (200) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus (200) is configured to generate an output video data stream from the input video data stream.

## Claims

### Claim at position 1

1-188. (canceled)

### Claim 189

A video decoder for receiving a video data stream having a video stored therein,
wherein the video decoder is configured to decode the video from the video data stream,
wherein the video data stream comprises one or more scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements,
wherein each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream,
wherein the video decoder is configured to decode the video depending on the one or more syntax elements of the plurality of syntax elements.

### Claim 190 (depends on 189)

The video decoder according to claim 189,
wherein the video data stream or the portion of the video data stream comprises at least one buffering period supplemental enhancement information message, wherein said buffering period supplemental enhancement information message defines the size for each syntax element of the one or more syntax elements of the plurality of syntax elements.

### Claim 191 (depends on 190)

The video decoder according to claim 190,
wherein said buffering period supplemental enhancement information message comprises, for defining the size for each syntax element of the one or more syntax elements of the plurality of syntax elements, at least one of
a bp_cpb_initial_removal_delay_length_minus1 element,
a bp_cpb_removal_delay_length_minus1 element,
a bp_dpb_output_delay_length_minus1 element,
a bp_du_cpb_removal_delay_increment_length_minus1 element,
a bp_dpb_output_delay_du_length_minus1 element.

### Claim 192 (depends on 189)

The video decoder according to claim 189,
wherein for each access unit of a plurality of access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said access unit also comprises a non-scalable-nested buffering period supplemental enhancement information message.

### Claim 193 (depends on 190)

The video decoder according to claim 190,
wherein for each single-layer access unit of a plurality of single-layer access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said single-layer access unit also comprises a non-scalable-nested buffering period supplemental enhancement information message.

### Claim 194 (depends on 189)

The video decoder according to claim 189,
wherein the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream.

### Claim 195 (depends on 192)

The video decoder according to claim 192,
wherein the video data stream comprises a plurality of access units, wherein each access unit of the plurality of access units is assigned to one of a plurality of pictures of the video,
wherein the portion of the video data stream is an access unit of the plurality of access units of the video data stream, and
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit.

### Claim 196 (depends on 195)

The video decoder according to claim 195,
wherein the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit and in in every one of the non-scalable nested supplemental enhancement information messages of the access unit.

### Claim 197 (depends on 189)

The video decoder according to claim 189,
wherein the portion of the video data stream is a coded video sequence of the video data stream, and
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence.

### Claim 198 (depends on 197)

The video decoder according to claim 197,
wherein the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence and in in every one of the non-scalable nested supplemental enhancement information messages of the coded video sequence.

### Claim 199

A video encoder,
wherein the video encoder is configured to encode a video into a video data stream,
wherein the video encoder is configured to generate the video data stream such that the video data stream comprises one or more scalable nested supplemental enhancement information messages,
wherein the video encoder is configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements,
wherein the video encoder is configured to generate the video data stream such that each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream.

### Claim 200 (depends on 199)

The video encoder according to claim 199,
wherein the video encoder is configured to generate the video data stream such that the video data stream or the portion of the video data stream comprises at least one buffering period supplemental enhancement information message, wherein said buffering period supplemental enhancement information message defines the size for each syntax element of the one or more syntax elements of the plurality of syntax elements.

### Claim 201 (depends on 200)

The video encoder according to claim 200,
wherein the video encoder is configured to generate the video data stream such that said buffering period supplemental enhancement information message comprises, for defining the size for each syntax element of the one or more syntax elements of the plurality of syntax elements, at least one of
a bp_cpb_initial_removal_delay_length_minus1 element,
a bp_cpb_removal_delay_length_minus1 element,
a bp_dpb_output_delay_length_minus1 element,
a bp_du_cpb_removal_delay_increment_length_minus1 element,
a bp_dpb_output_delay_du_length_minus1 element.

### Claim 202 (depends on 199)

The video encoder according to claim 199,
wherein the video encoder is configured to generate the video data stream such that for each access unit of a plurality of access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said access unit also comprises a non-scalable-nested buffering period supplemental enhancement information message.

### Claim 203 (depends on 200)

The video encoder according to claim 200,
wherein the video encoder is configured to generate the video data stream such that for each single-layer access unit of a plurality of single-layer access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said single-layer access unit also comprises a non-scalable-nested buffering period supplemental enhancement information message.

### Claim 204 (depends on 199)

The video encoder according to claim 199,
wherein the video encoder is configured to generate the video data stream such that the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the video encoder is configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein the video encoder is configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream.

### Claim 205 (depends on 202)

The video encoder according to claim 202,
wherein the video encoder is configured to generate the video data stream such that the video data stream comprises a plurality of access units, wherein each access unit of the plurality of access units is assigned to one of a plurality of pictures of the video,
wherein the portion of the video data stream is an access unit of the plurality of access units of the video data stream, and
wherein the video encoder is configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit.

### Claim 206 (depends on 205)

The video encoder according to claim 205,
wherein the video encoder is configured to generate the video data stream such that the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the video encoder is configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein the video encoder is configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit and in in every one of the non-scalable nested supplemental enhancement information messages of the access unit.

### Claim 207 (depends on 199)

The video encoder according to claim 199,
wherein the portion of the video data stream is a coded video sequence of the video data stream, and
wherein the video encoder is configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence.

### Claim 208 (depends on 207)

The video encoder according to claim 207,
wherein the video encoder is configured to generate the video data stream such that the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the video encoder is configured to generate the video data stream such that the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein the video encoder is configured to generate the video data stream such that each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence and in in every one of the non-scalable nested supplemental enhancement information messages of the coded video sequence.

### Claim 209

A non-transitory computer-readable medium storing a video data stream,
wherein the video data stream has a video encoded thereinto,
wherein the video data stream comprises one or more scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages comprise a plurality of syntax elements,
wherein each syntax element of one or more syntax elements of the plurality of syntax elements is defined to have a same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of a portion of the video data stream.

### Claim 210 (depends on 209)

The non-transitory computer-readable medium storing the video data stream according to claim 209,
wherein the video data stream or the portion of the video data stream comprises at least one buffering period supplemental enhancement information message, wherein said buffering period supplemental enhancement information message defines the size for each syntax element of the one or more syntax elements of the plurality of syntax elements.

### Claim 211 (depends on 210)

The non-transitory computer-readable medium storing the video data stream according to claim 210,
wherein said buffering period supplemental enhancement information message comprises, for defining the size for each syntax element of the one or more syntax elements of the plurality of syntax elements, at least one of
a bp_cpb_initial_removal_delay_length_minus1 element,
a bp_cpb_removal_delay_length_minus1 element,
a bp_dpb_output_delay_length_minus1 element,
a bp_du_cpb_removal_delay_increment_length_minus1 element,
a bp_dpb_output_delay_du_length_minus1 element.

### Claim 212 (depends on 209)

The non-transitory computer-readable medium storing the video data stream according to claim 209,
wherein for each access unit of a plurality of access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said access unit also comprises a non-scalable-nested buffering period supplemental enhancement information message.

### Claim 213 (depends on 210)

The non-transitory computer-readable medium storing the video data stream according to claim 210,
wherein for each single-layer access unit of a plurality of single-layer access units of the video data stream, which comprises a scalable-nested buffering period supplemental enhancement information message, said single-layer access unit also comprises a non-scalable-nested buffering period supplemental enhancement information message.

### Claim 214 (depends on 209)

The non-transitory computer-readable medium storing the video data stream according to claim 209,
wherein the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream and in in every one of the non-scalable nested supplemental enhancement information messages of the video data stream or of the portion of the video data stream.

### Claim 215 (depends on 212)

The non-transitory computer-readable medium storing the video data stream according to claim 212,
wherein the video data stream comprises a plurality of access units, wherein each access unit of the plurality of access units is assigned to one of a plurality of pictures of the video,
wherein the portion of the video data stream is an access unit of the plurality of access units of the video data stream, and
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit.

### Claim 216 (depends on 215)

The non-transitory computer-readable medium storing the video data stream according to claim 215,
wherein the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the access unit and in in every one of the non-scalable nested supplemental enhancement information messages of the access unit.

### Claim 217 (depends on 209)

The non-transitory computer-readable medium storing the video data stream according to claim 209,
wherein the portion of the video data stream is a coded video sequence of the video data stream, and
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence.

### Claim 218 (depends on 217)

The non-transitory computer-readable medium storing the video data stream according to claim 217,
wherein the video data stream comprises one or more non-scalable nested supplemental enhancement information messages,
wherein the one or more scalable nested supplemental enhancement information messages and the one or more non-scalable nested supplemental enhancement information message comprise the plurality of syntax elements,
wherein each syntax element of the one or more syntax elements of the plurality of syntax elements is defined to have the same size in every one of the scalable nested supplemental enhancement information messages of the coded video sequence and in in every one of the non-scalable nested supplemental enhancement information messages of the coded video sequence.
