# US 12,225,236 B2 · Miscellaneous signaling concepts for multi-layer video bitstreams and for output timing derivation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,225,236 B2
- Document ID: US12225236B2
- Status: Granted
- Kind: B2
- Application number: 18/008,534
- Filed: 2021-06-09
- Published: 2023-10-26
- Granted: 2025-02-11
- Earliest claimed: 2020-06-10
- Assignees: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft Zur FöRderung Der Angewandten Forschung E.V.
- Inventors: Yago Sánchez De La Fuente; Karsten Sühring; Cornelius Hellge; Thomas Schierl; Robert Skupin; Thomas Wiegand
- Web page: https://patentgrep.com/patent/US12225236B2

## CPC

- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/172: the region being a picture, frame or field
- H04N 19/187: the unit being a scalable video layer
- H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit}
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/31: in the temporal domain
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A first aspect provides concepts for handling coded layer video sequence boundaries in multilayered video bitstreams having inter-layer references. A second aspect provides concepts for handling, signaling and deriving of picture output timing, e.g. with respect to an access unit specific signaling and an output layer specific signaling of a number of repetitions of a picture output.

## Claims

### Claim 1

A decoder for decoding a video data stream, the decoder comprising:
at least one processor configured to perform operations comprising:
decoding a parameter set including a first syntax element indicating whether network abstraction layer (NAL) hypothetical reference decoder (HRD) parameters are present, a second syntax element indicating whether video coding layer (VCL) hypothetical reference decoder (HRD) parameters are present, a fixed-picture rate flag indicative of whether a picture output involves a fixed picture rate within a coded video sequence, and, if the fixed-picture rate flag indicates that the picture output involves a fixed picture rate within the coded video sequence, an elemental output picture duration syntax element; and
based at least in part on determining that the first syntax element indicates that NAL HRD parameters are not present and the second syntax element indicates that VCL HRD parameters are not present:
determining elemental picture output times for the coded video sequence based on the elemental output picture duration syntax element; and
inferring that a picture output multiplication syntax element in a picture timing supplemental enhancement information message of the video data stream, which reveals information on whether or not a respective access unit is subject to multiplied output and, if so, how many sequential output pictures are to be generated out of the respective access unit, indicates non multiplied output.

### Claim 2 (depends on 1)

The decoder of claim 1, wherein:
the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag;
the first syntax element comprises general_nal_hrd_params_present_flag;
the elemental output picture duration syntax element comprises elemental_duration_in_tc_minus1;
the second syntax element comprises general_vcl_hrd_params_present_flag; and
the picture output multiplication syntax element comprises pt_display_elemental_periods_minus1.

### Claim 3 (depends on 1)

The decoder of claim 1, the operations further comprising:
wherein the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag, and wherein the fixed-picture rate flag is decoded based on a fixed_pic_rate_general_flag having a value of 1.

### Claim 4

An encoder for encoding a video data stream, the encoder comprising:
at least one processor configured to perform operations comprising:
encoding a parameter set into the video data stream, including a first syntax element indicating whether network abstraction layer (NAL) hypothetical reference decoder (HRD) parameters are present, a second syntax element indicating whether video coding layer (VCL) hypothetical reference decoder (HRD) parameters are present, a fixed-picture rate flag indicative of whether a picture output involves a fixed picture rate within a coded video sequence, and, if the fixed-picture rate flag indicates that the picture output involves a fixed picture rate within the coded video sequence, an elemental output picture duration syntax element; and
based at least in part on determining that the first syntax element indicates that NAL HRD parameters are not present and the second syntax element indicates that VCL HRD parameters are not present:
elemental picture output times are determinable for the coded video sequence based on the elemental output picture duration syntax element; and
a picture output multiplication syntax element in a picture timing supplemental enhancement information message of the video data stream, which reveals information on whether or not a respective access unit is subject to multiplied output and, if so, how many sequential output pictures are to be generated out of the respective access unit, is inferable to indicate non multiplied output.

### Claim 5 (depends on 4)

The encoder of claim 4, wherein:
the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag;
the first syntax element comprises general_nal_hrd_params_present_flag;
the elemental output picture duration syntax element comprises elemental_duration_in_tc_minus1;
the second syntax element comprises general_vcl_hrd_params_present_flag; and
the picture output multiplication syntax element comprises pt_display_elemental_periods_minus1.

### Claim 6 (depends on 4)

The encoder of claim 4, the operations further comprising:
wherein the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag, and wherein the fixed-picture rate flag is decoded based on a fixed_pic_rate_general_flag having a value of 1.

### Claim 7

A method of decoding a video data stream, the method comprising:
decoding a parameter set including a first syntax element indicating whether network abstraction layer (NAL) hypothetical reference decoder (HRD) parameters are present, a second syntax element indicating whether video coding layer (VCL) hypothetical reference decoder (HRD) parameters are present, a fixed-picture rate flag indicative of whether a picture output involves a fixed picture rate within a coded video sequence, and, if the fixed-picture rate flag indicates that the picture output involves a fixed picture rate within the coded video sequence, an elemental output picture duration syntax element; and
based at least in part on determining that the first syntax element indicates that NAL HRD parameters are not present and the second syntax element indicates that VCL HRD parameters are not present:
determining elemental picture output times for the coded video sequence based on the elemental output picture duration syntax element; and
inferring that a picture output multiplication syntax element in a picture timing supplemental enhancement information message of the video data stream, which reveals information on whether or not a respective access unit is subject to multiplied output and, if so, how many sequential output pictures are to be generated out of the respective access unit, indicates non multiplied output.

### Claim 8 (depends on 7)

A non-transitory computer-readable medium storing a computer program for implementing the method of claim 7 when executed on a computer or signal processor.

### Claim 9 (depends on 7)

The method of claim 7, wherein:
the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag;
the first syntax element comprises general_nal_hrd_params_present_flag;
the elemental output picture duration syntax element comprises elemental_duration_in_tc_minus1;
the second syntax element comprises general_vcl_hrd_params_present_flag; and
the picture output multiplication syntax element comprises pt_display_elemental_periods_minus1.

### Claim 10 (depends on 7)

The method of claim 7, further comprising:
wherein the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag, and
wherein the fixed-picture rate flag is decoded based on a fixed_pic_rate_general_flag having a value of 1.

### Claim 11

A method of encoding a video data stream, the method comprising:
encoding a parameter set into the video data stream, including a first syntax element indicating whether network abstraction layer (NAL) hypothetical reference decoder (HRD) parameters are present, a second syntax element indicating whether video coding layer (VCL) hypothetical reference decoder (HRD) parameters are present, a fixed-picture rate flag indicative of whether a picture output involves a fixed picture rate within a coded video sequence, and, if the fixed-picture rate flag indicates that the picture output involves a fixed picture rate within the coded video sequence, an elemental output picture duration syntax element; and
based at least in part on determining that the first syntax element indicates that NAL HRD parameters are not present and the second syntax element indicates that VCL HRD parameters are not present:
elemental picture output times are determinable for the coded video sequence based on the elemental output picture duration syntax element; and
a picture output multiplication syntax element in a picture timing supplemental enhancement information message of the video data stream, which reveals information on whether or not a respective access unit is subject to multiplied output and, if so, how many sequential output pictures are to be generated out of the respective access unit, is inferable to indicate non multiplied output.

### Claim 12 (depends on 11)

A non-transitory computer-readable medium storing a computer program for implementing the method of claim 11 when executed on a computer or signal processor.

### Claim 13 (depends on 11)

The method of claim 11, wherein:
the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag;
the first syntax element comprises general_nal_hrd_params_present_flag;
the elemental output picture duration syntax element comprises elemental_duration_in_tc_minus1;
the second syntax element comprises general_vcl_hrd_params_present_flag; and
the picture output multiplication syntax element comprises pt_display_elemental_periods_minus1.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
wherein the fixed-picture rate flag comprises fixed_pic_rate_within_cvs_flag, and wherein the fixed-picture rate flag is decoded based on a fixed_pic_rate_general_flag having a value of 1.