# US 11,909,995 B2 · Indication of end of sequence in coded video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,909,995 B2
- Document ID: US11909995B2
- Status: Granted
- Kind: B2
- Application number: 17/988,934
- Filed: 2022-11-17
- Published: 2023-03-09
- Granted: 2024-02-20
- Earliest claimed: 2020-05-22
- Assignees: Bytedance Inc.
- Applicants: Bytedance Inc.
- Inventors: Ye-kui Wang
- Web page: https://patentgrep.com/patent/US11909995B2

## CPC

- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 7/01: Conversion of standards {, e.g. involving analogue television standards or digital television standards processed at pixel level}
- H04N 19/172: the region being a picture, frame or field
- H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit}
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video. The bitstream conforms to a format rule. The bitstream includes one or more layers including one or more picture units (PUs). The format rule specifies that, responsive to a first PU in a layer of the bitstream following an end of sequence network abstraction layer (EOS NAL) unit in the layer in a decoding order, a variable of the first PU is set to a particular value, wherein the variable indicates whether the first PU is a coded layer video sequence start (CLVSS) PU.

## Claims

### Claim 1

A method of video processing, comprising:
performing a conversion between a video and a bitstream of the video according to a first format rule,
wherein the bitstream comprises one or more layers comprising one or more picture units (PUs), and
wherein the first format rule specifies that, responsive to a first PU in a layer of the bitstream following an end of sequence network abstraction layer (EOS NAL) unit in the layer in a decoding order, a variable of the first PU is set to a particular value, wherein the variable indicates whether the first PU is a coded layer video sequence start (CLVSS) PU;
wherein the first PU is a clean random access PU, and another variable of the clean random access PU is set to indicate that the clean random access PU is handled as the CLVSS PU.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first PU is an instantaneous decoding refresh PU.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first PU is a gradual decoding refresh PU.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first PU is a first PU in the layer in the decoding order.

### Claim 5 (depends on 1)

The method of claim 1, wherein the variable corresponds to NoOutputBeforeRecoveryFlag.

### Claim 6 (depends on 1)

The method of claim 1, wherein the conversion is performed according to a second format rule, wherein the second format rule specifies that a PU of a particular layer after an end of sequence network abstraction layer (EOS NAL) unit of the particular layer is a particular type of PU.

### Claim 7 (depends on 6)

The method of claim 6, wherein the particular type of PU is one of an intra random access point (IRAP) type or a Gradual Decoding Refresh (GDR) type.

### Claim 8 (depends on 6)

The method of claim 6, wherein the particular type of PU is a CLVSS PU.

### Claim 9 (depends on 1)

The method of claim 1, wherein the conversion is performed according to a third format rule, wherein the third format rule specifies that, when present, an end of sequence (EOS) raw byte sequence payload (RBSP) syntax structure specifies that a next subsequent PU that belongs to a same layer as the EOS NAL unit in the bitstream in the decoding order is of a particular PU type from an intra random access point (IRAP) PU type or a gradual decoding refresh (GDR) PU type.

### Claim 10 (depends on 9)

The method of claim 9, wherein the particular PU type is the IRAP PU type.

### Claim 11 (depends on 9)

The method of claim 9, wherein the particular PU type is the GDR PU type.

### Claim 12 (depends on 1)

The method of claim 1, wherein the PU comprises a picture header NAL unit, a coded picture comprising one or more video coding layer NAL units and zero or more non-video coding layer NAL units.

### Claim 13 (depends on 1)

The method of claim 1, wherein the performing the conversion comprises encoding the video into the bitstream.

### Claim 14 (depends on 1)

The method of claim 1, wherein the performing the conversion comprises decoding the video from the bitstream.

### Claim 15

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
perform a conversion between a video and a bitstream of the video according to a first format rule,
wherein the bitstream comprises one or more layers comprising one or more picture units (PUs), and
wherein the first format rule specifies that, responsive to a first PU in a layer of the bitstream following an end of sequence network abstraction layer (EOS NAL) unit in the layer in a decoding order, a variable of the first PU is set to a particular value, wherein the variable indicates whether the first PU is a coded layer video sequence start (CLVSS) PU;
wherein the first PU is a clean random access PU, and another variable of the clean random access PU is set to indicate that the clean random access PU is handled as the CLVSS PU.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the conversion is performed according to a second format rule or a third format rule,
wherein the second format rule specifies that a PU of a particular layer after an end of sequence network abstraction layer (EOS NAL) unit of the particular layer is a particular type of PU, and
wherein the third format rule specifies that, when present, an end of sequence (EOS) raw byte sequence payload (RBSP) syntax structure specifies that a next subsequent PU that belongs to a same layer as the EOS NAL unit in the bitstream in the decoding order is of a particular PU type from an intra random access point (IRAP) PU type or a gradual decoding refresh (GDR) PU type.

### Claim 17

A non-transitory computer-readable storage medium storing instructions that cause a processor to:
perform a conversion between a video and a bitstream of the video according to a first format rule,
wherein the bitstream comprises one or more layers comprising one or more picture units (PUs),
wherein the first format rule specifies that, responsive to a first PU in a layer of the bitstream following an end of sequence network abstraction layer (EOS NAL) unit in the layer in a decoding order, a variable of the first PU is set to a particular value, wherein the variable indicates whether the first PU is a coded layer video sequence start (CLVSS) PU;
wherein the first PU is a clean random access PU, and another variable of the clean random access PU is set to indicate that the clean random access PU is handled as the CLVSS PU.

### Claim 18

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
generating the bitstream of the video according to a first format rule,
wherein the bitstream comprises one or more layers comprising one or more picture units (PUs), and
wherein the first format rule specifies that, responsive to a first PU in a layer of the bitstream following an end of sequence network abstraction layer (EOS NAL) unit in the layer in a decoding order, a variable of the first PU is set to a particular value, wherein the variable indicates whether the first PU is a coded layer video sequence start (CLVSS) PU;
wherein the first PU is a clean random access PU, and another variable of the clean random access PU is set to indicate that the clean random access PU is handled as the CLVSS PU.
