US 2022/0103850 A1Published application

Method for layerwise random access in a coded video stream

AssigneeTencent America LLC

InventorsByeongdoo CHOI, Shan Liu, Stephan WENGER

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method of generating an encoded video bitstream, including obtaining an IRAP AU from a video bitstream; determining whether the IRAP AU is a first AU in a decoding order, whether each picture is an IDR picture, or whether each picture is a first picture of a layer following an EOS NAL unit; if so, setting a first flag for the IRAP AU equal to one; if not, determining whether a second flag for the IRAP AU is externally set to an external value; if so, setting the first flag for the IRAP AU equal to the external value; and if not, setting the first flag for the IRAP AU and the second flag for the IRAP AU equal to zero; encoding the video bitstream based on the first flag and the second flag; and transmitting the encoded video bitstream.

Claims20

Dependent claims

A method of generating an encoded video bitstream using at least one processor, the method comprising:

obtaining a non-intra random access point (IRAP) access unit (AU) from a video bitstream;
obtaining an IRAP picture unit (PU) from the non-IRAP AU;
determining whether a picture corresponding to the IRAP PU is an instantaneous decoder refresh (IDR) picture, and whether the picture is a first picture of a layer that follows an end of sequence (EOS) network abstraction layer (NAL) unit in a decoding order;
based on determining that the picture is the IDR picture or determining that the picture is the first picture of the layer that follows the EOS NAL unit in the decoding order, setting a first flag for the IRAP PU equal to one;
based on determining that the picture is not the IDR picture, and determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, determining whether a second flag for the RAP PU is externally set to an external value;
based on determining that the picture is not the IDR picture, determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, and determining that the second flag for the RAP PU is externally set to an external value, setting the first flag for the RAP PU to the external value;
based on the determining that the picture is not the IDR picture, the determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, and determining that the second flag for the IRAP PU is not externally set to the external value, setting the first flag for the IRAP PU equal to zero and setting the second flag for the IRAP PU equal to zero;
encoding the video bitstream based on the first flag for the IRAP PU and the second flag for the IRAP PU;
and
transmitting the encoded video bitstream.

7 more elements

A device for generating an encoded video bitstream, the device comprising:

at least one memory configured to store program code;
and
at least one processor configured to read the program code and operate as instructed by the program code, the program code including
first obtaining code configured to cause the at least one processor to obtain a non-intra random access point (IRAP) AU from a video bitstream;
second obtaining code configured to cause the at least one processor to obtain an IRAP picture unit (PU) from the non-IRAP AU;
first determining code configured to cause the at least one processor to determine whether a picture corresponding to the IRAP PU is an instantaneous decoder refresh (IDR) picture, and whether the picture is a first picture of a layer that follows the an end of sequence (EOS) network abstraction layer (NAL) unit in a decoding order;
first setting code configured to cause the at least one processor to, based on determining that the picture is the IDR picture or determining that the picture is the first picture of the layer that follows the EOS NAL unit in the decoding order, set a first flag for the IRAP PU equal to one;
second determining code configured to cause the at least one processor to, based on determining that the picture is not the IDR picture, and determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, determine whether a second flag for the IRAP PU is externally set to an external value;
second setting code configured to cause the at least one processor to, based on determining that the picture is not the IDR picture, determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, and determining that the second flag for the IRAP PU is externally set to the external value, set the first flag for the IRAP PU to the external value;
third setting code configured to cause the at least one processor to, based on the determining that the picture is not the IDR picture, the determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, and determining that the second flag for the IRAP PU is not externally set to the external value, set the first flag for the IRAP PU equal to zero and set the second flag for the IRAP PU equal to zero,
wherein the video bitstream is further encoded based on the first flag for the IRAP PU and the second flag for the IRAP PU;
encoding the video bitstream based on the first flag for the IRAP PU and the second flag for the IRAP PU;
and
transmitting the encoded video bitstream.

11 more elements

A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors of a device for generating an encoded video bitstream, cause the one or more processors to:
obtain a non-intra random access point (IRAP) AU from a video bitstream;
obtain an IRAP picture unit (PU) from the non-IRAP AU;
determine whether a picture corresponding to the IRAP PU is an instantaneous decoder refresh (IDR) picture, and whether the picture is a first picture of a layer that follows an end of sequence (EOS) network abstraction layer (NAL) unit in a decoding order;
based on determining that the picture is the IDR picture or determining that the picture is the first picture of the layer that follows the EOS NAL unit in the decoding order, set a first flag for the IRAP PU equal to one;
based on determining that the picture is not the IDR picture, and determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, determine whether a second flag for the IRAP PU is externally set to an external value;
based on determining that the picture is not the IDR picture, determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, and determining that the second flag for the IRAP PU is externally set to the external value, set the first flag for the IRAP PU to the external value;
based on the determining that the picture is not the IDR picture, the determining that the picture is not the first picture of the layer that follows the EOS NAL unit in the decoding order, and determining that the second flag for the IRAP PU is not externally set to the external value, set the first flag for the IRAP PU equal to zero and set the second flag for the IRAP PU equal to zero,
wherein the video bitstream is further encoded based on the first flag for the IRAP PU and the second flag for the IRAP PU;
encode the video bitstream based on the first flag for the IRAP PU and the second flag for the IRAP PU;
and
transmit the encoded video bitstream.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/546,780Filed 9 Dec 2021
Priority: 30 Dec 2019
Published: 31 Mar 2022
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04N 19/30
Methods or arrangements for coding, decoding, compressing or decompressing digital video signals: using hierarchical techniques, e.g. scalability
H04N 19/46
Methods or arrangements for coding, decoding, compressing or decompressing digital video signals: embedding additional information in the video…
H04N 19/129
Characterised by the element, parameter or selection affected or controlled by the adaptive coding: scanning of coding units, e.g. zig-zag scan of…
H04N 19/159
Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter:…

Family

Application62/954,880Us provisional application · filed 30 Dec 2019
Application17/063,082Continuation · filed 5 Oct 2020
Application17/546,780Continuation
US 11,228,777 B2Related patent
US 11,765,373 B2Related patent
US 2021/0203970 A1Published application
US 2022/0103850 A1This patent

From the US filing history. Foreign family members aren’t listed.