# US 12,120,329 B2 · Sub-bitstream extraction-based image coding device and method for scalability > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,120,329 B2 - Document ID: US12120329B2 - Status: Granted - Kind: B2 - Application number: 18/075,822 - Filed: 2022-12-06 - Published: 2023-04-06 - Granted: 2024-10-15 - Earliest claimed: 2020-06-06 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Hendry Hendry - Web page: https://patentgrep.com/patent/US12120329B2 ## CPC - H04N 19/31: in the temporal domain - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) - H04N 19/172: the region being a picture, frame or field - H04N 19/187: the unit being a scalable video layer - H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit} - H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract According to embodiment(s) of the present document, multilayer-based coding can be performed. The multilayer-based coding can include a sub-bitstream extraction process. Inputs of the sub-bitstream extraction process can include a value related to a target OLS index and a value related to a highest temporal identifier. ## Claims ### Claim 1 An image decoding method performed by a decoding apparatus, the method comprising: obtaining image information from a sub-bitstream; decoding a picture being belonging to a layer included in a target output layer set (OLS) for a target OLS index and being related to a highest temporal identifier; and outputting the decoded picture, wherein the sub-bitstream is derived based on sub-bitstream extraction process for a bitstream, wherein inputs of the sub-bitstream extraction process includes a value related to the target OLS index and a value related to the highest temporal identifier, wherein the sub-bitstream includes a specific network abstraction layer (NAL) unit including information on both the target OLS index and the highest temporal identifier, wherein a value of the information on the target OLS index is set based on an input for the sub-bitstream extraction process and a value of the information on the highest temporal identifier is set based on the input for the sub-bitstream extraction process, and wherein the specific NAL unit including the information on the target OLS index and the information on the highest temporal identifier is a first NAL unit in an access unit (AU) based on the image information including the AU which contains the specific NAL unit and does not contain an access unit delimiter (AUD) NAL unit. ### Claim 2 (depends on 1) The method of claim 1, wherein the sub-bitstream extraction process comprises removing the specific NAL unit including the information on the target OLS index and the information on the highest temporal identifier. ### Claim 3 (depends on 1) The method of claim 1, wherein the target OLS index is set based on an external means or the information on the target OLS index obtained from the sub-bitstream, wherein based on the external means being available, the target OLS index is set based on the external means, and wherein based on the external means not being available, the target OLS index is set based on the information on the target OLS index. ### Claim 4 (depends on 1) The method of claim 1, wherein the highest temporal identifier is set based on an external means or the information on the highest temporal identifier obtained based on the sub-bitstream, wherein based on the external means being available, the highest temporal identifier is set based on the external means, and wherein based on the external means not being available, the highest temporal identifier is set based on the information on the highest temporal identifier. ### Claim 5 (depends on 1) The method of claim 1, wherein the picture is decoded based on a temporal sublayer having a temporal identifier, and wherein the value of the temporal identifier is smaller than that of the highest temporal identifier. ### Claim 6 A non-transitory computer readable storage medium for storing encoded information causing an image decoding apparatus to perform the image decoding method of 1. ### Claim 7 A decoding apparatus for performing an image decoding method, the decoding apparatus comprising: a bitstream extractor for deriving a sub-bitstream from a bitstream based on a sub-bitstream extraction process and obtaining image information from the sub-bitstream; and a decoder for decoding a picture belonging to a layer included in a target output layer set (OLS) for a target OLS index and being related to a highest temporal identifier and outputting the decoded picture, wherein inputs of the sub-bitstream extraction process include a value related to the target OLS index and a value related to the highest temporal identifier, wherein the sub-bitstream includes a specific network abstraction layer (NAL) unit including information on both the target OLS index and the highest temporal identifier, wherein a value of the information on the target OLS index is set based on an input for the sub-bitstream extraction process and a value of the information on the highest temporal identifier is set based on the input for the sub-bitstream extraction process, wherein the specific NAL unit including the information on the target OLS index and the information on the highest temporal identifier is a first NAL unit in an access unit (AU) based on the image information including the AU which contains the specific NAL unit and does not contain an access unit delimiter (AUD) NAL unit. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the sub-bitstream extraction process comprises removing the specific NAL unit including the information on the target OLS index and the information on the highest temporal identifier. ### Claim 9 (depends on 7) The apparatus of claim 7, wherein the target OLS index is set based on an external means or the information on the target OLS index obtained from the sub-bitstream, wherein based on the external means being available, the target OLS index is set based on the external means, and wherein based on the external means not being available, the target OLS index is set based on the information on the target OLS index. ### Claim 10 (depends on 7) The apparatus of claim 7, wherein the highest temporal identifier is set based on an external means or the information on the highest temporal identifier obtained based on the sub-bitstream, wherein based on the external means being available, the highest temporal identifier is set based on the external means, and wherein based on the external means not being available, the highest temporal identifier is set based on the information on the highest temporal identifier. ### Claim 11 (depends on 7) The apparatus of claim 7, wherein the picture is decoded based on a temporal sublayer having a temporal identifier, and the value of the temporal ID is smaller than that of the highest temporal identifier. ### Claim 12 A method for transmitting data for image information causing an image decoding apparatus to perform the image decoding method, the image decoding method comprising: obtaining image information from a sub-bitstream; decoding a picture being belonging to a layer included in a target output layer set (OLS) for a target OLS index and being related to a highest temporal identifier; and outputting the decoded picture, wherein the sub-bitstream is derived based on sub-bitstream extraction process for a bitstream, and wherein inputs of the sub-bitstream extraction process includes a value related to the target OLS index and a value related to the highest temporal identifier, wherein the sub-bitstream includes a specific network abstraction layer (NAL) unit including information on the target OLS index and the highest temporal identifier, wherein a value of the information on the target OLS index is set based on an input for the sub-bitstream extraction process and a value of the information on the highest temporal identifier is set based on the input for the sub-bitstream extraction process, and wherein the specific NAL unit including the information on the target OLS index and the information on the highest temporal identifier is a first NAL unit in an access unit (AU) based on the image information including the AU which contains the specific NAL unit and does not contain an access unit delimiter (AUD) NAL unit. ### Claim 13 An image encoding method performed by an encoding apparatus, the method comprising: obtaining an image; encoding the image; and outputting a bitstream including image information based on the encoding; wherein the bitstream includes a specific network abstraction layer (NAL) unit including information on a target output layer set (OLS) index and information on a highest temporal identifier, wherein the specific NAL unit including the information on the target OLS index and the information on the highest temporal identifier is a first NAL unit in an access unit (AU) based on the image information including the AU which contains the specific NAL unit and does not contain an access unit delimiter (AUD) NAL unit.