# US 12,003,777 B2 · Video decoder initialization information signaling > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,003,777 B2 - Document ID: US12003777B2 - Status: Granted - Kind: B2 - Application number: 17/566,220 - Filed: 2021-12-30 - Published: 2022-07-21 - Granted: 2024-06-04 - Earliest claimed: 2021-01-08 - Assignees: Lemon Inc. - Applicants: Lemon Inc. - Inventors: Ye-kui Wang - Web page: https://patentgrep.com/patent/US12003777B2 ## CPC - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/172: the region being a picture, frame or field - H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit} - H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence) - H04N 21/816: {involving special video data, e.g 3D video} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A mechanism for processing video data is disclosed. Video decoder initialization information (DII) is determined. The DII includes data describing a maximum level (MaxLevel) to which all coded video sequences (CVSs) of the bitstream conform and a maximum format that comprises one or more parameters. The MaxLevel indicates a first maximum DPB size needed for decoding the bitstream. The maximum format indicates a second maximum DPB size, denoted as DPB memory for as maximum format (DpbMemory4MaxFormat), determined by simultaneously setting all parameters of the maximum format to largest values. The DII further comprises a first indication of whether the DpbMemory4MaxFormat exceeds the first maximum DPB size. A conversion is performed between a visual media data and a bitstream based on the indication. ## Claims ### Claim 1 A method for processing video data comprising: determining decoder initialization information (DII) for a bitstream, wherein the DII includes data describing a maximum level (MaxLevel) to which all coded video sequences (CVSs) of the bitstream conform and a maximum format that comprises one or more of the following parameters: 1) a maximum number of decoded pictures (MaxDecPics) stored in the decoded picture buffer (DPB), 2) a maximum decoded picture width (MaxDecPicW) of all coded pictures in the bitstream, 3) a maximum decoded picture height (MaxDecPicH) of all coded pictures in the bitstream, 4) a maximum colour format (MaxColourFormat) of all coded pictures in the bitstream, and 5) a maximum bit depth (MaxBitdepth) of all coded pictures in the bitstream, wherein the MaxLevel indicates a first maximum DPB size needed for decoding the bitstream, wherein the maximum format indicates a second maximum DPB size, denoted as DPB memory for as maximum format (DpbMemory4MaxFormat), determined by simultaneously setting all parameters of the maximum format to largest values, and wherein the DII further comprises a first indication of whether the DpbMemory4MaxFormat exceeds the first maximum DPB size; and performing a conversion between a visual media data and a bitstream based on the first indication, wherein the DII further comprises a minimum level a decoder should support to decode the bitstream at a maximum format (MinLevel4MaxFormat), and wherein the MinLevel4MaxFormat signals a smallest level for which a value of a maximum picture size in luma samples (MaxLumaPs) is greater than or equal to the MaxDecPicW times the MaxDecPicH. ### Claim 2 (depends on 1) The method of claim 1, wherein the MinLevel4MaxFormat signals a smallest level for which the first maximum DPB size is greater than or equal to the DPBMemory4MaxFormat. ### Claim 3 (depends on 1) The method of claim 1, wherein the MinLevel4MaxFormat is signaled only when the first indication indicates that the DPBMemory4MaxFormat exceeds the first maximum DPB size. ### Claim 4 (depends on 1) The method of claim 1, wherein the MinLevel4MaxFormat is signaled only when the MaxDecPicW times the MaxDecPicH is greater than a maximum picture size (MaxLumaPs) of the MaxLevel. ### Claim 5 (depends on 1) The method of claim 1, wherein the MinLevel4MaxFormat signals a smallest level for which: the MaxDecPicW times the MaxDecPicH is less than or equal to a maximum picture size (MaxLumaPs) of the MaxLevel; and the MaxDecPics is less than or equal to the first maximum DPB size. ### Claim 6 (depends on 1) The method of claim 1, wherein the DII further comprises a second indication of whether the MaxDecPicW times the MaxDecPicH is greater than a maximum picture size (MaxLumaPs) of the MaxLevel. ### Claim 7 (depends on 1) The method of claim 1, wherein the DII further comprises a second indication of whether the MaxDecPicW times the MaxDecPicH is less than or equal to a maximum picture size (MaxLumaPs) of the MaxLevel of the coded video sequence. ### Claim 8 (depends on 7) The method of claim 7, wherein the second indication further indicates whether the MaxDecPics is less than or equal to the first maximum DPB size. ### Claim 9 (depends on 8) The method of claim 8, wherein the first maximum DPB size is determined by setting a maximum picture size in luma samples (PicSizeMaxInSamplesY) equal to MaxDecPicW times MaxDecPicH and setting MaxLumaPs for a level indicated by MinLevel4MaxFormat. ### Claim 10 (depends on 9) The method of claim 9, wherein a minimum level a decoder should support to decode the bitstream at a maximum format (MinLevel4MaxFormat) is only signaled in the DII when the second indication indicates that at least one of the following is false: the MaxDecPicW for the bitstream times the MaxDecPicH for the bitstream is less than or equal to the MaxLumaPs of the MaxLevel of the coded video sequence; and the MaxDecPics is less than or equal to the MaxDpbSize. ### Claim 11 (depends on 1) The method of claim 1, wherein the DII is signaled in a decoding capability information (DCI) network abstraction layer (NAL) unit, a supplemental enhancement information (SEI) message, a file format box, a dynamic adaptive streaming over Hypertext Transfer Protocol (DASH) media presentation description (MPD), or combinations thereof. ### Claim 12 (depends on 1) The method of claim 1, wherein the conversion comprises generating the bitstream according to the visual media data. ### Claim 13 (depends on 1) The method of claim 1, wherein the conversion comprises parsing the bitstream to obtain the visual media data. ### Claim 14 A non-transitory computer readable medium comprising a computer program product for use by a video coding device, the computer program product comprising computer executable instructions stored on the non-transitory computer readable medium such that when executed by a processor cause the video coding device to: determine decoder initialization information (DII) for a bitstream, wherein the DII includes data describing a maximum level (MaxLevel) to which all coded video sequences (CVSs) of the bitstream conform and a maximum format that comprises one or more of the following parameters: 1) a maximum number of decoded pictures (MaxDecPics) stored in the decoded picture buffer (DPB), 2) a maximum decoded picture width (MaxDecPicW) of all coded pictures in the bitstream, 3) a maximum decoded picture height (MaxDecPicH) of all coded pictures in the bitstream, 4) a maximum colour format (MaxColourFormat) of all coded pictures in the bitstream, and 5) a maximum bit depth (MaxBitdepth) of all coded pictures in the bitstream, wherein the MaxLevel indicates a first maximum DPB size needed for decoding the bitstream, wherein the maximum format indicates a second maximum DPB size, denoted as DPB memory for as maximum format (DpbMemory4MaxFormat), determined by simultaneously setting all parameters of the maximum format to largest values, and wherein the DII further comprises a first indication of whether the DpbMemory4MaxFormat exceeds the first maximum DPB size; and perform a conversion between a visual media data and a bitstream based on the first indication, wherein the DII further comprises a minimum level a decoder should support to decode the bitstream at a maximum format (MinLevel4MaxFormat), and wherein the MinLevel4MaxFormat signals a smallest level for which a value of a maximum picture size in luma samples (MaxLumaPs) is greater than or equal to the MaxDecPicW times the MaxDecPicH. ### Claim 15 (depends on 14) The non-transitory computer readable medium of claim 14, wherein the MinLevel4MaxFormat signals a smallest level for which the first maximum DPB size is greater than or equal to the DPBMemory4MaxFormat. ### Claim 16 (depends on 14) The non-transitory computer readable medium of claim 14, wherein the MinLevel4MaxFormat is signaled only when the first indication indicates that the DPBMemory4MaxFormat exceeds the first maximum DPB size. ### Claim 17 (depends on 14) The non-transitory computer readable medium of claim 14, wherein the MinLevel4MaxFormat is signaled only when the MaxDecPicW times the MaxDecPicH is greater than a maximum picture size (MaxLumaPs) of the MaxLevel. ### Claim 18 An apparatus for processing video data comprising: a processor; and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to: determine decoder initialization information (DII) for a bitstream, wherein the DII includes data describing a maximum level (MaxLevel) to which all coded video sequences (CVSs) of the bitstream conform and a maximum format that comprises one or more of the following parameters: 1) a maximum number of decoded pictures (MaxDecPics) stored in the decoded picture buffer (DPB), 2) a maximum decoded picture width (MaxDecPicW) of all coded pictures in the bitstream, 3) a maximum decoded picture height (MaxDecPicH) of all coded pictures in the bitstream, 4) a maximum colour format (MaxColourFormat) of all coded pictures in the bitstream, and 5) a maximum bit depth (MaxBitdepth) of all coded pictures in the bitstream, wherein the MaxLevel indicates a first maximum DPB size needed for decoding the bitstream, wherein the maximum format indicates a second maximum DPB size, denoted as DPB memory for as maximum format (DpbMemory4MaxFormat), determined by simultaneously setting all parameters of the maximum format to largest values, and wherein the DII further comprises a first indication of whether the DpbMemory4MaxFormat exceeds the first maximum DPB size; and perform a conversion between a visual media data and a bitstream based on the first indication, wherein the DII further comprises a minimum level a decoder should support to decode the bitstream at a maximum format (MinLevel4MaxFormat), and wherein the MinLevel4MaxFormat signals a smallest level for which a value of a maximum picture size in luma samples (MaxLumaPs) is greater than or equal to the MaxDecPicW times the MaxDecPicH. ### Claim 19 (depends on 18) The apparatus of claim 18, wherein the MinLevel4MaxFormat signals a smallest level for which the first maximum DPB size is greater than or equal to the DPBMemory4MaxFormat. ### Claim 20 (depends on 18) The apparatus of claim 18, wherein the MinLevel4MaxFormat is signaled only when the first indication indicates that the DPBMemory4MaxFormat exceeds the first maximum DPB size.