# US 2023/0054567 A1 · Video coding in relation to subpictures > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0054567 A1 - Document ID: US20230054567A1 - Status: Published application - Kind: A1 - Application number: 17/787,219 - Filed: 2020-12-18 - Published: 2023-02-23 - Earliest claimed: 2019-12-20 - Assignees: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. - Applicants: Fraunhofer-Gesellschaft Zur FöRderung Der Angewandten Forschung E.V. - Inventors: Yago SÁNCHEZ DE LA FUENTE; Karsten SÜHRING; Cornelius HELLGE; Thomas SCHIERL; Robert SKUPIN; Thomas WIEGAND - Web page: https://patentgrep.com/patent/US20230054567A1 ## CPC - H04N 19/136: Incoming video signal characteristics or properties - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks - H04N 19/184: the unit being bits, e.g. of the compressed video stream - H04N 19/31: in the temporal domain - H04N 19/33: in the spatial domain - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/51: Motion estimation or motion compensation - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/15: by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer - H04N 19/172: the region being a picture, frame or field - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/187: the unit being a scalable video layer - H04N 19/39: involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Concepts are described, including encoding, processing and decoding of a data stream having a video encoded thereinto, wherein the video comprises a plurality of pictures, wherein the data stream comprises a plurality of pictures in at least two layers, wherein the pictures of at least one layer are split into a predetermined layer-specific number of subpictures, one or more of the pictures or subpictures of one layer corresponds to one picture or subpictures in one or more other layer, and at least one of the subpictures comprises boundaries for boundary extension for motion compensation, and an indication that at least one of the boundaries of corresponding subpictures or corresponding pictures in different layers are aligned with each other. ## Claims ### Claim at position 1 1-169. (canceled) ### Claim 170 An encoder configured to: encode a picture of a video into a data stream, the picture comprising a plurality of subpictures, wherein the encoding of the picture comprises encoding, into the data stream, a first subpicture of the plurality of subpictures such that BinCountsInNalUnits for the first subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷ 32. ### Claim 171 (depends on 170) The encoder of claim 170, wherein the encoding of the picture comprises encoding into the data stream, a second subpicture of the plurality of subpictures such that BinCountsInNalUnits for the second subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 172 (depends on 170) The encoder of claim 170, wherein the encoding of the first subpicture comprises encoding a value of 1 for a subpic_treated_as_pic_flag associated with the first subpicture. ### Claim 173 (depends on 172) The encoder of claim 172, wherein the encoding of the first subpicture comprises determining that BinCountsInNalUnits for the first subpicture is greater than (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32, where RawMinCuBits=MinCbSizeY*MinCbSizeY*(BitDepth+2*BitDepth/(SubWidthC*SubHeightC)); based on the value of 1 for the subpic_treated_as_pic_flag associated with the first subpicture and the determination that BinCountsInNalUnits for the first subpicture is greater than (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32, adding one or more cabac_zero_words to the bitstream until BinCountsInNalUnits for the first subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 174 (depends on 173) The encoder of claim 173, wherein the encoding of the picture comprises encoding into the data stream, a second subpicture of the plurality of subpictures such that BinCountsInNalUnits for the second subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 175 (depends on 174) The encoder of claim 174, wherein the encoding of the second subpicture comprises encoding a value of 1 for a subpic_treated_as_pic_flag associated with the second subpicture. ### Claim 176 (depends on 175) The encoder of claim 175, wherein the encoding of the second subpicture comprises determining that BinCountsInNalUnits for the second subpicture is greater than (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32, where RawMinCuBits=MinCbSizeY*MinCbSizeY*(BitDepth+2*BitDepth/(SubWidthC*SubHeightC)); based on the value of 1 for the subpic_treated_as_pic_flag associated with the second subpicture and the determination that BinCountsInNalUnits for the second subpicture is greater than (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32, adding one or more cabac_zero_words to the bitstream until BinCountsInNalUnits for the second subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 177 A video bitstream comprising an encoded picture, the encoded picture comprising a plurality of subpictures, the plurality of subpictures comprising a first subpicture such that BinCountsInNalUnits for the first subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 178 (depends on 177) The video bitstream of claim 177, wherein the plurality of subpictures comprises a second subpicture such that BinCountsInNalUnits for the second subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 179 A decoder configured to decode a picture from a video bitstream, the picture comprising a plurality of subpictures, the plurality of subpictures comprising a first subpicture such that BinCountsInNalUnits for the first subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 180 (depends on 179) The decoder of claim 179, wherein the plurality of subpictures comprises a second subpicture such that BinCountsInNalUnits for the second subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 181 An encoding method comprising the steps of: encoding a picture of a video into a data stream, the picture comprising a plurality of subpictures, wherein the step of encoding the picture of the video into the data stream comprises encoding, into the data stream, a first subpicture of the plurality of subpictures such that BinCountsInNalUnits for the first subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 182 (depends on 181) The encoding method of claim 181, wherein the step of encoding the picture of the video into the data stream comprises encoding into the data stream, a second subpicture of the plurality of subpictures such that BinCountsInNalUnits for the second subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 183 A decoding method comprising the steps of: decoding a picture from a video bitstream, the picture comprising a plurality of subpictures, the plurality of subpictures comprising a first subpicture such that BinCountsInNalUnits for the first subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32. ### Claim 184 (depends on 183) The decoder method claim 183, wherein the plurality of subpictures comprises a second subpicture such that BinCountsInNalUnits for the second subpicture is less than or equal to (32÷3)*NumBytesInVclNalUnits+(RawMinCuBits*PicSizeInMinCbsY)÷32.