# US 11,910,022 B2 · Decoded picture buffer memory allocation and picture output in scalable video coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,910,022 B2 - Document ID: US11910022B2 - Status: Granted - Kind: B2 - Application number: 17/946,637 - Filed: 2022-09-16 - Published: 2023-01-26 - Granted: 2024-02-20 - Earliest claimed: 2020-03-17 - Assignees: Bytedance Inc. - Applicants: Bytedance Inc. - Inventors: Ye-kui Wang - Web page: https://patentgrep.com/patent/US11910022B2 ## CPC - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/11: among a plurality of spatial predictive coding modes - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/172: the region being a picture, frame or field - H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) - H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence) - H04N 19/593: involving spatial prediction techniques - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods and apparatus for video processing, including coding and decoding, are described. One example video processing method includes performing a conversion between a video having one or more video layers and a bitstream of the video according to a format rule, and wherein the format rule specifies that a value of a flag that indicates whether to remove pictures previously decoded and stored in a decoded picture buffer from the decoded picture buffer when decoding an access unit of a certain type is included in the bitstream. ## Claims ### Claim 1 A method of video processing, comprising: performing a conversion between a video having one or more video layers and a bitstream of the video according to a format rule, wherein the format rule specifies that a value of a flag that indicates whether to remove pictures previously decoded and stored in a decoded picture buffer from the decoded picture buffer when decoding an access unit of a certain type is included in the bitstream, wherein the format rule specifies that a value of a variable that indicates whether pictures in the decoded picture buffer prior to a current picture in decoding order in the bitstream are output before the pictures are removed from the decoded picture buffer is set to a predetermined value when a first condition related with a greatest allowed value of a chroma format indicator or a greatest allowed value of a bit depth used to represent pixels of the video is satisfied, wherein the value of the variable is set to the value of the flag when the first condition is not satisfied, and wherein the first condition is not satisfied when a color format or a bit depth of pictures changes but the greatest allowed value of the chroma format indicator or the greatest allowed value of the bit depth does not change. ### Claim 2 (depends on 1) The method of claim 1, wherein the format rule specifies that the value of the flag for the access unit is same for all pictures in the access unit. ### Claim 3 (depends on 1) The method of claim 1, wherein the format rule specifies that the value of the flag for the access unit is same for all slices in the access unit. ### Claim 4 (depends on 1) The method of claim 1, wherein the format rule specifies that the value of the flag is considered to be a value of a flag for pictures or slices of the access unit. ### Claim 5 (depends on 1) The method of claim 1, wherein the flag is indicated in a picture header. ### Claim 6 (depends on 1) The method of claim 1, wherein the flag is indicated in a slice header. ### Claim 7 (depends on 1) The method of claim 1, wherein the conversion includes encoding the video into the bitstream. ### Claim 8 (depends on 1) The method of claim 1, wherein the conversion includes decoding the video from the bitstream. ### Claim 9 (depends on 1) The method of claim 1, wherein the greatest allowed value of the chroma format indicator and/or the greatest allowed value of a bit depth used to represent pixels of the video are included in a video parameter set. ### Claim 10 (depends on 1) The method of claim 1, wherein the greatest allowed value of the chroma format indicator for a layer is applicable to all sequence parameter sets that are referred to by one or more layer video sequences in the layer. ### Claim 11 An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to: perform a conversion between a video having one or more video layers and a bitstream of the video according to a format rule, wherein the format rule specifies that a value of a flag that indicates whether to remove pictures previously decoded and stored in a decoded picture buffer from the decoded picture buffer when decoding an access unit of a certain type is included in the bitstream, wherein the format rule specifies that a value of a variable that indicates whether pictures in the decoded picture buffer prior to a current picture in decoding order in the bitstream are output before the pictures are removed from the decoded picture buffer is set to a predetermined value when a first condition related with a greatest allowed value of a chroma format indicator or a greatest allowed value of a bit depth used to represent pixels of the video is satisfied, wherein the value of the variable is set to the value of the flag when the first condition is not satisfied, and wherein the first condition is not satisfied when a color format or a bit depth of pictures changes but the greatest allowed value of the chroma format indicator or the greatest allowed value of the bit depth does not change. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein the format rule specifies that the value of the flag for the access unit is same for all pictures in the access unit. ### Claim 13 (depends on 11) The apparatus of claim 11, wherein the format rule specifies that the value of the flag for the access unit is same for all slices in the access unit. ### Claim 14 (depends on 11) The apparatus of claim 11, wherein the format rule specifies that the value of the flag is considered to be a value of a flag for pictures or slices of the access unit. ### Claim 15 (depends on 11) The apparatus of claim 11, wherein the flag is indicated in a picture header. ### Claim 16 A non-transitory computer-readable storage medium storing instructions that cause a processor to: perform a conversion between a video having one or more video layers and a bitstream of the video according to a format rule, wherein the format rule specifies that a value of a flag that indicates whether to remove pictures previously decoded and stored in a decoded picture buffer from the decoded picture buffer when decoding an access unit of a certain type is included in the bitstream, wherein the format rule specifies that a value of a variable that indicates whether pictures in the decoded picture buffer prior to a current picture in decoding order in the bitstream are output before the pictures are removed from the decoded picture buffer is set to a predetermined value when a first condition related with a greatest allowed value of a chroma format indicator or a greatest allowed value of a bit depth used to represent pixels of the video is satisfied, wherein the value of the variable is set to the value of the flag when the first condition is not satisfied, and wherein the first condition is not satisfied when a color format or a bit depth of pictures changes but the greatest allowed value of the chroma format indicator or the greatest allowed value of the bit depth does not change. ### Claim 17 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein the format rule specifies that the value of the flag for the access unit is same for all slices in the access unit. ### Claim 18 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein the format rule specifies that the value of the flag is considered to be a value of a flag for pictures or slices of the access unit. ### Claim 19 A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises: generating the bitstream of the video having one or more video layers according to a format rule, wherein the format rule specifies that a value of a flag that indicates whether to remove pictures previously decoded and stored in a decoded picture buffer from the decoded picture buffer when decoding an access unit of a certain type is included in the bitstream, wherein the format rule specifies that a value of a variable that indicates whether pictures in the decoded picture buffer prior to a current picture in decoding order in the bitstream are output before the pictures are removed from the decoded picture buffer is set to a predetermined value when a first condition related with a greatest allowed value of a chroma format indicator or a greatest allowed value of a bit depth used to represent pixels of the video is satisfied, wherein the value of the variable is set to the value of the flag when the first condition is not satisfied, and wherein the first condition is not satisfied when a color format or a bit depth of pictures changes but the greatest allowed value of the chroma format indicator or the greatest allowed value of the bit depth does not change.