# US 2023/0056436 A1 · Green metadata signaling > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0056436 A1 - Document ID: US20230056436A1 - Status: Published application - Kind: A1 - Application number: 17/816,237 - Filed: 2022-07-29 - Published: 2023-02-23 - Earliest claimed: 2021-08-09 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Yong HE; Muhammed Zeyd COBAN - Web page: https://patentgrep.com/patent/US20230056436A1 ## CPC - H04N 19/127: Prioritisation of hardware or computational resources - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) - H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/1883: {the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed are systems, methods, apparatuses, and computer-readable media for processing video data. For instance, an apparatus for processing video data, may include: at least one memory; and at least one processor coupled to the at least one memory, the at least one processor being configured to: obtain a bitstream; retrieve a granularity type syntax element associated with the bitstream, the granularity type syntax element specifying a type of granularity of one or more pictures over which complexity metrics (CM) associated with the bitstream are applicable; retrieve a period type syntax element associated with the bitstream, the period type syntax element indicating an upcoming period of time or a set of pictures over which the CM are applicable; and decode a portion of the bitstream based on the granularity type syntax element and the period type syntax element. ## Claims ### Claim 1 An apparatus for processing video data, comprising: at least one memory; and at least one processor coupled to the at least one memory, the at least one processor being configured to: obtain a bitstream; retrieve a granularity type syntax element associated with the bitstream, the granularity type syntax element specifying a type of granularity of one or more pictures over which complexity metrics (CM) associated with the bitstream are applicable; retrieve a period type syntax element associated with the bitstream, the period type syntax element indicating an upcoming period of time or a set of pictures over which the CM are applicable; and decode a portion of the bitstream based on the granularity type syntax element and the period type syntax element. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein a value of the granularity type syntax element specifies that the CM are applicable to a picture or a portion of the picture of the bitstream, the portion of the picture being less than an entirety of the picture. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein a value of the granularity type syntax element specifies that the CM are applicable to at least one of a slice, a tile, a subpicture, a scalable layer, or a coding tree unit (CTU) row of the one or more pictures of the bitstream. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the period type syntax element indicates at least one of a specified time interval for the upcoming period, a number of pictures for the upcoming period, that the upcoming period includes all pictures up to a picture including a next slice, or that the upcoming period includes a single picture. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the at least one processor is configured to retrieve a granularity level CM syntax structure associated with the bitstream, the granularity level CM syntax structure specifying granularity level complexity metrics for one or more granularity segments of the bitstream over the upcoming period. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the at least one processor is configured to: retrieve an additional period type syntax element associated with the bitstream, the additional period type syntax element being associated with the granularity type syntax element, wherein the additional period type syntax element differs from the period type syntax element; and decode the portion of the bitstream based on the granularity type syntax element and the additional period type syntax element. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the at least one processor is configured to retrieve at least one of: a subpicture syntax element associated with the bitstream, the subpicture syntax element indicating that a subpicture identifier (ID) is signaled when the CM applies to multiple pictures; a coding tree block (CTB) number syntax element associated with the bitstream, the CTB number syntax element indicating a total number of coding tree luma blocks over the upcoming period may be signaled in CM when the type of granularity is equal to a slice or a tile and the upcoming period is over multiple pictures; or an average CTB number syntax element associated with the bitstream, the average CTB number syntax element indicating an average number of CTBs or 4×4 blocks per granularity per picture. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein intra-coded block statistics are signaled in association with at least a portion of the bitstream when there are intra-coded blocks available in at least the portion the bitstream. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein inter-coded block statistics are signaled in association with at least a portion of the bitstream when there are inter-coded blocks available in at least the portion the bitstream. ### Claim 10 (depends on 1) The apparatus of claim 1, wherein the at least one processor is configured to determine an operating frequency of the apparatus based on the CM associated with the bitstream. ### Claim 11 (depends on 1) The apparatus of claim 1, further comprising a display configured to display at least the portion of the bitstream. ### Claim 12 (depends on 1) The apparatus of claim 1, wherein the apparatus is one of a mobile device, a wearable device, an extended reality device, a camera, a personal computer, a vehicle, a robotic device, a television, or a computing device. ### Claim 13 A method for processing video data, comprising: obtaining a bitstream; retrieving a granularity type syntax element associated with the bitstream, the granularity type syntax element specifying a type of granularity of one or more pictures over which complexity metrics (CM) associated with the bitstream are applicable; retrieving a period type syntax element associated with the bitstream, the period type syntax element indicating an upcoming period of time or a set of pictures over which the CM are applicable; and decoding a portion of the bitstream based on the granularity type syntax element and the period type syntax element. ### Claim 14 (depends on 13) The method of claim 13, wherein a value of the granularity type syntax element specifies that the CM are applicable to a picture or a portion of the picture of the bitstream, the portion of the picture being less than an entirety of the picture. ### Claim 15 (depends on 13) The method of claim 13, wherein a value of the granularity type syntax element specifies that the CM are applicable to at least one of a slice, a tile, a subpicture, a scalable layer, or a coding tree unit (CTU) row of the one or more pictures of the bitstream. ### Claim 16 (depends on 13) The method of claim 13, wherein the period type syntax element indicates at least one of a specified time interval for the upcoming period, a number of pictures for the upcoming period, that the upcoming period includes all pictures up to a picture including a next slice, or that the upcoming period includes a single picture. ### Claim 17 (depends on 13) The method of claim 13, further comprising retrieving a granularity level CM syntax structure associated with the bitstream, the granularity level CM syntax structure specifying granularity level complexity metrics for one or more granularity segments of the bitstream over the upcoming period. ### Claim 18 (depends on 13) The method of claim 13, further comprising: retrieving an additional period type syntax element associated with the bitstream, the additional period type syntax element being associated with the granularity type syntax element, wherein the additional period type syntax element differs from the period type syntax element; and decoding a portion of the bitstream based on the granularity type syntax element and the additional period type syntax element. ### Claim 19 (depends on 13) The method of claim 13, further comprising retrieving at least one of: a subpicture syntax element associated with the bitstream, the subpicture syntax element indicating that a subpicture identifier (ID) is signaled when the CM applies to multiple pictures; a coding tree block (CTB) number syntax element associated with the bitstream, the CTB number syntax element indicating a total number of coding tree luma blocks over the upcoming period may be signaled in CM when the type of granularity is equal to a slice or a tile and the upcoming period is over multiple pictures; or an average CTB number syntax element associated with the bitstream, the average CTB number syntax element indicating an average number of CTBs or 4×4 blocks per granularity per picture. ### Claim 20 (depends on 13) The method of claim 13, wherein intra-coded block statistics are signaled in association with at least a portion of the bitstream when there are intra-coded blocks available in at least the portion the bitstream. ### Claim 21 (depends on 13) The method of claim 13, wherein inter-coded block statistics are signaled in association with at least a portion of the bitstream when there are inter-coded blocks available in at least the portion the bitstream. ### Claim 22 (depends on 13) The method of claim 13, further comprising displaying at least the portion of the bitstream on a display. ### Claim 23 (depends on 13) The method of claim 13, further comprising determining an operating frequency of a device based on the CM associated with the bitstream. ### Claim 24 An apparatus for processing video data, comprising: at least one memory; and at least one processor coupled to the at least one memory, the at least one processor being configured to: obtain video data; generate, for a bitstream, a granularity type syntax element specifying a type of granularity of one or more pictures over which complexity metrics (CM) associated with the bitstream are applicable; generate, for the bitstream, a period type syntax element associated with the bitstream, the period type syntax element indicating an upcoming period of time or a set of pictures over which the CM are applicable; generate the bitstream associated with the video data, the bitstream including the granularity type syntax element and the period type syntax element; and output the generated bitstream. ### Claim 25 (depends on 24) The apparatus of claim 24, wherein a value of the granularity type syntax element specifies that the CM are applicable to a picture or a portion of the picture of the bitstream, the portion of the picture being less than an entirety of the picture. ### Claim 26 (depends on 24) The apparatus of claim 24, wherein a value of the granularity type syntax element specifies that the CM are applicable to at least one of a slice, a tile, a subpicture, a scalable layer, or a coding tree unit (CTU) row of the one or more pictures of the bitstream. ### Claim 27 (depends on 24) The apparatus of claim 24, wherein the period type syntax element indicates at least one of a specified time interval for the upcoming period, a number of pictures for the upcoming period, that the upcoming period includes all pictures up to a picture including a next slice, or that the upcoming period includes a single picture. ### Claim 28 (depends on 24) The apparatus of claim 24, wherein the at least one processor is configured to generate, for the bitstream, a granularity level CM syntax structure specifying specifies granularity level complexity metrics for one or more entities over the upcoming period. ### Claim 29 (depends on 24) The apparatus of claim 24, wherein the period type syntax element indicates at least one of a specified time interval for the upcoming period, a number of pictures for the upcoming period, that the upcoming period includes all pictures up to a picture containing a next slice, or that the upcoming period includes a single picture. ### Claim 30 (depends on 24) The apparatus of claim 24, wherein the at least one processor is configured to generate, for the bitstream, an additional period type syntax element associated, the additional period type syntax element being associated with the granularity type syntax element, wherein the additional period type syntax element differs from the period type syntax element, and wherein the additional period type syntax element is for decoding a portion of the bitstream with the granularity type syntax element. ### Claim 31 (depends on 24) The apparatus of claim 24, wherein the at least one processor is configured to generate, for the bitstream at least one of: a subpicture syntax element associated with the bitstream, the subpicture syntax element indicating that a subpicture identifier (ID) is signaled when the CM applies to multiple pictures; a coding tree block (CTB) number syntax element associated with the bitstream, the CTB number syntax element indicating a total number of coding tree luma blocks over the upcoming period may be signaled in CM when the type of granularity is equal to a slice or a tile and the upcoming period is over multiple pictures; or an average CTB number syntax element associated with the bitstream, the average CTB number syntax element indicating an average number of CTBs or 4×4 blocks per granularity per picture. ### Claim 32 (depends on 24) The apparatus of claim 24, wherein intra-coded block statistics are signaled in association with at least a portion of the bitstream when there are intra-coded blocks available in at least the portion the bitstream. ### Claim 33 (depends on 24) The apparatus of claim 24, wherein inter-coded block statistics are signaled in association with at least a portion of the bitstream when there are inter-coded blocks available in at least the portion the bitstream. ### Claim 34 (depends on 24) The apparatus of claim 24, further comprising a camera configured to capture the video data. ### Claim 35 (depends on 24) The apparatus of claim 24, wherein the apparatus is one of a mobile device, a wearable device, an extended reality device, a camera, a personal computer, a vehicle, a robotic device, a television, or a computing device.