# US 12,015,777 B2 · Signaling profile level exemptions for immersive video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,015,777 B2 - Document ID: US12015777B2 - Status: Granted - Kind: B2 - Application number: 17/544,024 - Filed: 2021-12-07 - Published: 2022-06-16 - Granted: 2024-06-18 - Earliest claimed: 2020-12-14 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Sebastian Schwarz - Web page: https://patentgrep.com/patent/US12015777B2 ## CPC - H04N 19/127: Prioritisation of hardware or computational resources - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) - G06T 9/001: {Model-based coding, e.g. wire frame} - H04N 19/115: Selection of the code volume for a coding unit prior to coding - H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria - H04N 19/172: the region being a picture, frame or field - H04N 19/177: the unit being a group of pictures [GOP] - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An encoder may determine that volumetric video data comprises at least one time period during which a computational requirement for rendering or decoding changes at least a threshold amount; and include, in a bitstream, an indication of the change in the computational requirement for rendering or decoding of the volumetric video data during the at least one time period. A decoder may receive an indication of a change in at least one computational requirement for rendering or decoding of volumetric video data; and reallocate at least one computational resource based on the received indication. ## Claims ### Claim 1 An apparatus comprising: at least one processor; and at least one non-transitory memory and computer program code, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: determine that volumetric video data comprises at least one time period during which a computational requirement for rendering or decoding changes at least a threshold amount; and include, in a bitstream, an indication of the change in the computational requirement for rendering or decoding of the volumetric video data during the at least one time period, wherein the indication of the change in the computational requirement for rendering or decoding comprises an indication of a lead time for the change in the computational requirement for rendering or decoding. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the computational requirement for rendering or decoding is signaled in or along the bitstream as at least one of: a profile indicator, or a level indicator. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein determining that the volumetric video data comprises the at least one time period during which the computational requirement for rendering or decoding changes at least the threshold amount comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: determine that the volumetric video data comprises at least one of: a first object entering a scene; a second object leaving the scene; a visual effect; a three-dimensional deformation; a texture change; or a combination of two or more of: the first object, the second object, the visual effect, the three dimensional deformation, or the texture change. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein determining that the volumetric video data comprises the at least one time period during which the computational requirement for rendering or decoding changes at least the threshold amount comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: receive a manual input indicating that the computational requirement for rendering or decoding changes during the at least one time period. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein determining that the volumetric video data comprises the at least one time period during which the computational requirement for rendering or decoding changes at least the threshold amount comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: perform content analysis of the volumetric video data during encoding or as a pre-encoding step. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the indication of the change in the computational requirement for rendering or decoding comprises a flag, wherein the flag is configured to indicate that at least one syntax element related to the change in the computational requirement for rendering or decoding is included in the bitstream. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the indication of the change in the computational requirement for rendering or decoding comprises an indication of at least one of: a level change, a tier change, or a profile change for an associated decoder. ### Claim 8 (depends on 1) The method of claim 1, wherein the indication of the change in the computational requirement for rendering or decoding comprises an indication of a duration for the change in the computational requirement for rendering or decoding. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the computational requirement is associated with at least one of: an increase in a level of complexity of the volumetric video data during the at least one time period, a decrease in the level of complexity of the volumetric video data during the at least one time period, an increase in a level of detail of the volumetric video data during the at least one time period, or a decrease in the level of detail of the volumetric video data during the at least one time period. ### Claim 10 A method comprising: determining that volumetric video data comprises at least one time period during which a computational requirement for rendering or decoding changes at least a threshold amount; and including, in a bitstream, an indication of the change in the computational requirement for rendering or decoding of the volumetric video data during the at least one time period, wherein the indication of the change in the computational requirement for rendering or decoding comprises an indication of a lead time for the change in the computational requirement for rendering or decoding. ### Claim 11 A non-transitory computer-readable medium comprising program instructions stored thereon which, when executed with at least one processor, cause the at least one processor to: determine that volumetric video data comprises at least one time period during which a computational requirement for rendering or decoding changes at least a threshold amount; and include, in a bitstream, an indication of the change in the computational requirement for rendering or decoding of the volumetric video data during the at least one time period, wherein the indication of the change in the computational requirement for rendering or decoding comprises an indication of a lead time for the change in the computational requirement for rendering or decoding. ### Claim 12 An apparatus comprising: at least one processor; and at least one non-transitory memory and computer program code, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: receive an indication of a change in at least one computational requirement for rendering or decoding of volumetric video data, wherein the indication of the change in the at least one computational requirement for rendering or decoding comprises an indication of a lead time for the change in one or more of the at least one computational requirement; and reallocate at least one computational resource based on the received indication. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein receiving the indication comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: detect a flag in a stream associated with the volumetric video data, wherein the flag is configured to indicate that at least one syntax element related to the change in the at least one computational requirement for rendering or decoding is included in the stream. ### Claim 14 (depends on 12) The apparatus of claim 12, wherein the indication of the change in the at least one computational requirement for rendering or decoding comprises an indication of at least one of: a level change, a tier change, or a profile change for an associated decoder. ### Claim 15 (depends on 12) The apparatus of claim 12, wherein the indication of the change in the at least one computational requirement for rendering or decoding comprises an indication of a duration for the change in one or more of the at least one computational requirement for rendering or decoding. ### Claim 16 (depends on 12) The apparatus of claim 12, wherein the at least one computational resource comprises at least one of: at least one memory buffer, at least one processor, or at least one power source. ### Claim 17 (depends on 12) The apparatus of claim 12, wherein reallocating the at least one computational resource based on the received indication comprises the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to one of: increase the at least one computational resource for rendering or decoding of the volumetric video data, or decrease the at least one computational resource for rendering or decoding of the volumetric video data. ### Claim 18 (depends on 12) The apparatus of claim 12, wherein the at least one computational requirement is associated with at least one of: an increase in a level of complexity of the volumetric video data during at least one time period, a decrease in the level of complexity of the volumetric video data during the at least one time period, an increase in a level of detail of the volumetric video data during the at least one time period, or a decrease in the level of detail of the volumetric video data during the at least one time period. ### Claim 19 A method comprising: receiving an indication of a change in at least one computational requirement for rendering or decoding of volumetric video data, wherein the indication of the change in the at least one computational requirement for rendering or decoding comprises an indication of a lead time for the change in one or more of the at least one computational requirement; and reallocating at least one computational resource based on the received indication. ### Claim 20 A non-transitory computer-readable medium comprising program instructions stored thereon which, when executed with at least one processor, cause the at least one processor to: receive an indication of a change in at least one computational requirement for rendering or decoding of volumetric video data, wherein the indication of the change in the at least one computational requirement for rendering or decoding comprises an indication of a lead time for the change in one or more of the at least one computational requirement; and reallocate at least one computational resource based on the received indication.