# US 12,114,148 B2 · Audio scene change signaling > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,114,148 B2 - Document ID: US12114148B2 - Status: Granted - Kind: B2 - Application number: 17/782,398 - Filed: 2020-11-16 - Published: 2023-01-05 - Granted: 2024-10-08 - Earliest claimed: 2019-12-04 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Sujeet Shyamsundar Mate; Kari Järvinen; Jussi Leppänen; Lasse Laaksonen - Web page: https://patentgrep.com/patent/US12114148B2 ## CPC - H04S 7/303: {Tracking of listener position or orientation} - H04S 7/304: {For headphones} - G06F 3/162: {Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs} - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - H04S 1/007: {in which the audio signals are in digital form (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S 2420/11: Application of ambisonics in stereophonic audio systems - H04S: STEREOPHONIC SYSTEMS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract There is disclosed inter alia a method for rendering a virtual reality audio scene comprising: receiving information defining a limited area audio scene within the virtual reality audio scene (301), wherein the limited area audio scene defines a sub space of the virtual reality audio scene (304), wherein the information defines the limited area audio scene by defining an extent a user can move within the virtual audio scene; determining if the movement of the user within the limited area audio scene meets a condition of an audio scene change (302); and processing the audio scene change when the movement of the user within the limited area audio scene meets the condition of an audio scene change (306). ## Claims ### Claim 1 A method comprising: receiving information defining a limited area audio scene within a virtual reality audio scene, wherein the limited area audio scene defines a sub space of the virtual reality audio scene, and wherein the information defines the limited area audio scene by defining a movement capability of a user within the virtual audio scene; processing only one or more audio scene changes that are within the limited area audio scene without processing one or more other audio scene changes that are within the virtual reality audio scene but outside of the limited area audio scene, wherein processing the one or more audio scene changes for the limited area audio scene comprises determining whether a movement of the user within the limited area audio scene meets a condition of the one or more audio scene changes in order to trigger the one or more audio scene changes; and processing a change to an audio scene based upon rendering parameters of one or more audio elements within the virtual reality audio scene that are associated with the one or more audio scene changes that are determined to be triggered. ### Claim 2 (depends on 1) The method as claimed in claim 1, wherein the movement capability is defined as a number of predetermined directional steps, wherein each of the predetermined directional steps has at least one associated audio scene change condition, and wherein the at least one audio scene change condition is associated with a respective at least one audio scene change, and wherein determining whether the movement of the user within the limited area audio scene meets the condition of the one or more audio scene changes comprises determining that the movement of the user meets the at least one audio scene change condition of one of the number of predetermined directional steps, and wherein processing the change to the audio scene comprises processing a respective at least one audio scene change associated with the at least one audio scene change condition. ### Claim 3 (depends on 2) The method as claimed in claim 2, wherein each defined directional step or movement is accompanied by an indication as to a processing power required to process the respective at least one audio scene change. ### Claim 4 (depends on 1) The method as claimed in claim 1, wherein the movement capability is defined as an area of the virtual reality audio scene within a physical space, wherein the area has at least one associated audio scene change condition and wherein the at least one audio scene change condition is associated with a respective at least one audio scene change, wherein determining whether the movement of the user within the limited area audio scene meets the condition of the one or more audio scene changes comprises determining that the movement of the user meets the at least one audio scene change condition of the area, and wherein processing the change of the audio comprises processing a respective at least one audio scene change associated with the at least one audio scene change condition. ### Claim 5 (depends on 1) The method as claimed in claim 1, wherein the information defining the limited area audio scene is a data structure of a timed metadata track. ### Claim 6 (depends on 5) The method as claimed in claim 5, wherein the data structure comprises, for the at least one audio scene change, at least one of the following data fields: an identifier indicating an audio scene associated with the condition of the at least one audio scene change; an identifier identifying a group of audio elements comprising an audio element associated with the condition of the at least one audio scene change condition; or an identifier identifying an audio element associated with the condition of the least one audio scene change. ### Claim 7 (depends on 5) The method as claimed in claim 5, wherein the information defining a limited area audio scene comprises part of a sample entry within a timed metadata track according to the ISO Base Media File Format (ISOBMFF). ### Claim 8 (depends on 1) The method as claimed in claim 1, wherein the one or more audio scene changes are each defined by at least one audio element and the rendering parameters of the at least one audio element. ### Claim 9 (depends on 8) The method as claimed in claim 8, wherein the at least one audio element comprises at least one of: an audio object; an audio channel; or higher order ambisonics. ### Claim 10 (depends on 1) The method as claimed in claim 1 wherein the rendering parameters associated with the audio scene changes within the limited area audio scene are precalculated and stored. ### Claim 11 An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to: receive information defining a limited area audio scene within the virtual reality audio scene, wherein the limited area audio scene defines a sub space of the virtual reality audio scene, wherein the information defines the limited area audio scene by defining a movement capability of a user within the virtual audio scene; process only one or more audio scene changes that are within the limited area audio scene without processing one or more other audio scene changes that are within the virtual reality audio scene but outside of the limited area audio scene, wherein the one or more audio scene changes for the limited area audio scene are processed by determining whether a movement of the user within the limited area audio scene meets a condition of the one or more audio scene changes in order to trigger the one or more audio scene changes; and process a change to an audio scene based upon rendering parameters of one or more audio elements within the virtual reality audio scene that are associated with the one or more audio scene changes that are determined to be triggered. ### Claim 12 (depends on 11) The apparatus as claimed in claim 11, wherein the movement capability is defined as a number of predetermined directional steps, wherein each of the predetermined directional steps has at least one associated audio scene change condition and wherein the at least one audio scene change condition is associated with a respective at least one audio scene change, wherein the apparatus caused to determine whether the movement of the user within the limited area audio scene meets a condition of the one or more audio scene changes is caused to determine that the movement of the user meets the at least one audio scene change condition of one of the number of predetermined directional steps, and wherein the apparatus caused to process the change to the audio scene change is caused to process a respective at least one audio scene change associated with the at least one audio scene change condition. ### Claim 13 (depends on 12) The apparatus as claimed in claim 12, wherein each defined directional step or movement is accompanied by an indication as to the processing power required to process the respective at least one audio scene change. ### Claim 14 (depends on 11) The apparatus as claimed in claim 11, wherein the movement capability is defined as an area of the virtual reality audio scene within a physical space, wherein the area has at least one associated audio scene change condition and wherein the at least one audio scene change condition is associated with a respective at least one audio scene change, wherein the apparatus is further caused to determine whether the movement of the user within the limited area audio scene meets a condition of the one or more audio scene changes is caused to determine that the movement of the user meets the at least one audio scene change condition of the area, and wherein the apparatus is further caused to process the change of the audio is caused to process a respective at least one audio scene change associated with the at least one audio scene change condition. ### Claim 15 (depends on 11) The apparatus as claimed in claim 11, wherein the information defining the limited area audio scene is a data structure of a timed metadata track. ### Claim 16 (depends on 15) The apparatus as claimed in claim 15, wherein the data structure comprises for the at least one audio scene change at least one of the following data fields: an identifier indicating an audio scene associated with the condition of the at least one audio scene change; an identifier identifying a group of audio elements comprising an audio element associated with the condition of the at least one audio scene change condition; and an identifier identifying an audio element associated with the condition of the least one audio scene change. ### Claim 17 (depends on 15) The apparatus as claimed in claim 15, wherein the information defining a limited area audio scene is part of a sample entry within a timed metadata track according to the ISO Base Media File Format (ISOBMFF). ### Claim 18 (depends on 11) The apparatus as claimed in claim 11, wherein the one or more audio scene changes are each defined by at least one audio element and the rendering parameters of the at least one audio element. ### Claim 19 (depends on 18) The apparatus as claimed in claim 18, wherein the at least one audio element comprises at least one of: an audio object; an audio channel; and higher order ambisonics. ### Claim 20 (depends on 11) The apparatus as claimed in claim 11 wherein the rendering parameters associated with the audio scene changes within the limited area audio scene are precalculated and stored. ### Claim 21 A computer program product embodied on a non-transitory computer readable medium, comprising computer program code configured to, when executed on at least one processor, cause an apparatus to: receive information defining a limited area audio scene within the virtual reality audio scene, wherein the limited area audio scene defines a sub space of the virtual reality audio scene, wherein the information defines the limited area audio scene by defining a movement capability of user a within the virtual audio scene; process only one or more audio scene changes that are within the limited area audio scene without processing one or more other audio scene changes that are within the virtual reality audio scene but outside of the limited area audio scene, wherein the one or more audio scene changes for the limited area audio scene are processed by determining whether a movement of the user within the limited area audio scene meets a condition of the one or more audio scene changes in order to trigger the one or more audio scene changes; and process a change to an audio scene based upon rendering parameters of one or more audio elements within the virtual reality audio scene that are associated with the one or more audio scene changes that are determined to be triggered. ### Claim 22 (depends on 21) The computer program product as claimed in claim 21, wherein the movement capability is defined as a number of predetermined directional steps, wherein each of the predetermined directional steps has at least one associated audio scene change condition, and wherein the at least one audio scene change condition is associated with a respective at least one audio scene change, and wherein determining whether the movement of the user within the limited area audio scene meets the condition of the one or more audio scene changes comprises determining that the movement of the user meets the at least one audio scene change condition of one of the number of predetermined directional steps, and wherein processing the change to the audio scene comprises processing a respective at least one audio scene change associated with the at least one audio scene change condition. ### Claim 23 (depends on 21) The computer program product as claimed in claim 21, wherein the movement capability is defined as an area of the virtual reality audio scene within a physical space, wherein the area has at least one associated audio scene change condition and wherein the at least one audio scene change condition is associated with a respective at least one audio scene change, wherein determining whether the movement of the user within the limited area audio scene meets the condition of the one or more audio scene changes comprises determining that the movement of the user meets the at least one audio scene change condition of the area, and wherein processing the change of the audio comprises processing a respective at least one audio scene change associated with the at least one audio scene change condition. ### Claim 24 (depends on 21) The computer program product as claimed in claim 21 wherein the rendering parameters associated with the audio scene changes within the limited area audio scene are precalculated and stored.