# US 2025/0097658 A1 · Audio Rendering with Spatial Metadata Interpolation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0097658 A1 - Document ID: US20250097658A1 - Status: Published application - Kind: A1 - Application number: 18/967,114 - Filed: 2024-12-03 - Published: 2025-03-20 - Earliest claimed: 2020-02-26 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Juha VILKAMO; Mikko-Ville LAITINEN; Archontis POLITIS - Web page: https://patentgrep.com/patent/US20250097658A1 ## CPC - H04S 7/303: {Tracking of listener position or orientation} - H04S 7/304: {For headphones} - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} - H04R 2499/15: Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] - H04S 2420/03: Application of parametric coding in stereophonic audio systems - H04S 2420/11: Application of ambisonics in stereophonic audio systems - H04S: STEREOPHONIC SYSTEMS - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract An apparatus comprising means configured to: obtain two or more audio signal sets, wherein each audio signal set is associated with a position; obtain at least one parameter value for at least two of the audio signal sets; obtain the positions associated with at least the at least two of the audio signal sets; obtain a listener position; generate at least one audio signal based on at least one audio signal from at least one of the two or more audio signal sets based on the positions associated with the at least the at least two of the audio signal sets and the listener position; generate at least one modified parameter value based on the obtained at least one parameter value for the at least two of the audio signal sets, the positions associated with the at least two of the audio signal sets and the listener position; and process the at least one audio signal based on the at least one modified parameter value to generate a spatial audio output. ## Claims ### Claim at position 1 1-25. (canceled) ### Claim 26 An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to: obtain two or more spatial audio streams, wherein the two or more spatial audio streams respectively comprise at least one audio signal and at least one spatial metadata parameter, wherein the two or more spatial audio streams are respectively associated with a position; obtain the positions associated with at least two of the two or more spatial audio streams; obtain a listener position, wherein the listener position is configured to be tracked; generate at least one audio signal based, at least partially, on at least one of the two or more spatial audio streams, the positions, and the listener position; generate at least one modified spatial metadata parameter based, at least partially, on the at least one spatial metadata parameter comprised by the at least two spatial audio streams, the positions, and the listener position; and process the at least one audio signal based, at least partially, on the at least one modified spatial metadata parameter to generate a spatial audio output. ### Claim 27 (depends on 26) The apparatus as claimed in claim 26, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus at least to: obtain an updated listener position based, at least partially, on tracking of the listener position, wherein the at least one modified spatial metadata parameter is generated based, at least partially, on the updated listener position. ### Claim 28 (depends on 26) The apparatus as claimed in claim 26, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus at least to: obtain the two or more spatial audio streams from microphone wherein arrangements, the microphone arrangements are at respective positions and respectively comprise one or more microphones. ### Claim 29 (depends on 26) The apparatus as claimed in claim 26, wherein the two or more spatial audio streams are respectively associated with an orientation, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to: obtain the orientations of the two or more spatial audio streams, wherein the generated at least one audio signal is further based on the orientations associated with the two or more spatial audio streams, and wherein the at least one modified spatial metadata parameter is further based on the orientations associated with the at least two of the two or more spatial audio streams. ### Claim 30 (depends on 26) The apparatus as claimed in claim 26, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to: obtain a listener orientation, wherein the at least one modified spatial metadata parameter is further based on the listener orientation. ### Claim 31 (depends on 30) The apparatus as claimed in claim 30, wherein processing the at least one audio signal based on the at least one modified spatial metadata parameter to generate the spatial audio output comprises the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to: process the at least one audio signal further based on the listener orientation. ### Claim 32 (depends on 26) The apparatus as claimed in claim 26, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to: obtain control parameters based on the positions associated with the at least two of the two or more spatial audio streams and the listener position, and wherein at least one of the at least one audio signal or the at least one modified spatial metadata parameter is controlled based, at least partially, on the control parameters. ### Claim 33 (depends on 32) The apparatus as claimed in claim 32, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to at least one of: identify at least three of the two or more spatial audio streams within which the listener position is located and generate weights associated with the at least three spatial audio streams based on the associated positions and the listener position; or identify two of the two or more spatial audio streams closest to the listener position and generate weights associated with the two spatial audio streams based on the associated positions and a perpendicular projection of the listener position from a line between the two spatial audio streams. ### Claim 34 (depends on 33) The apparatus as claimed in claim 33, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to one of: combine two or more audio signals from the two or more spatial audio streams based on at least one of: the weights associated with the at least three spatial audio streams, or the weights associated with the two spatial audio streams; select one or more audio signals from one of the two or more spatial audio streams based on which of the two or more spatial audio streams is closest to the listener position; or select one or more audio signals from the one of the two or more spatial audio streams based on which of the two or more spatial audio streams is closest to the listener position, and a further switching threshold. ### Claim 35 (depends on 33) The apparatus as claimed in claim 33, the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to: combine the at least one spatial metadata parameter comprised by at least two of the two or more spatial audio streams based on at least one of: the weights associated with the at least three spatial audio streams, or the weights associated with the two spatial audio streams. ### Claim 36 (depends on 26) The apparatus as claimed in claim 26, wherein processing the at least one audio signal to generate the spatial audio output comprises the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to: generate at least one of: a binaural audio output comprising two audio signals for headphones and/or earphones; or a multichannel audio output comprising at least two audio signals for a multichannel speaker set. ### Claim 37 (depends on 26) The apparatus as claimed in claim 26, wherein at least one spatial metadata parameter comprises at least one of: at least one direction; at least one direct-to-total ratio associated with at least one direction value; at least one spread coherence associated with at least one direction value; at least one distance associated with at least one direction value; at least one surround coherence; at least one diffuse-to-total ratio; or at least one remainder-to-total ratio. ### Claim 38 A method comprising: obtaining two or more spatial audio streams, wherein the two or more spatial audio streams respectively comprise at least one audio signal and at least one spatial metadata parameter, wherein the two or more spatial audio streams are respectively associated with a position; obtaining the positions associated with at least two of the two or more spatial audio streams; obtaining a listener position, wherein the listener position is configured to be tracked; generating at least one audio signal based, at least partially, on at least one of the two or more spatial audio streams, the positions, and the listener position; generating at least one modified spatial metadata parameter based, at least partially, on the at least one spatial metadata parameter comprised by the at least two spatial audio streams, the positions, and the listener position; and processing the at least one audio signal based, at least partially, on the at least one modified spatial metadata parameter to generate a spatial audio output. ### Claim 39 (depends on 38) The method as claimed in claim 38, further comprising: obtaining an updated listener position based, at least partially, on tracking of the listener position, wherein the at least one modified spatial metadata parameter is generated based, at least partially, on the updated listener position. ### Claim 40 (depends on 38) The method as claimed in claim 38, further comprising: obtaining the two or more spatial audio streams from microphone arrangements, wherein the microphone arrangements are at respective positions and respectively comprise one or more microphones. ### Claim 41 (depends on 38) The method as claimed in claim 38, wherein the two or more spatial audio streams are respectively associated with an orientation, wherein the method further comprises: obtaining the orientations of the two or more spatial audio streams, wherein the generated at least one audio signal is further based on the orientations associated with the two or more spatial audio streams, and wherein the at least one modified spatial metadata parameter is further based on the orientations associated with the at least two of the two or more spatial audio streams. ### Claim 42 (depends on 38) The method as claimed in claim 38, further comprising: obtaining a listener orientation, wherein the at least one modified spatial metadata parameter is further based on the listener orientation. ### Claim 43 (depends on 42) The method as claimed in claim 42, wherein the processing of the at least one audio signal based on the at least one modified spatial metadata parameter to generate the spatial audio output comprises: processing the at least one audio signal further based on the listener orientation. ### Claim 44 (depends on 38) The method as claimed in claim 38, wherein at least one spatial metadata parameter comprises at least one of: at least one direction; at least one direct-to-total ratio associated with at least one direction value; at least one spread coherence associated with at least one direction value; at least one distance associated with at least one direction value; at least one surround coherence; at least one diffuse-to-total ratio; or at least one remainder-to-total ratio. ### Claim 45 An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to: obtain at least one signal, wherein the at least one signal comprises one or more audio signals from respective ones of two or more capturing positions, wherein the two or more capturing positions are inside an audio scene; obtain at least one capturing position, wherein the at least one capturing position comprises one or more capturing positions of the two or more capturing positions; obtain at least one spatial metadata parameter, wherein the at least one spatial metadata parameter comprises one or more spatial metadata parameters associated with the respective ones of the two or more capturing positions; obtain a plurality of predefined listener positions; generate a plurality of modified spatial metadata parameters based, at least partially, on the at least one spatial metadata parameter, the at least one capturing position, and the plurality of predefined listener positions; and generate two or more spatial audio streams based, at least partially, on the at least one signal, the at least one capturing position, and the plurality of modified spatial metadata parameters.