# US 2020/0288262 A1 · Spatial Audio Signal Processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0288262 A1 - Document ID: US20200288262A1 - Status: Published application - Kind: A1 - Application number: 16/649,433 - Filed: 2018-10-01 - Published: 2020-09-10 - Earliest claimed: 2017-10-09 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Antti ERONEN; Arto LEHTINIEMI; Jussi LEPPANEN; Tapani PIHLAJAKUJA - Web page: https://patentgrep.com/patent/US20200288262A1 ## CPC - G10L 25/48: specially adapted for particular use - H04S 7/303: {Tracking of listener position or orientation} - G01S 3/80: using ultrasonic, sonic or infrasonic waves - H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)} - G10L 25/03: characterised by the type of extracted parameters - H04R 2201/40: Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04S: STEREOPHONIC SYSTEMS - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract An apparatus for spatial audio signal processing, the apparatus including at least one processor configured to: receive captured audio content, the captured audio content captured within a capture environment with defined geometry; determine audio directions and distances associated with the captured audio content; determine a listening space area geometry; map the audio directions and distances associated with the captured audio content relative to the defined geometry to the listening space area geometry; and synthesize a volumetric audio based on the mapped audio directions and distances to generate an audio content experience within the listening space area geometry. ## Claims ### Claim at position 1 1-25. (canceled) ### Claim 26 An apparatus for spatial audio signal processing, the apparatus comprising at least one processor configured to: receive captured audio content, wherein the captured audio content is captured within a capture environment with defined geometry; determine audio directions and distances associated with the captured audio content; determine a listening space area geometry; map the audio directions and distances associated with the captured audio content relative to the defined geometry to the listening space area geometry; and synthesize a volumetric audio based on the mapped audio directions and distances to generate an audio content experience within the listening space area geometry. ### Claim 27 (depends on 26) The apparatus as claimed in claim 26, wherein the at least one processor configured to receive the captured audio content to receive at least one of: professional audio content, the professional audio content captured within the capture environment with defined geometry; and personal audio content, the personal audio content captured within the capture environment with defined geometry. ### Claim 28 (depends on 26) The apparatus as claimed in claim 26, wherein the at least one processor configured to determine audio directions and distances associated with the captured audio content to one of: receive the audio directions and distances associated with the captured audio content; and analyse the captured audio content to generate the audio directions and distances associated with the captured audio content. ### Claim 29 (depends on 26) The apparatus as claimed in claim 26, wherein the at least one processor configured to receive the captured audio content to receive: professional audio content, the professional audio content captured within the capture environment with defined geometry; and personal audio content, the personal audio content captured within the capture environment with defined geometry, wherein the at least one processor configured to determine audio directions and distances associated with the captured audio content is further configured to: generate a local personal audio content by removing a common part between the captured professional audio content and the captured personal audio content from the captured personal audio content; and analyse the local personal audio content to determine the audio directions and distances associated with the local personal audio content. ### Claim 30 (depends on 29) The apparatus as claimed in claim 29, wherein the at least one processor configured to determine audio directions and distances associated with the captured audio content to: generate a far professional audio content by removing a common part between the captured professional audio content and the captured personal audio content from the captured professional audio content; and analyse the far professional audio content to determine audio directions and distances associated with the far professional audio content. ### Claim 31 (depends on 28) The apparatus as claimed in claim 28, wherein the processor configured to synthesize a volumetric audio based on the mapped audio directions and distances to generate an audio content experience within the listening space area geometry to: synthesize a personal volumetric audio using the local personal audio content based on the mapped audio directions and distances to generate a local personal audio content experience within the listening space area geometry; synthesize a professional volumetric audio using the far professional audio content based on the mapped audio directions and distances to generate a far professional audio content experience within the listening space area geometry associated with the professional audio content; and mix the professional volumetric audio and the personal volumetric audio to generate the volumetric audio to generate the audio content experience. ### Claim 32 (depends on 31) The apparatus as claimed in claim 31, wherein the processor configured to synthesize the professional volumetric audio to synthesize the professional volumetric audio based on a determined listening position. ### Claim 33 (depends on 26) The apparatus as claimed in claim 26, the at least one processor further configured to at least one of: determine a listening position; and synthesize the personal volumetric audio is configured to synthesize the personal volumetric audio based on the listening position. ### Claim 34 (depends on 28) The apparatus as claimed in claim 28, wherein the processor configured to receive captured personal audio content to receive at least two separate captured personal audio contents, and wherein the processor is configured to selectively switch between the at least two separate captured personal audio contents based on a user interface input. ### Claim 35 (depends on 26) The apparatus as claimed in claim 26, wherein the processor configured to determine a listening space area geometry associated with the audio content to: determine a listening space area geometry; and determine within the listening space area geometry a listening space area geometry associated with the audio content. ### Claim 36 (depends on 35) The apparatus as claimed in claim 35, wherein the processor configured to determine a listening space area geometry to: receive information from at least one sensor located within the listening space; and determine a listening space area geometry from the information from at least one sensor located within the listening space. ### Claim 37 (depends on 36) The apparatus as claimed in claim 36, further comprising the at least one sensor, wherein the at least one sensor comprises at least one of: a camera pair; a phase or time difference based laser range detector; and a light field camera. ### Claim 38 (depends on 27) The apparatus as claimed in claim 27, wherein the captured professional audio content comprises at least one of: an audio signal captured by a close microphone within the capture environment; an audio signal captured by a PA microphone within the capture environment; an audio signal captured from a mixing desk within the capture environment; and an audio signal captured by a spatial microphone array within the capture environment. ### Claim 39 A method for spatial audio signal processing comprising: receiving captured audio content, the captured audio content captured within a capture environment with defined geometry; determining audio directions and distances associated with the captured audio content; determining a listening space area geometry; mapping the audio directions and distances associated with the captured audio content relative to the defined geometry to the listening space area geometry; and synthesizing a volumetric audio based on the mapped audio directions and distances to generate an audio content experience within the listening space area geometry. ### Claim 40 (depends on 39) The method as claimed in claim 39, wherein receiving the captured audio content is further comprises at least one of: receiving professional audio content, the professional audio content captured within the capture environment with defined geometry; and receiving personal audio content, the personal audio content captured within the capture environment with defined geometry. ### Claim 41 (depends on 39) The method as claimed in claim 39, wherein determining audio directions and distances associated with the captured audio content comprises one of: receiving audio directions and distances associated with the captured audio content; and analysing the captured audio content to generate the audio directions and distances associated with the captured audio content. ### Claim 42 (depends on 39) The method as claimed in claim 39, wherein receiving the captured audio content comprises: receiving professional audio content, the professional audio content captured within the capture environment with defined geometry; and receiving personal audio content, the personal audio content captured within the capture environment with defined geometry, wherein determining audio directions and distances associated with the captured audio content comprises: generating a local personal audio content by removing a common part between the captured professional audio content and the captured personal audio content from the captured personal audio content; and analysing the local personal audio content to determine the audio directions and distances associated with the local personal audio content. ### Claim 43 (depends on 42) The method as claimed in claim 42, wherein determining audio directions and distances associated with the captured audio content comprises: generating a far professional audio content by removing a common part between the captured professional audio content and the captured personal audio content from the captured professional audio content; and analysing the far professional audio content to determine audio directions and distances associated with the far professional audio content. ### Claim 44 (depends on 42) The method as claimed in claim 42, wherein synthesizing a volumetric audio based on the mapped audio directions and distances to generate an audio content experience within the listening space area geometry comprises: synthesizing a personal volumetric audio using the local personal audio content based on the mapped audio directions and distances to generate a local personal audio content experience within the listening space area geometry; synthesizing a professional volumetric audio using the far professional audio content based on the mapped audio directions and distances to generate a far professional audio content experience within the listening space area geometry associated with the professional audio content; and mixing the professional volumetric audio and the personal volumetric audio to generate the volumetric audio to generate the audio content experience. ### Claim 45 (depends on 39) The method as claimed in claim 39, further comprising at least one of: determining a listening position; and synthesizing the personal volumetric audio based on the listening position.