# US 12,010,484 B2 · Method, apparatus and computer-readable media to create audio focus regions dissociated from the microphone system for the purpose of optimizing audio processing at precise spatial locations in a 3D space > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,484 B2 - Document ID: US12010484B2 - Status: Granted - Kind: B2 - Application number: 17/516,480 - Filed: 2021-11-01 - Published: 2022-04-14 - Granted: 2024-06-11 - Earliest claimed: 2019-01-29 - Assignees: Nureva, Inc. - Applicants: Nureva, Inc. - Inventors: Erica Patricia Yorga; Richard Dale Ferguson; Kael Blais; Mahdi Javer; Nicholas Norrie - Web page: https://patentgrep.com/patent/US12010484B2 ## CPC - H04R 1/406: {microphones} - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - H04R 29/005: {Microphone arrays} - H04S 7/30: {Control circuits for electronic adaptation of the sound field} - H04R 2201/401: 2D or 3D arrays of transducers - H04R 2201/403: Linear arrays of transducers - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - H04S: STEREOPHONIC SYSTEMS ## Abstract Method, apparatus, and computer-readable media focusing sound signals from plural microphones in a 3D space, to determine audio signal processing profiles to optimize sound source(s) in the space. At least one processor determines plural virtual microphone bubbles in the space, and defines one or more bubble object profiles which comprise(s) specific attributes and functions of audio processing functions for each bubble, each bubble object profile including: (a) an individual bubble object profile when the bubble has been configured for an individual bubble; (b) a region object profile when the bubble has been configured for a region of one or more bubbles; and (c) a group object profile when the bubble has been configured for a group having one or more bubbles. The audio signal processing functions are used for the at least one bubble, for any combination of (a), (b), and (c). ## Claims ### Claim 1 An apparatus configured to apply location based virtual microphone post-processing of combined sound signals from a plurality of physical microphones based on the targeted virtual microphone's location in a shared 3D space to optimize one or more sound sources audio processing based on their location in the shared 3D space regardless of locations of the physical microphones, the apparatus comprising: at least one microphone input from an enabled virtual microphone that receives plural microphone input signals from the plurality of physical microphones in the shared 3D space; and at least one processor coupled to said at least one microphone input and receiving the plural microphone input signals, the at least one processor being configured to determine a plurality of virtual microphones in the shared 3D space, wherein: the at least one processor is configured to set up location based virtual microphone specific processing attributes and/or functions, based on requirements of virtual microphone locations in the shared 3D space, and one or more regions comprising one or more virtual microphones and/or one or more groups comprising one or more virtual microphones and/or one or more regions; the one or more virtual microphones, the one or more regions and the one or more groups each contains one or more profiles, and the one or more profiles each contains one or more attributes and/or one or more functions, the attributes and/or functions defining audio post-processing functions for each virtual microphone; the virtual microphones included in the same region share the one or more profiles set forth in the region, and the virtual microphones included in the same group share the one or more profiles set forth in the group; the at least one processor is configured to assign specific attributes and/or functions to the one or more regions based on the requirements of virtual microphone locations for the regions in the shared 3D space; and the at least one processor is configured to process the processing functions for virtual microphones based on the assigned specific attributes and/or functions of the regions. ### Claim 2 (depends on 1) The apparatus of claim 1 wherein the at least one processor is configured to assign the attributes and/or functions to the one or more regions independently of the locations of the physical microphones. ### Claim 3 (depends on 1) The apparatus of claim 1 wherein the at least one processor is configured to set up the one or more regions in various sizes and shapes based on the requirements of locations in the shared 3D space regardless of the locations of the physical microphones. ### Claim 4 (depends on 1) The apparatus of claim 1 wherein the at least one processor is configured to set up the one or more regions and/or the one or more groups regardless of the locations of the physical microphones such that configurations of the one or more regions and the one or more groups stay constant disassociated from the locations of the physical microphones. ### Claim 5 (depends on 1) The apparatus of claim 1 wherein the at least one processor is configured to output real-time location coordinates, in the shared 3D space, of the one or more sound sources that include desire and/or undesired sound sources. ### Claim 6 (depends on 1) The apparatus of claim 1 wherein the attributes include one or more selected from a group consisting of on/off, 2D positions, 3D positions, various threshold values, sizes, descriptions, arrays, Boolean, numeric and text values. ### Claim 7 (depends on 1) The apparatus of claim 1 wherein the functions include one or more selected from a group consisting of Boolean logic, filtering, digital signal processing, analog processing, gain, thresholding, and any location-based logic and behaviors, and wherein the functions are configured to access other devices in the shared 3D space which include IOT (Internet of Things), displays, speakers, room control, lightening, external amplification and any other device that has an exposed physical and/or software control interface. ### Claim 8 A method to apply location based virtual microphone post-processing of combined sound signals from a plurality of physical microphones based on the targeted virtual microphone's location in a shared 3D space to optimize one or more sound sources audio processing based on their location in the shared 3D space regardless of locations of the physical microphones, the method comprising: providing at least one microphone input from an enabled virtual microphone that receives plural microphone input signals from the plurality of physical microphones in the shared 3D space; determining, via at least one processor, a plurality of virtual microphones in the shared 3D space; setting up, via the at least one processor, location based virtual microphone specific processing attributes and/or functions, based on requirements of virtual microphone locations in the shared 3D space, and one or more regions comprising one or more virtual microphones and/or one or more groups comprising one or more virtual microphones and/or one or more regions, wherein: the one or more regions and one or more groups are set up based on requirements of locations in the shared 3D space, the one or more virtual microphones, the one or more regions and the one or more groups each contains one or more profiles, the one or more profiles each contains one or more attributes and/or one or more functions, the attributes and/or functions define audio post-processing functions for each virtual microphone, and the virtual microphones included in the same region share the one or more profiles set forth in the region, and the virtual microphones included in the same group share the one or more profiles set forth in the group; assigning, via the at least one processor, specific attributes and/or functions to the one or more regions based on the requirements of virtual microphone locations for the regions in the shared 3D space; and processing, via the at least one processor, the processing functions for virtual microphones based on the assigned specific attributes and/or functions of the regions. ### Claim 9 (depends on 8) The method of claim 8 wherein the attributes and/or functions are assigned to the one or more regions independently of the locations of the physical microphones. ### Claim 10 (depends on 8) The method of claim 8 wherein the at least one processor is configured to set up the one or more regions in various sizes and shapes based on the requirements of locations in the shared 3D space regardless of the locations of the physical microphones. ### Claim 11 (depends on 8) The method of claim 8 wherein the at least one processor is configured to set up the one or more regions and/or the one or more groups regardless of the locations of the physical microphones such that configurations of the one or more regions and the one or more groups stay constant disassociated from the locations of the physical microphones. ### Claim 12 (depends on 8) The method of claim 8 wherein the at least one processor is configured to output real-time location coordinates, in the shared 3D space, of the one or more sound sources that include desire and/or undesired sound sources. ### Claim 13 (depends on 8) The method of claim 8 wherein the attributes include one or more selected from a group consisting of on/off, 2D positions, 3D positions, various threshold values, sizes, descriptions, arrays, Boolean, numeric and text values. ### Claim 14 (depends on 8) The method of claim 8 wherein the functions include one or more selected from a group consisting of Boolean logic, filtering, digital signal processing, analog processing, gain, thresholding, and any location-based logic and behaviors, and wherein the functions are configured to access other devices in the shared 3D space which include IOT (Internet of Things), displays, speakers, room control, lightening, external amplification and any other device that has an exposed physical and/or software control interface. ### Claim 15 At least one program embodied in a non-transitory computer readable medium for applying location based virtual microphone post-processing of combined sound signals from a plurality of physical microphones based on the targeted virtual microphone's location in a shared 3D space to optimize one or more sound sources audio processing based on their location in the shared 3D space regardless of locations of the physical microphones, the program comprising instructions causing at least one processor to perform operations comprising: providing at least one microphone input from an enabled virtual microphone that receives plural microphone input signals from the plurality of physical microphones in the shared 3D space; determining, via the at least one processor, a plurality of virtual microphones in the shared 3D space; setting up, via the at least one processor, location based virtual microphone specific processing attributes and/or functions, based on requirements of virtual microphone locations in the shared 3D space, and one or more regions comprising one or more virtual microphones and/or one or more groups comprising one or more virtual microphones and/or one or more regions, wherein: the one or more regions and one or more groups are set up based on requirements of locations in the shared 3D space, the one or more virtual microphones, the one or more regions and the one or more groups each contains one or more profiles, the one or more profiles each contains one or more attributes and/or one or more functions, the attributes and/or functions define audio post-processing functions for each virtual microphone, and the virtual microphones included in the same region share the one or more profiles set forth in the region, and the virtual microphones included in the same group share the one or more profiles set forth in the group; assigning, via the at least one processor, specific attributes and/or functions to the one or more regions based on the requirements of virtual microphone locations for the regions in the shared 3D space; and processing, via the at least one processor, the processing functions for virtual microphones based on the assigned specific attributes and/or functions of the regions. ### Claim 16 (depends on 15) The at least one program of claim 15 wherein the attributes and/or functions are assigned to the one or more regions independently of the locations of the physical microphones. ### Claim 17 (depends on 15) The at least one program of claim 15 wherein the at least one processor is configured to set up the one or more regions in various sizes and shapes based on the requirements of locations in the shared 3D space regardless of the locations of the physical microphones. ### Claim 18 (depends on 15) The at least one program of claim 15 wherein the at least one processor is configured to set up the one or more regions and/or the one or more groups regardless of the locations of the physical microphones such that configurations of the one or more regions and the one or more groups stay constant disassociated from the locations of the physical microphones. ### Claim 19 (depends on 15) The at least one program of claim 15 wherein the at least one processor is configured to output real-time location coordinates, in the shared 3D space, of the one or more sound sources that include desire and/or undesired sound sources. ### Claim 20 (depends on 15) The at least one program of claim 15 wherein the attributes include one or more selected from a group consisting of on/off, 2D positions, 3D positions, various threshold values, sizes, descriptions, arrays, Boolean, numeric and text values. ### Claim 21 (depends on 15) The at least one program of claim 15 wherein the functions include one or more selected from a group consisting of Boolean logic, filtering, digital signal processing, analog processing, gain, thresholding, and any location-based logic and behaviors, and wherein the functions are configured to access other devices in the shared 3D space which include IOT (Internet of Things), displays, speakers, room control, lightening, external amplification and any other device that has an exposed physical and/or software control interface.