# US 12,120,491 B1 · Auxiliary microphone and methods for improved hearing in smart glass applications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,120,491 B1 - Document ID: US12120491B1 - Status: Granted - Kind: B1 - Application number: 17/832,440 - Filed: 2022-06-03 - Granted: 2024-10-15 - Earliest claimed: 2021-08-20 - Assignees: Meta Platforms Technologies, LLC - Applicants: Meta Platforms Technologies, LLC - Inventors: Julian Joseph Maurice Fessard; Zhaonian Zhang - Web page: https://patentgrep.com/patent/US12120491B1 ## CPC - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - G10L 21/0208: Noise filtering - H04R 1/08: Mouthpieces; {Microphones;} Attachments therefor - H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)} - H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)} - H04R 2420/07: Applications of wireless loudspeakers or wireless microphones - H04R 2460/01: Hearing devices using active noise cancellation - H04R 2499/15: Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract An augmented reality headset is provided that includes a first microphone mounted on a headset and configured to receive a first audio signal from a speaker, and a second microphone remotely located from the headset and configured to receive a second audio signal from the speaker. The augmented reality headset also includes a memory storing multiple instructions, and one or more processors configured to execute the instructions. When the one or more processors execute the instructions, they cause the augmented reality headset to: synchronize the first audio signal and the second audio signal, form an enhanced audio signal with the first audio signal and the second audio signal, and provide the enhanced audio signal to a user of the augmented reality headset. ## Claims ### Claim 1 A computer-implemented method, comprising: receiving, in a first microphone, a first audio signal from a speaker, wherein the first microphone is mounted on an augmented reality headset worn by a user; receiving, in a second microphone, a second audio signal from the speaker, wherein the second microphone is remotely located from the augmented reality headset; synchronizing the first audio signal and the second audio signal; forming an enhanced audio signal with the first audio signal and the second audio signal, wherein forming the enhanced audio signal comprises: identifying a noise source in the second audio signal, and removing the noise source from the first audio signal; and providing the enhanced audio signal to the augmented reality headset. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein receiving the first audio signal from the speaker comprises selecting the speaker via a user manual input in a control in the augmented reality headset. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein receiving the first audio signal from the speaker comprises selecting the speaker via a user input in a virtual control displayed on an eyepiece of the augmented reality headset. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising selecting the speaker automatically from a user audio and multiple audio signals from multiple speakers. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein receiving the second audio signal comprises: receiving a wireless electromagnetic signal containing the second audio signal; and decoding the wireless electromagnetic signal to retrieve the second audio signal. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein synchronizing the first audio signal and the second audio signal comprises selecting at least one audio component that is common to the first audio signal and the second audio signal. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, wherein forming the enhanced audio signal comprises: identifying a unique feature from the speaker in the second audio signal; and amplifying the unique feature in the enhanced audio signal. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein forming the enhanced audio signal comprises: identifying a unique environment feature in the second audio signal; and amplifying the unique environment feature in the enhanced audio signal. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, wherein forming the enhanced audio signal comprises selecting to use the second audio signal to either one of enhancing a speaker voice or neglecting a noise background. ### Claim 10 A headset, comprising: a first microphone mounted on the headset and configured to receive a first audio signal from a speaker; a second microphone remotely located from the headset and configured to receive a second audio signal from the speaker; a memory storing multiple instructions; and one or more processors configured to execute the instructions and cause the headset to: synchronize the first audio signal and the second audio signal; form an enhanced audio signal with the first audio signal and the second audio signal, wherein to form the enhanced audio signal, the one or more processors are configured to: identify a noise source in the second audio signal, and remove the noise source from the first audio signal; and provide the enhanced audio signal to a user of the headset. ### Claim 11 (depends on 10) The headset of claim 10, further comprising an eye tracking module to identify a gaze direction of the user, wherein the one or more processors execute instructions to select the speaker based on the gaze direction. ### Claim 12 (depends on 10) The headset of claim 10, further comprising a display having a virtual control to receive a user selection of a sound source for one of the first audio signal or the second audio signal. ### Claim 13 (depends on 10) The headset of claim 10, wherein to form the enhanced audio signal, the one or more processors are configured to: identify a unique feature in the second audio signal; and amplify the unique feature in the enhanced audio signal. ### Claim 14 A computer-implemented method, comprising: receiving, in a mobile device paired to an augmented reality headset worn by a user, a first audio signal from a first microphone mounted on the augmented reality headset; receiving, in the mobile device, a second audio signal from a second microphone remotely located from the augmented reality headset; providing the first audio signal and the second audio signal to a remote server; forming an enhanced audio signal with the first audio signal and the second audio signal, wherein forming the enhanced audio signal comprises: identifying a noise source in the second audio signal, and removing the noise source from the first audio signal; receiving, from the remote server, the enhanced audio signal; and providing the enhanced audio signal to the augmented reality headset, for the user. ### Claim 15 (depends on 14) The computer-implemented method of claim 14, wherein receiving the first audio signal comprises receiving, from the augmented reality headset, a selection of a source for the first audio signal. ### Claim 16 (depends on 14) The computer-implemented method of claim 14, further comprising selecting an audio component that is common to the first audio signal and the second audio signal; and synchronizing the first audio signal with the second audio signal based on the audio component. ### Claim 17 (depends on 14) The computer-implemented method of claim 14, further comprising: identifying a unique feature from an audio source in the second audio signal; and amplifying the unique feature before providing the second audio signal to the remote server.