# US 10,873,807 B2 · Processing echoes received at a directional microphone unit > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,873,807 B2 - Document ID: US10873807B2 - Status: Granted - Kind: B2 - Application number: 16/635,910 - Filed: 2018-07-09 - Published: 2020-07-16 - Granted: 2020-12-22 - Earliest claimed: 2017-08-01 - Assignees: Xmos Ltd - Applicants: Xmos Ltd - Inventors: Sam Chesney; Andrew Graham Stanford-Jason; Hendrik Lambertus Muller - Web page: https://patentgrep.com/patent/US10873807B2 ## CPC - G10L 21/0208: Noise filtering - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - G01S 3/802: Systems for determining direction or deviation from predetermined direction - G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning} - G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence) - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 21/0232: Processing in the frequency domain - G10L 25/51: for comparison or discrimination - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - H04R 1/406: {microphones} - G10L 2021/02082: {the noise being echo, reverberation of the speech} - G10L 2021/02166: {Microphone arrays; Beamforming} - H04N 7/15: Conference systems - H04R 1/342: {for microphones} - H04R 2201/401: 2D or 3D arrays of transducers - H04R 2430/21: Direction finding using differential microphone array [DMA] - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method of using a directional microphone unit having an array of constituent microphones. Each of a plurality of the microphones receives substantially white noise via a direct path from a source, and also receives an echo comprising a reflection of the white noise from at least one surface, thereby obtaining a received noise signal comprising a combination of the directly-received noise and the echo. For each of the plurality of microphones, a spacing is identified between lobes and/or troughs in a respective spectrum of the received noise signal as received by the respective microphone, thereby determining an additional distance travelled by the echo to the respective microphone relative to the direct path. A direction of the source is calculated based on the additional distance travelled for each of said plurality of microphones. ## Claims ### Claim 1 A method of using a directional microphone unit, the directional microphone unit comprising an array of constituent microphones spaced apart from one another, and the method comprising: at each respective one of a plurality of the microphones, receiving substantially white noise via a direct path from a source of the white noise and also receiving an echo comprising a reflection of the white noise from at least one reflective surface, and thereby obtaining a received noise signal comprising a combination of the directly-received noise and the echo as received by the respective microphone; for each of the plurality of microphones, identifying a spacing between lobes and/or troughs in a respective spectrum of the received noise signal as received by the respective microphone, thereby determining an additional distance travelled by the echo to the respective microphone relative to the direct path; calculating a direction of the source based on the additional distance travelled for each of said plurality of microphones; and based on the calculated direction of the source, directing one or more directional sensors and/or indicators to target or avoid the source of the noise. ### Claim 2 (depends on 1) The method of claim 1, wherein the one or more directional sensors comprise at least said directional microphone unit, said directing comprising applying a respective weight to each of the microphones in the array, thereby forming a receive beam that targets or avoids the source of the noise. ### Claim 3 (depends on 1) The method of claim 1, wherein the source comprises a person, the white noise comprising a plosive or fricative sound spoken by said person. ### Claim 4 (depends on 3) The method of claim 3, wherein said directing comprises controlling the sensor and/or indicator to target the person. ### Claim 5 (depends on 1) The method of claim 1, wherein said calculating comprises solving a set of simultaneous equations, each equation in the set relating the additional distance travelled by the echo to each respective one of the plurality of microphones to three unknowns: a distance of the microphone unit from the surface, an angle of the source relative to the microphone unit, and a rotation of the microphone unit relative to the surface. ### Claim 6 (depends on 5) The method of claim 5, comprising using an echo cancelling algorithm to determine a distance of the microphone from the surface and a rotation of the microphone from the surface, and then combining with the spacing to determine the direction of the source. ### Claim 7 (depends on 1) The method of claim 1, wherein said calculating comprises applying a numerical optimization algorithm. ### Claim 8 (depends on 2) The method of claim 2, wherein the method comprises performing a sound recognition algorithm to recognize one or more elements in sound received via said directional microphone unit, and wherein said directing comprises controlling the receive beam to target the source of said noise as part of the sound recognition. ### Claim 9 (depends on 8) The method of claim 8, wherein: the source comprises a person, the white noise comprising a plosive or fricative sound spoken by said person; and the sound recognition algorithm comprises a speech recognition algorithm for recognizing an intention in the person's speech, and wherein said directing comprises controlling the receive beam to target the direction of the person as part of the speech recognition. ### Claim 10 (depends on 2) The method of claim 2, wherein the method comprises performing a sound recognition algorithm to recognize one or more elements in sound received via said directional microphone unit, and wherein said directing comprises controlling the receive beam to avoid the direction of the source during the sound recognition. ### Claim 11 (depends on 10) The method of claim 10, wherein the sound recognition algorithm comprises a speech recognition algorithm for recognizing an intention in a person's speech, and wherein said directing comprises controlling the receive beam to avoid the source of the noise during the speech recognition. ### Claim 12 (depends on 10) The method of claim 10, wherein the source of the noise is a household or office appliance. ### Claim 13 (depends on 12) The method of claim 12, wherein the household appliance comprises a washing machine, dishwasher, air-conditioning unit, heating unit, fan unit, kettle, printer, photocopier or scanner. ### Claim 14 (depends on 1) The method of claim 1, wherein the one or more directional sensors comprise a camera or other non-audio sensor, and said directing comprises directing the camera or other non-audio sensor toward the direction of the source. ### Claim 15 (depends on 1) The method of claim 1, wherein said directing comprises controlling the indicator to indicate a direction of the source of said noise to a user. ### Claim 16 (depends on 15) The method of claim 15, wherein said indicator comprises a light or other visual indicator arranged to indicate said direction by indicating a position of the source. ### Claim 17 (depends on 1) The method of claim 1, wherein the method further comprises: performing a sound recognition algorithm to recognize one or more elements in sound received via said directional microphone unit; identifying spectral locations of the lobes and/or troughs; and on a per frequency band basis, selecting one or a subset of the microphones of the array not experiencing troughs in the frequency band, and using only the selected one or subset of microphones to receive the sound for said sound recognition. ### Claim 18 (depends on 17) The method of claim 17, wherein the sound recognition algorithm comprises a speech recognition algorithm for recognizing an intention in the person's speech, only the selected one or subset of the microphones being used to receive the speech for said speech recognition. ### Claim 19 (depends on 1) The method of claim 1, wherein the method further comprises, based on the respective spectrum, equalizing one or more of the microphones to at least partially reverse a frequency response caused by the echo. ### Claim 20 (depends on 1) The method of claim 1, wherein: said echo comprises a reflection of the white noise from a plurality of reflective surfaces; said identifying comprises modelling the received noise signal as a superposition of respective spectra resulting from each of the surfaces, and identifying the spacing between lobes and/or troughs in the respective spectrum of each surface, thereby determining an additional distance travelled by the echo from each surface relative to the direct path; and said calculating of the direction of the source is based on the additional distances travelled via each of said surfaces. ### Claim 21 (depends on 1) A computer program product embodied on non-transitory computer-readable storage and configured so as when run on one or more processing units to perform operations in accordance with claim 1. ### Claim 22 (depends on 1) A user device comprising the directional microphone unit and control logic configured to perform the method of claim 1. ### Claim 23 (depends on 22) The user device of claim 22, wherein the control logic comprises memory comprising one or more memory units and processing apparatus comprising one or more processing units, the memory storing code arranged to run on the processing apparatus, and the code being configured so as when run on the processing apparatus to perform the method.