# US 2021/0176571 A1 · Method and apparatus for spatial filtering and noise suppression

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176571 A1
- Document ID: US20210176571A1
- Status: Published application
- Kind: A1
- Application number: 17/068,810
- Filed: 2020-10-12
- Published: 2021-06-10
- Earliest claimed: 2017-12-01
- Inventors: Ross Snyder
- Web page: https://patentgrep.com/patent/US20210176571A1

## CPC

- H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)}
- H04R 25/43: {Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics (H04R25/407 takes precedence)}
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 25/356: {Amplitude, e.g. amplitude shift or compression}
- H04R 25/405: {by combining a plurality of transducers}
- H04R 25/407: {Circuits for combining signals of a plurality of transducers}
- H04R 25/552: {Binaural}
- H04R 25/554: {using a wireless connection, e.g. between microphone and amplifier or using Tcoils}
- H04R 25/70: {Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting}
- G10L 21/0208: Noise filtering
- G10L 25/30: using neural networks
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L 2021/02166: {Microphone arrays; Beamforming}
- H04R 1/406: {microphones}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 25/507: {implemented by neural network or fuzzy logic}
- H04R 2201/401: 2D or 3D arrays of transducers
- H04R 2225/43: Signal processing in hearing aids to enhance the speech intelligibility
- H04R 2430/23: Direction finding using a sum-delay beam-former
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04S: STEREOPHONIC SYSTEMS

## Abstract

An apparatus, system, and method for selectively enhancing a desired sound while suppressing noise is provided. An apparatus comprises a plurality of microphones situated at spatially diverse locations to provide microphone signals, a spatial filter coupled to the microphones, the spatial filter configured to spatially filter the microphone signals, and a noise suppressor coupled to the spatial filter, the noise suppressor for suppressing noise. In accordance with at least one embodiment, the noise suppressor comprises a voice activity detector coupled to the spatial filter, the voice activity detector for detecting voice activity and for selecting an updated spatial parameter value for the spatial filter to use for performing further spatial filtering.

## Claims

### Claim 1

Apparatus comprising:
a plurality of microphones situated at spatially diverse locations to provide microphone signals;
a spatial filter coupled to the microphones, the spatial filter configured to spatially filter the microphone signals; and
a noise suppressor coupled to the spatial filter, the noise suppressor for suppressing noise after spatial filtering.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the noise suppressor comprises:
an artificial neural network (ANN) for learning a noise characteristic of the noise.

### Claim 3 (depends on 1)

The apparatus of claim 1 wherein the noise suppressor comprises:
a voice activity detector coupled to the spatial filter, the voice activity detector for detecting voice activity.

### Claim 4 (depends on 1)

The apparatus of claim 1 further comprising:
a human interface device (HID) coupled to the spatial filter, the HID for receiving a manual control input and for providing control of a spatial filter parameter value of the spatial filter, the HID configured to control an angular direction for spatial filtering and an amount of spatial filtering.

### Claim 5 (depends on 1)

The apparatus of claim 1 further comprising:
a spatial scanner coupled to the noise suppressor and to the spatial filter, the spatial scanner coupling the noise suppressor to the spatial filter, the spatial scanner for scanning a plurality of spatial filter parameter values of the spatial filter and for receiving a feedback signal from the noise suppressor.

### Claim 6 (depends on 1)

The apparatus of claim 1 further comprising:
an audio processor coupled to the noise suppressor and to the audio amplifier, the audio processor coupling the noise suppressor to the audio amplifier, the audio processor comprising a speech recognizer, the speech recognizer for recognizing speech and for providing a spatial filter feedback signal to the spatial filter and a noise suppressor feedback signal to the noise suppressor.

### Claim 7 (depends on 1)

The apparatus of claim 1 wherein the spatial filter comprises:
a differential amplifier for amplifying a difference between a first microphone derived signal derived from a first microphone of the plurality of microphones and a second microphone derived signal derived from a second microphone of the plurality of microphones.

### Claim 8 (depends on 1)

The apparatus of claim 1 wherein the spatial filter comprises:
a first adjustable time delay element for delaying a first microphone derived signal derived from a first microphone of the plurality of microphones; and
a second adjustable time delay element for delaying a second microphone derived signal from a second microphone of the plurality of microphones, the first adjustable time delay element and the second adjustable time delay element for providing time-difference-of-arrival-based (TDOA-based) spatial filtering.

### Claim 9 (depends on 1)

The apparatus of claim 1 further comprising:
a frequency domain filter coupled to the spatial filter and to the noise suppressor, the frequency domain filter coupling the spatial filter to the noise suppressor, the frequency domain filter for spectrally filtering a spatially filtered signal from the spatial filter.

### Claim 10

A method comprising:
receiving acoustic input signals;
performing spatial filtering of the acoustic input signals;
performing noise suppression after the performing the spatial filtering;
applying a voice activity detection indication obtained from the performing noise suppression to select an updated spatial parameter value for further spatial filtering; and
providing spatially filtered noise-suppressed output.

### Claim 11 (depends on 10)

The method of claim 10 further comprising:
performing frequency domain filtering;

### Claim 12 (depends on 10)

The method of claim 10 further comprising:
reading a human input device (HID) to obtain a spatial filtering parameter value, wherein the performing the spatial filtering of the acoustic input signals comprises performing the spatial filtering of the acoustic input signals according to the spatial filtering parameter value, the HID configured to control an angular direction for spatial filtering and an amount of spatial filtering.

### Claim 13 (depends on 10)

The method of claim 10 further comprising:
scanning a plurality of spatial filtering parameter values, wherein the performing the spatial filtering of the acoustic input signals comprises performing the spatial filtering of the acoustic input signals according to each of the spatial filtering parameter values.

### Claim 14 (depends on 10)

The method of claim 10 wherein the performing the spatial filtering of the acoustic input signals comprises:
amplifying an amplitude difference between a first amplitude of a first acoustic input signal from a first microphone and a second amplitude of a second acoustic input signal from a second microphone, the first microphone and the second microphone situated at spatially diverse locations.

### Claim 15 (depends on 10)

The method of claim 10 wherein the performing the spatial filtering of the acoustic input signals comprises:
introducing a temporal delay to a second timing of a second acoustic input signal from a second microphone with respect to a first timing of a first acoustic input signal from a first microphone, the first microphone and the second microphone situated at spatially diverse locations.

### Claim 16 (depends on 10)

The method of claim 10 further comprising:
performing speech recognition on a noise-suppressed signal;
adjusting the spatial filtering based on a first metric of the speech recognition; and
adjusting the noise suppression based on a second metric of the speech recognition.

### Claim 17 (depends on 10)

The method of claim 10 wherein the performing noise suppression comprises:
performing the noise suppression using an artificial neural network (ANN).

### Claim 18

An apparatus comprising:
a plurality of microphones situated at spatially diverse locations to provide microphone signals;
a spatial filter coupled to the microphones, the spatial filter configured to spatially filter the microphone signals;
a noise suppressor coupled to the spatial filter, the noise suppressor for suppressing noise according to a recurrent neural network (RNN); and
an audio processor coupled to the noise suppressor, the audio processor comprising a speech recognizer, the speech recognizer providing a spatial filter feedback signal to control the spatial filter and a noise suppressor feedback signal to control the noise suppressor.

### Claim 19 (depends on 18)

The apparatus of claim 18 further comprising:
a human interface device (HID) coupled to the spatial filter, the HID for receiving a manual control input and for providing control of a spatial filter parameter value of the spatial filter, the HID configured to control an angular direction for spatial filtering and an amount of spatial filtering.

### Claim 20 (depends on 18)

The apparatus of claim 18 further comprising:
a spatial scanner coupled to the noise suppressor and to the spatial filter, the spatial scanner coupling the noise suppressor to the spatial filter, the spatial scanner for scanning a plurality of spatial filter parameter values of the spatial filter and for receiving a feedback signal from the noise suppressor.
