# US 2023/0410827 A1 · Audio signal processing method and system for noise mitigation of a voice signal measured by an audio sensor in an ear canal of a user

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410827 A1
- Document ID: US20230410827A1
- Status: Published application
- Kind: A1
- Application number: 17/841,440
- Filed: 2022-06-15
- Published: 2023-12-21
- Earliest claimed: 2022-06-15
- Assignees: Analog Devices International Unlimited Company
- Applicants: Analog Devices International Unlimited Company
- Inventors: Stijn ROBBEN; Charles FOX
- Web page: https://patentgrep.com/patent/US20230410827A1

## CPC

- G10L 21/0208: Noise filtering
- G10L 21/0232: Processing in the frequency domain
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- H04R 5/027: Spatial or constructional arrangements of microphones, e.g. in dummy heads
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- G10L 2021/02082: {the noise being echo, reverberation of the speech}
- G10L 2021/02165: {Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal}
- H04R 1/10: Earpieces; Attachments therefor {; Earphones; Monophonic headphones (H04R1/28 takes precedence; stereophonic headphones H04R5/033)}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

Disclosed is an audio signal processing method implemented by an audio system with internal and external sensors. The internal sensor measures acoustic signals propogating internally to a user's head. The external sensor measures acoustic signals propagating externally to the user's head. The method includes: producing first and second audio signals by measuring simultaneously acoustic signals reaching the internal and external sensors, respectively; filtering the second audio signal by a noise matching filter matching a second noise signal affecting the second audio signal with a first noise signal affecting the first audio signal, wherein the first noise signal and the second noise signal correspond to a same noise acoustic signal originating outside the user's head and measured by respectively the internal and external sensors, thereby producing a filtered second audio signal including a matched second noise signal; and mixing the filtered second audio signal and the first audio signal.

## Claims

### Claim 1

An audio signal processing method implemented by an audio system which comprises at least two sensors which include an internal sensor and an external sensor, wherein the internal sensor is arranged to measure acoustic signals which reach the internal sensor by propagating internally to a head of a user of the audio system and the external sensor is arranged to measure acoustic signals which reach the external sensor by propagating externally to the user's head, wherein the audio signal processing method comprises:
producing a first audio signal and a second audio signal by measuring simultaneously acoustic signals reaching the internal sensor and acoustic signals reaching the external sensor, respectively,
filtering the second audio signal by a noise matching filter configured to match a second noise signal affecting the second audio signal with a first noise signal affecting the first audio signal, wherein the first noise signal and the second noise signal correspond to a same noise acoustic signal originating outside the user's head and measured by respectively the internal sensor and the external sensor, thereby producing a filtered second audio signal which includes a matched second noise signal,
mixing the filtered second audio signal and the first audio signal, thereby producing a denoised first audio signal.

### Claim 2 (depends on 1)

The audio signal processing method according to claim 1, wherein the noise matching filter is an adaptive filter.

### Claim 3 (depends on 2)

The audio signal processing method according to claim 2, further comprising detecting a user's voice activity and adapting the noise matching filter based on the detected user's voice activity.

### Claim 4 (depends on 2)

The audio signal processing method according to claim 2, further comprising detecting wind, and at least one among the following:
adapting the noise matching filter based on the detected wind,
combining the filtered second audio signal and the first audio signal based on the detected wind.

### Claim 5 (depends on 2)

The audio signal processing method according to claim 2, further comprising estimating a noise level and adapting the noise matching filter based on the estimated noise level.

### Claim 6 (depends on 2)

The audio signal processing method according to claim 2, further comprising estimating a level of an echo in the first audio signal and/or in the second audio signal, wherein said echo is caused by a speaker unit of the audio system, and at least one among the following:
adapting the noise matching filter based on the estimated echo level,
combining the filtered second audio signal and the first audio signal based on the estimated echo level.

### Claim 7 (depends on 1)

The audio signal processing method according to claim 1, further comprising filtering the denoised first audio signal by a voice matching filter configured to match a first voice signal in the filtered first audio signal with a second voice signal in the second audio signal, wherein the first voice signal and the second voice signal correspond to a same voice acoustic signal emitted by the user, measured by respectively the internal sensor and the external sensor, thereby producing a filtered denoised first audio signal.

### Claim 8 (depends on 7)

The audio signal processing method according to claim 7, wherein the voice matching filter is an adaptive filter.

### Claim 9 (depends on 8)

The audio signal processing method according to claim 8, further comprising at least one among the following:
detecting a user's voice activity and adapting the voice matching filter based on the detected voice activity,
detecting wind and adapting the noise matching filter based on the detected wind,
estimating a noise level and adapting the noise matching filter based on the estimated noise level,
estimating a level of an echo in the first audio signal and/or in the second audio signal, wherein said echo is caused by a speaker unit of the audio system, and adapting the noise matching filter based on the estimated echo level.

### Claim 10 (depends on 1)

The audio signal processing method according to claim 1, further comprising producing an output signal by using the denoised first audio signal below a cutoff frequency and using the second audio signal above the cutoff frequency.

### Claim 11

An audio system comprising at least two sensors which include an internal sensor and an external sensor, wherein the internal sensor is arranged to measure acoustic signals which reach the internal sensor by propagating internally to a head of a user of the audio system and the external sensor is arranged to measure acoustic signals which reach the external sensor by propagating externally to the user's head, wherein the internal sensor and the external audio sensor are configured to produce a first audio signal and a second audio signal by measuring simultaneously acoustic signals reaching the internal sensor and acoustic signals reaching the external sensor, respectively, wherein said audio system further comprises a processing circuit configured to:
filter the second audio signal by a noise matching filter configured to match a second noise signal affecting the second audio signal with a first noise signal affecting the first audio signal, wherein the first noise signal and the second noise signal correspond to a same noise acoustic signal originating outside the user's head and measured by respectively the internal sensor and the external sensor, thereby producing a filtered second audio signal which includes a matched second noise signal,
mix the filtered second audio signal and the first audio signal, thereby producing a denoised first audio signal.

### Claim 12 (depends on 11)

The audio system according to claim 11, wherein the noise matching filter is an adaptive filter.

### Claim 13 (depends on 12)

The audio system according to claim 12, wherein the processing circuit is further configured to detect a user's voice activity and to adapt the noise matching filter based on the detected voice activity.

### Claim 14 (depends on 12)

The audio system according to claim 12, wherein the processing circuit is further configured to detect wind, and to perform at least one among the following:
adapt the noise matching filter based on the detected wind,
combine the filtered second audio signal and the first audio signal based on the detected wind.

### Claim 15 (depends on 12)

The audio system according to claim 12, wherein the processing circuit is further configured to estimate a noise level and to adapt the noise matching filter based on the estimated noise level.

### Claim 16 (depends on 12)

The audio system according to claim 12, further comprising a speaker unit, wherein the processing circuit is further configured to estimate a level of an echo in the first audio signal and/or in the second audio signal, wherein said echo is caused by the speaker unit, and to perform at least one among the following:
adapt the noise matching filter based on the estimated echo level,
combine the filtered second audio signal and the first audio signal based on the estimated echo level.

### Claim 17 (depends on 11)

The audio system according to claim 11, wherein the processing circuit is further configured to filter the denoised first audio signal by a voice matching filter configured to match a first voice signal in the denoised first audio signal with a second voice signal in the second audio signal, wherein the first voice signal and the second voice signal correspond to a same voice acoustic signal emitted by the user, measured by respectively the internal sensor and the external sensor, thereby producing a filtered denoised first audio signal.

### Claim 18 (depends on 17)

The audio system according to claim 17, wherein the voice matching filter is an adaptive filter.

### Claim 19 (depends on 18)

The audio system according to claim 18, wherein the processing circuit is further configured to perform at least one among the following:
detecting a user's voice activity and adapting the voice matching filter based on the detected user's voice activity,
detecting wind and adapting the noise matching filter based on the detected wind,
estimating a noise level and adapting the noise matching filter based on the estimated noise level,
estimating a level of an echo in the first audio signal and/or in the second audio signal, wherein said echo is caused by a speaker unit of the audio system, and adapting the noise matching filter based on the estimated echo level.

### Claim 20 (depends on 11)

The audio system according to claim 11, wherein the processing circuit is further configured to produce an output signal by using the denoised first audio signal below a cutoff frequency and using the second audio signal above the cutoff frequency.

### Claim 21

A non-transitory computer readable medium comprising computer readable code to be executed by an audio system comprising at least two sensors which include an internal sensor and an external sensor, wherein the internal sensor is arranged to measure acoustic signals which reach the internal sensor by propagating internally to a head of a user of the audio system and the external sensor is arranged to measure acoustic signals which reach the external sensor by propagating externally to the user's head, wherein said audio system further comprises a processing circuit, wherein said computer readable code causes said audio system to:
producing a first audio signal and a second audio signal by measuring simultaneously acoustic signals reaching the internal sensor and acoustic signals reaching the external sensor, respectively,
filter the second audio signal by a noise matching filter configured to match a second noise signal affecting the second audio signal with a first noise signal affecting the first audio signal, wherein the first noise signal and the second noise signal correspond to a same noise acoustic signal originating outside the user's head and measured by respectively the internal sensor and the external sensor, thereby producing a filtered second audio signal which includes a matched second noise signal,
mix the filtered second audio signal and the first audio signal, thereby producing a denoised first audio signal.
