# US 2021/0264893 A1 · Signal processing method and device for earphone, and earphone

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0264893 A1
- Document ID: US20210264893A1
- Status: Published application
- Kind: A1
- Application number: 17/180,705
- Filed: 2021-02-19
- Published: 2021-08-26
- Earliest claimed: 2020-02-20
- Assignees: Beijing Xiaoniao Tingting Technology Co., LTD.
- Applicants: Beijing Xiaoniao Tingting Technology Co., LTD.
- Inventors: Song LIU; Na LI; Bo LI
- Web page: https://patentgrep.com/patent/US20210264893A1

## CPC

- G10K 11/17854: {the filter being an adaptive filter}
- H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)}
- G01P 15/18: in two or more dimensions
- G10K 11/17881: {the reference signal being an acoustic signal, e.g. recorded with a microphone}
- G10K 2210/1081: Earphones, e.g. for telephones, ear protectors or headsets
- G10K 2210/3026: Feedback
- G10K 2210/3027: Feedforward
- G10K 2210/3028: Filtering, e.g. Kalman filters or special analogue or digital filters
- G10K 2210/501: Acceleration, e.g. for accelerometers
- H04R 2410/05: Noise reduction with a separate noise microphone
- H04R 2410/07: Mechanical or electrical reduction of wind noise generated by wind passing a microphone
- H04R 2460/01: Hearing devices using active noise cancellation
- G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G01P: MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT (measuring or recording blood flow A61B5/02, A61B8/06; monitoring speed or deceleration of electrically-propelled vehicles B60L3/00; vehicle lighting systems adapted to indicate speed B60Q1/54; determining position or course in navigation, measuring ground distance in geodesy or surveying G01C; combined measuring devices for measuring two or more variables of movement G01C23/00; measuring velocity of sound G01H; measuring velocity of light G01J7/00; measuring direction or velocity of solid objects by reception or emission of radiowaves or other waves and based on propagation effects, e.g. Doppler effect, propagation time, direction of propagation, G01S; measuring speed of nuclear radiation G01T; measuring acceleration of gravity G01V; {measuring or recording the speed of trains B61L23/00; speed indicators incorporated in motor vehicles B60K35/00; measuring frequency or phase G01R; traffic control G08G})

## Abstract

A signal processing method for an earphone includes: a motion state of a wearer of the earphone is detected by using an acceleration sensor arranged inside the earphone; a first microphone and a second microphone both arranged outside the earphone detect wind noise conditions corresponding to different frequency bands; and according to the motion state of the wearer of the earphone and the wind noise conditions corresponding to different frequency bands, operating modes of a feedforward filter and a feedback filter inside the earphone are adjusted, herein the feedforward filter and the feedback filter are configured for active noise cancellation of the earphone.

## Claims

### Claim 1

A signal processing method for an earphone, comprising:
detecting a motion state of a wearer of the earphone by using an acceleration sensor arranged inside the earphone;
detecting wind noise conditions corresponding to different frequency bands by using a first microphone and a second microphone both arranged outside the earphone; and
adjusting, according to the motion state of the wearer of the earphone and the wind noise conditions corresponding to different frequency bands, operating modes of a feedforward filter and a feedback filter inside the earphone, wherein the feedforward filter and the feedback filter are configured for active noise cancellation of the earphone.

### Claim 2 (depends on 1)

The signal processing method for an earphone of claim 1, wherein the detecting the wind noise conditions corresponding to different frequency bands comprises:
acquiring, according to signals collected by the first microphone and the second microphone, an average correlation of signals of the two microphones corresponding to each of three frequency bands including a low frequency band, a mid frequency band and a high frequency band respectively, and an average energy of the signals of the first microphone corresponding to each of the three frequency bands, wherein the first microphone is a feedforward microphone and the second microphone is a talk microphone; and
determining, according to the acquired average correlations and average energies, whether there is wind noise in the three frequency bands, and intensities of the wind noise in the three frequency bands.

### Claim 3 (depends on 2)

The signal processing method for an earphone of claim 2, wherein the acquiring comprises:
acquiring, according to time domain signals collected by the first microphone and the second microphone, frequency domain signals of the first microphone and the second microphone at each of frequency points; and
dividing frequency bands of the signals into three frequency bands including a low frequency band, a mid frequency band and a high frequency band, and acquiring, according to the acquired frequency domain signals of the first microphone and the second microphone at each of frequency points, the average correlation of signals of the two microphones corresponding to each of the three frequency bands including the low frequency band, the mid frequency band and the high frequency band respectively, and the average energy of the signals of the first microphone corresponding to each of the three frequency bands.

### Claim 4 (depends on 2)

The signal processing method for an earphone of claim 2, wherein the determining comprises:
for each frequency band, if the average correlation is less than a first correlation threshold, determining that there is strong wind noise in the frequency band responsive to the average energy being greater than a first energy threshold, determining that there is weak wind noise in the frequency band responsive to the average energy being less than the first energy threshold but greater than a second energy threshold, and determining that there is no wind noise in the frequency band responsive to the average energy being less than the second energy threshold;
for each frequency band, if the average correlation is greater than the first correlation threshold but less than a second correlation threshold, determining that there is weak wind noise in the frequency band responsive to the average energy being greater than the second energy threshold, and determining that there is no wind noise in the frequency band responsive to the average energy being less than the second energy threshold; and
for each frequency band, if the average correlation is greater than the second correlation threshold, determining that there is no wind noise in the frequency band.

### Claim 5 (depends on 1)

The signal processing method for an earphone of claim 1, wherein the adjusting comprises:
when the wearer of the earphone is in the motion state and there is weak wind noise in the low frequency band, and no wind noise in the mid frequency band and the high frequency band, adjusting coefficients of the feedforward filter to allow the feedforward filter to amplify signals in mid and high frequency bands, and keeping the feedback filter unchanged; or
when the wearer of the earphone is in the motion state and there is strong wind noise in the low frequency band, weak wind noise in the mid frequency band and no wind noise in the high frequency band, adjusting the coefficients of the feedforward filter to allow the feedforward filter to amplify the signal in the high frequency band only, and keeping the feedback filter unchanged; or
when the wearer of the earphone is in the motion state and there is strong wind noise in the mid frequency band, and weak wind noise or strong wind noise in the high frequency band, turning off the feedforward filter, and keeping the feedback filter unchanged; or
when the wearer of the earphone is in a non-motion state and there is strong wind noise in the low frequency band, turning off the feedforward filter, and keeping the feedback filter unchanged.

### Claim 6 (depends on 1)

The signal processing method for an earphone of claim 1, further comprising: detecting an energy magnitude of environmental noise by using the first microphone, and considering the energy magnitude of the environmental noise when adjusting the operating modes of the feedforward filter and the feedback filter inside the earphone.

### Claim 7 (depends on 6)

The signal processing method for an earphone of claim 6, wherein the detecting the energy magnitude of the environmental noise by using the first microphone comprises:
performing exponential smoothing on the frequency domain signal of the first microphone at any of frequency points, and taking a minimum value of the smoothed signals within a set length of time to obtain the environmental noise signal of the frequency point in a current time frame; and
superimposing the environmental noise signals of all the frequency points in the current time frame to obtain a total energy of the environmental noises.

### Claim 8 (depends on 6)

The signal processing method for an earphone of claim 6, wherein the considering the energy magnitude of the environmental noise when adjusting the operating modes of the feedforward filter and the feedback filter inside the earphone comprises:
when the wearer of the earphone is in a motion state and there is no wind noise in the low frequency band, adjusting coefficients of the feedforward filter to allow the feedforward filter to amplify signals in mid and high frequency bands, and selecting, according to the energy magnitude of the environmental noise in the low frequency band, a feedforward filter and a feedback filter with appropriate noise cancellation levels so that there is an appropriate level of noise cancellation in the low frequency band; or
when the wearer of the earphone is in the non-motion state and there is no wind noise or weak wind noise in the low frequency band, selecting a feedforward filter and a feedback filter with appropriate noise cancellation levels according to the energy magnitude of the environmental noise in the entire frequency bands, to perform noise cancellation on the entire frequency bands.

### Claim 9

A signal processing device for an earphone, comprising:
a processor; and
memory configured to store instructions executable by the processor,
wherein the processor is configured to:
detect a motion state of a wearer of the earphone by using an acceleration sensor arranged inside the earphone;
detect wind noise conditions corresponding to different frequency bands by using a first microphone and a second microphone both arranged outside the earphone; and
adjust, according to the motion state of the wearer of the earphone and the wind noise conditions corresponding to different frequency bands, operating modes of a feedforward filter and a feedback filter inside the earphone, wherein the feedforward filter and the feedback filter are configured for active noise cancellation of the earphone.

### Claim 10 (depends on 9)

The signal processing device for an earphone of claim 9, wherein to detect the wind noise conditions corresponding to different frequency bands, the processor is further configured to:
acquire, according to signals collected by the first microphone and the second microphone, an average correlation of signals of the two microphones corresponding to each of three frequency bands including a low frequency band, a mid frequency band and a high frequency band respectively, and an average energy of the signals of the first microphone corresponding to each of the three frequency bands, wherein the first microphone is a feedforward microphone and the second microphone is a talk microphone; and
determine, according to the acquired average correlations and average energies, whether there is wind noise in the three frequency bands, and intensities of the wind noise in the three frequency bands.

### Claim 11 (depends on 10)

The signal processing device for an earphone of claim 10, wherein to acquire, according to the signals collected by the first microphone and the second microphone, the average correlation of signals of the two microphones corresponding to each of the three frequency bands including the low frequency band, the mid frequency band and the high frequency band respectively, and the average energy of the signals of the first microphone corresponding to each of the three frequency bands, the processor is configured to:
acquire, according to time domain signals collected by the first microphone and the second microphone, frequency domain signals of the first microphone and the second microphone at each of frequency points; and
divide frequency bands of the signals into three frequency bands including a low frequency band, a mid frequency band and a high frequency band, and acquire, according to the acquired frequency domain signals of the first microphone and the second microphone at each of frequency points, the average correlation of signals of the two microphones corresponding to each of the three frequency bands including the low frequency band, the mid frequency band and the high frequency band respectively, and the average energy of the signals of the first microphone corresponding to each of the three frequency bands.

### Claim 12 (depends on 10)

The signal processing device for an earphone of claim 10, wherein to determine, according to the acquired average correlations and average energies, whether there is wind noise in the three frequency bands, and the intensities of the wind noise in the three frequency bands, the processor is configured to:
for each frequency band, if the average correlation is less than a first correlation threshold, determining that there is strong wind noise in the frequency band responsive to the average energy being greater than a first energy threshold, determine that there is weak wind noise in the frequency band responsive to the average energy being less than the first energy threshold but greater than a second energy threshold, and determine that there is no wind noise in the frequency band responsive to the average energy being less than the second energy threshold;
for each frequency band, if the average correlation is greater than the first correlation threshold but less than a second correlation threshold, determine that there is weak wind noise in the frequency band responsive to the average energy being greater than the second energy threshold, and determine that there is no wind noise in the frequency band responsive to the average energy being less than the second energy threshold; and
for each frequency band, if the average correlation is greater than the second correlation threshold, determine that there is no wind noise in the frequency band.

### Claim 13 (depends on 9)

The signal processing device for an earphone of claim 9, wherein to adjust, according to the motion state of the wearer of the earphone and the wind noise conditions corresponding to different frequency bands, the operating modes of the feedforward filter and the feedback filter inside the earphone, the processor is configured to:
when the wearer of the earphone is in the motion state and there is weak wind noise in the low frequency band, and no wind noise in the mid frequency band and the high frequency band, adjust coefficients of the feedforward filter to allow the feedforward filter to amplify signals in mid and high frequency bands, and keep the feedback filter unchanged; or
when the wearer of the earphone is in the motion state and there is strong wind noise in the low frequency band, weak wind noise in the mid frequency band and no wind noise in the high frequency band, adjust the coefficients of the feedforward filter to allow the feedforward filter to amplify the signal in the high frequency band only, and keep the feedback filter unchanged; or
when the wearer of the earphone is in the motion state and there is strong wind noise in the mid frequency band, and weak wind noise or strong wind noise in the high frequency band, turn off the feedforward filter, and keep the feedback filter unchanged; or
when the wearer of the earphone is in a non-motion state and there is strong wind noise in the low frequency band, turn off the feedforward filter, and keep the feedback filter unchanged.

### Claim 14 (depends on 9)

The signal processing device for an earphone of claim 9, wherein the processor is further configured to: detect an energy magnitude of environmental noise by using the first microphone, and consider the energy magnitude of the environmental noise when adjusting the operating modes of the feedforward filter and the feedback filter inside the earphone.

### Claim 15 (depends on 14)

The signal processing device for an earphone of claim 14, wherein to detect the energy magnitude of the environmental noise by using the first microphone, the processor is configured to:
perform exponential smoothing on the frequency domain signal of the first microphone at any of frequency points, and take a minimum value of the smoothed signals within a set length of time to obtain the environmental noise signal of the frequency point in a current time frame; and
superimpose the environmental noise signals of all the frequency points in the current time frame to obtain a total energy of the environmental noises.

### Claim 16 (depends on 14)

The signal processing device for an earphone of claim 14, wherein to consider the energy magnitude of the environmental noise when adjusting the operating modes of the feedforward filter and the feedback filter inside the earphone, the processor is configured to:
when the wearer of the earphone is in the motion state and there is no wind noise in the low frequency band, adjust coefficients of the feedforward filter to allow the feedforward filter to amplify signals in mid and high frequency bands, and select, according to the energy magnitude of the environmental noise in the low frequency band, a feedforward filter and a feedback filter with appropriate noise cancellation levels so that there is an appropriate level of noise cancellation in the low frequency band; or
when the wearer of the earphone is in the non-motion state, and there is no wind noise or weak wind noise in the low frequency band, select a feedforward filter and a feedback filter with appropriate noise cancellation levels according to the energy magnitude of the environmental noise in the entire frequency bands, to perform noise cancellation on the entire frequency bands.

### Claim 17 (depends on 9)

An earphone, comprising: an acceleration sensor arranged inside the earphone, a first microphone and a second microphone both arranged outside the earphone, and a feedforward filter and a feedback filter inside the earphone, wherein the earphone is further provided therein with the signal processing device for an earphone of claim 9.

### Claim 18

A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to perform a signal processing method for an earphone, the method comprising:
detecting a motion state of a wearer of the earphone by using an acceleration sensor arranged inside the earphone;
detecting wind noise conditions corresponding to different frequency bands by using a first microphone and a second microphone both arranged outside the earphone; and
adjusting, according to the motion state of the wearer of the earphone and the wind noise conditions corresponding to different frequency bands, operating modes of a feedforward filter and a feedback filter inside the earphone, wherein the feedforward filter and the feedback filter are configured for active noise cancellation of the earphone.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the detecting the wind noise conditions corresponding to different frequency bands comprises:
acquiring, according to signals collected by the first microphone and the second microphone, an average correlation of signals of the two microphones corresponding to each of three frequency bands including a low frequency band, a mid frequency band and a high frequency band respectively, and an average energy of the signals of the first microphone corresponding to each of the three frequency bands, wherein the first microphone is a feedforward microphone and the second microphone is a talk microphone; and
determining, according to the acquired average correlations and average energies, whether there is wind noise in the three frequency bands, and intensities of the wind noise in the three frequency bands.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the acquiring comprises:
acquiring, according to time domain signals collected by the first microphone and the second microphone, frequency domain signals of the first microphone and the second microphone at each of frequency points; and
dividing frequency bands of the signals into three frequency bands including a low frequency band, a mid frequency band and a high frequency band, and acquiring, according to the acquired frequency domain signals of the first microphone and the second microphone at each of frequency points, the average correlation of signals of the two microphones corresponding to each of the three frequency bands including the low frequency band, the mid frequency band and the high frequency band respectively, and the average energy of the signals of the first microphone corresponding to each of the three frequency bands.
