US 12,119,015 B2Granted

Systems, methods, apparatus, and storage medium for processing a signal

AssigneeShenzhen Shokz Co., Ltd.

InventorsJinbo Zheng, Fengyun Liao, Xin Qi

Life of this patent

Estimating the term…

Loading patent…

Abstract

The present disclosure provides systems and methods for processing a signal. The system for processing a signal may include at least one microphone and at least one vibration sensor. The at least one microphone may be configured to collect a sound signal, and the sound signal may include at least one of user voice and environmental noise. The at least one vibration sensor may be configured to collect a vibration signal, and the vibration signal may include at least one of the user voice and the environmental noise. The system for processing a signal may also comprise a processor. The processor may be configured to determine a relationship between a noise component in the sound signal and a noise component in the vibration signal, and obtain a target vibration signal by performing, based at least on the relationship, noise reduction processing on the vibration signal.

Claims15

Dependent claims

A system for processing a signal, comprising:

at least one microphone configured to collect a sound signal, the sound signal including at least one of user voice and environmental noise;
at least one vibration sensor configured to collect a vibration signal, the vibration signal including at least one of the user voice and the environmental noise;
and
a processor configured to:
identify signal segments excluding the user voice within the sound signal and the vibration signal, respectively;
determine, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal;
determine a noise component in the sound signal in signal segments including the user voice;
determine, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration signal in the signal segments including the user voice;
and
obtain a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice,
wherein the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and to determine, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal, the processor is further configured to:
determine a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment;
and
determine a relationship between the first noise signal and the vibration signal.

11 more elements

A method for processing a signal, comprising:

collecting a sound signal by at least one microphone, the sound signal including at least one of user voice and environmental noise;
collecting a vibration signal by at least one vibration sensor, the vibration signal including at least one of the user voice and the environmental noise;
identifying signal segments excluding the user voice within the sound signal and the vibration signal, respectively;
determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal;
determining a noise component in the sound signal in signal segments including the user voice;
determining, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration the signal in signal segments including the user voice;
and
obtaining a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice, wherein:
the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and the determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal includes:
determining a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment;
and
determining a relationship between the first noise signal and the vibration signal.

9 more elements

A non-transitory computer readable medium, comprising at least one set of instructions, wherein when read by a computing device, the at least one set of instructions causes the computing device to perform a method, the method comprising:

collecting a sound signal by at least one microphone, the sound signal including at least one of user voice and environmental noise;
collecting a vibration signal by at least one vibration sensor, the vibration signal including at least one of the user voice and the environmental noise;
identifying signal segments excluding the user voice within the sound signal and the vibration signal, respectively;
determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal;
determining a noise component in the sound signal in signal segments including the user voice;
determining, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration signal in the signal segments including the user voice;
and
obtaining a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice, wherein:
the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and the determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal includes:
determining a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment;
and
determining a relationship between the first noise signal and the vibration signal.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/649,362Filed 30 Jan 2022 · continuation
Priority: 19 Mar 2021
Published: US 2022/0301574 A122 Sep 2022
Granted: 15 Oct 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification4 codes

G10L 21/0216
Noise filtering: characterised by the method used for estimating noise
G10L 25/18
Characterised by the type of extracted parameters: the extracted parameters being spectral information of each sub-band
G10L 25/78
Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00: detection of presence or absence of voice signals
G10L
Speech analysis techniques or speech synthesis

Family

PCT/CN2021/081927Parent of this continuation · filed 19 Mar 2021
US 2022/0301574 A1Pre-grant publication · published 22 Sep 2022
US 12,119,015 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key