# US 12,119,015 B2 · Systems, methods, apparatus, and storage medium for processing a signal > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,119,015 B2 - Document ID: US12119015B2 - Status: Granted - Kind: B2 - Application number: 17/649,362 - Filed: 2022-01-30 - Published: 2022-09-22 - Granted: 2024-10-15 - Earliest claimed: 2021-03-19 - Assignees: Shenzhen Shokz Co., Ltd. - Applicants: Shenzhen Shokz Co., Ltd. - Inventors: Jinbo Zheng; Fengyun Liao; Xin Qi - Web page: https://patentgrep.com/patent/US12119015B2 ## CPC - G10L 21/0216: characterised by the method used for estimating noise - G10L 25/18: the extracted parameters being spectral information of each sub-band - G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract The present disclosure provides systems and methods for processing a signal. The system for processing a signal may include at least one microphone and at least one vibration sensor. The at least one microphone may be configured to collect a sound signal, and the sound signal may include at least one of user voice and environmental noise. The at least one vibration sensor may be configured to collect a vibration signal, and the vibration signal may include at least one of the user voice and the environmental noise. The system for processing a signal may also comprise a processor. The processor may be configured to determine a relationship between a noise component in the sound signal and a noise component in the vibration signal, and obtain a target vibration signal by performing, based at least on the relationship, noise reduction processing on the vibration signal. ## Claims ### Claim 1 A system for processing a signal, comprising: at least one microphone configured to collect a sound signal, the sound signal including at least one of user voice and environmental noise; at least one vibration sensor configured to collect a vibration signal, the vibration signal including at least one of the user voice and the environmental noise; and a processor configured to: identify signal segments excluding the user voice within the sound signal and the vibration signal, respectively; determine, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal; determine a noise component in the sound signal in signal segments including the user voice; determine, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration signal in the signal segments including the user voice; and obtain a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice, wherein the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and to determine, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal, the processor is further configured to: determine a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment; and determine a relationship between the first noise signal and the vibration signal. ### Claim 2 (depends on 1) The system of claim 1, wherein the processor is further configured to obtain the target vibration signal by suppressing steady-state noise in the vibration signal. ### Claim 3 (depends on 1) The system of claim 1, wherein the processor is further configured to convert the sound signal and the vibration signal from a time domain signal to a frequency domain signal; and obtain a noise relationship between the noise component in the sound signal and the noise component in the vibration signal on at least one frequency domain sub-band. ### Claim 4 (depends on 1) The system of claim 1, wherein the processor is further configured to obtain a target sound signal by performing a noise reduction processing on the sound signal in one of the signal segments including the user voice of the sound signal. ### Claim 5 (depends on 4) The system of claim 4, wherein the processor is further configured to obtain a target signal by aliasing at least part of components in the target vibration signal with at least part of components in the target sound signal, wherein frequencies of the at least part of the components in the target vibration signal are less than frequencies of the at least part of the components in the target sound signal. ### Claim 6 (depends on 1) The system of claim 1, wherein the processor is further configured to: determine a first voice signal from the sound signal based on the relative positional relationship between the plurality of microphones in the microphone array in one of the signal segments including the user voice; and obtain a target sound signal by performing, based on the first noise signal and the first voice signal, a noise reduction processing on the sound signal, or designate the first voice signal as the target sound signal. ### Claim 7 (depends on 1) The system of claim 1, including: a noise mixer, and to generate the sound signal, the processor is configured to perform operations including: obtaining a microphone signal collected by at least one target microphone in the plurality of microphones; and generating the sound signal by mixing the first noise signal and the microphone signal via the noise mixer. ### Claim 8 (depends on 7) The system of claim 7, wherein the noise mixer is configured to: obtain a noise level along the direction of the user voice; and determine, based on the noise level, a mixing ratio of the first noise signal to the microphone signal. ### Claim 9 (depends on 1) The system of claim 1, wherein a signal-to-noise ratio of the at least one vibration sensor is greater than a signal-to-noise ratio of the at least one microphone in at least part of a frequency range. ### Claim 10 (depends on 1) The system of claim 1, further comprises a noise relationship calculator, the processor configured to: detect whether the sound signal and the vibration signal include the user voice, when the sound signal and the vibration signal do not include the user voice, updating the relationship between the noise component in the sound signal and the noise component in the vibration signal by the noise relationship calculator; and when the sound signal and the vibration signal include the user voice, stop updating the relationship between the noise component in the sound signal and the noise component in the vibration signal, and performing noise reduction processing on the vibration signal to obtain the target vibration signal. ### Claim 11 A method for processing a signal, comprising: collecting a sound signal by at least one microphone, the sound signal including at least one of user voice and environmental noise; collecting a vibration signal by at least one vibration sensor, the vibration signal including at least one of the user voice and the environmental noise; identifying signal segments excluding the user voice within the sound signal and the vibration signal, respectively; determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal; determining a noise component in the sound signal in signal segments including the user voice; determining, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration the signal in signal segments including the user voice; and obtaining a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice, wherein: the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and the determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal includes: determining a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment; and determining a relationship between the first noise signal and the vibration signal. ### Claim 12 (depends on 11) The method of claim 11, including: performing a noise reduction processing on the sound signal in one of the signal segments including the user voice of the sound signal; and aliasing at least part of components in the target vibration signal with at least part of components in the target sound signal, wherein frequencies of the at least part of the components in the target vibration signal are less than frequencies of the at least part of the components in the target sound signal. ### Claim 13 (depends on 11) The method of claim 11, including: determining a first voice signal from the sound signal based on the relative positional relationship between the plurality of microphones in the microphone array in one of the signal segments including the user voice; and obtaining a target sound signal by performing, based on the first noise signal and the first voice signal, a noise reduction processing on the sound signal, or designate the first voice signal as the target sound signal. ### Claim 14 (depends on 11) The method of claim 11, further including: obtaining a microphone signal collected by at least one target microphone in the plurality of microphones; and generating the sound signal by mixing the first noise signal and the microphone signal. ### Claim 15 A non-transitory computer readable medium, comprising at least one set of instructions, wherein when read by a computing device, the at least one set of instructions causes the computing device to perform a method, the method comprising: collecting a sound signal by at least one microphone, the sound signal including at least one of user voice and environmental noise; collecting a vibration signal by at least one vibration sensor, the vibration signal including at least one of the user voice and the environmental noise; identifying signal segments excluding the user voice within the sound signal and the vibration signal, respectively; determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, a relationship between a noise component in the sound signal and a noise component in the vibration signal; determining a noise component in the sound signal in signal segments including the user voice; determining, based on the relationship and the noise component in the sound signal in the signal segments including the user voice, a noise component in the vibration signal in the signal segments including the user voice; and obtaining a target vibration signal by removing the noise component in the vibration signal in the signal segments including the user voice, wherein: the at least one microphone includes a microphone array, the microphone array includes a plurality of microphones, and the determining, in the identified signal segments excluding the user voice within the sound signal and the vibration signal, the relationship between the noise component in the sound signal and the noise component in the vibration signal includes: determining a first noise signal from the sound signal based on a relative positional relationship between the plurality of microphones in the microphone array in the identified signal segments excluding the user voice within the sound signal and the vibration signal, respectively, wherein the first noise signal is a noise signal synthesized from noises in all directions except a direction of the user voice in the environment; and determining a relationship between the first noise signal and the vibration signal.