# US 10,482,871 B2 · Method for processing signals, terminal device, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,482,871 B2
- Document ID: US10482871B2
- Status: Granted
- Kind: B2
- Application number: 16/229,410
- Filed: 2018-12-21
- Published: 2019-10-03
- Granted: 2019-11-19
- Earliest claimed: 2018-03-30
- Assignees: Guangdong Oppo Mobile Telecommunications Corp., Ltd.
- Applicants: Guangdong Oppo Mobile Telecommunications Corp., Ltd.
- Inventors: Bixiang Yan
- Web page: https://patentgrep.com/patent/US10482871B2

## CPC

- G10K 11/17881: {the reference signal being an acoustic signal, e.g. recorded with a microphone}
- G08B 13/1672: {using sonic detecting means, e.g. a microphone operating in the audio frequency range}
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)}
- H04R 3/12: for distributing signals to two or more loudspeakers {(specially adapted for hearing aids H04R25/407)}
- G10K 2210/1081: Earphones, e.g. for telephones, ear protectors or headsets
- G10K 2210/3016: Control strategies, e.g. energy minimization or intensity measurements
- G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A method for processing signals, a terminal device, and a non-transitory computer-readable storage medium are provided. The method includes the following. A sound signal of external environment is recorded via a microphone of a headphone when the headphone is in a playing state. Feature audio in the sound signal is identified and reminding information corresponding to the feature audio is acquired. Inquire of a user whether recorded sound signal is critical according to the reminding information in response to the headphone being paused. An input operation of the user is detected and the sound signal is processed according to the input operation of the user.

## Claims

### Claim 1

A method for processing signals, comprising:
recording, via a microphone of a headphone, a sound signal of external environment when the headphone is in a playing state;
identifying feature audio in the sound signal and acquiring reminding information corresponding to the feature audio;
inquiring of a user whether recorded sound signal is critical according to the reminding information, in response to the headphone being paused; and
detecting an input operation of the user and processing the sound signal according to the input operation of the user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the microphone comprises a first microphone and a second microphone, and the recording, via a microphone of a headphone, a sound signal of external environment when the headphone is in a playing state comprises one of the following:
recording, via the first microphone of the headphone, the sound signal of external environment when playing music through the headphone; and
recording, via the second microphone of the headphone, the sound signal of external environment when the user talking through the headphone.

### Claim 3 (depends on 2)

The method of claim 2, wherein the recording, via a microphone of a headphone, a sound signal of external environment when the headphone is in a playing state comprises:
acquiring the sound signal of the external environment recorded via the first microphone of the headphone within a preset time period when playing music through the headphone, the preset time period being determined according to a time period in which the music is played; and
generating and storing an audio file corresponding to the sound signal recorded.

### Claim 4 (depends on 1)

The method of claim 1, further comprising the following prior to the identifying feature audio in the sound signal:
detecting whether the sound signal contains a valid sound signal; and
conducting a smooth-filter process on the sound signal when the sound signal contains the valid sound signal.

### Claim 5 (depends on 1)

The method of claim 1, wherein the identifying feature audio in the sound signal and acquiring reminding information corresponding to the feature audio comprises:
determining whether the sound signal contains the feature audio according to a preset sound model; and
determining the reminding information corresponding to the feature audio according to a correspondence between feature audio and reminding information, based on a determination that the sound signal contains the feature audio.

### Claim 6 (depends on 5)

The method of claim 5, wherein the determining whether the sound signal contains the feature audio according to a preset sound model comprises at least one of:
extracting noise information in the sound signal and determining whether the noise information matches a preset noise model;
extracting voiceprint information in the sound signal and determining whether the voiceprint information matches a sample voiceprint information; and
extracting sensitive information in the sound signal and determining whether the sensitive information matches a preset keyword.

### Claim 7 (depends on 1)

The method of claim 1, wherein the inquiring of a user whether recorded sound signal is critical according to the reminding information, in response to the headphone being paused comprises one of:
inquiring of the user whether the recorded sound signal is critical according to the reminding information in response to music switching being detected, in a process of playing music through the headphone; or
inquiring of the user whether the recorded sound signal is critical according to the reminding information in response to a music pause instruction being received, in the process of playing music through the headphone.

### Claim 8 (depends on 1)

The method of claim 1, wherein the detecting an input operation of the user and processing the sound signal according to the input operation comprises:
receiving the input operation of the user on the headphone and determining whether to play the sound signal according to the input operation; and
playing the sound signal based on a determination that the sound signal is to be played; or
deleting a stored audio file corresponding to the sound signal based on a determination that the sound signal is not to be played.

### Claim 9 (depends on 8)

The method of claim 8, wherein the playing the sound signal comprises:
acquiring, via the headphone, at least one of geographic location information and time information of the sound signal; and
generating a target audio file according to the sound signal and the at least one of geographic location information and time information of the sound signal, and playing the target audio file.

### Claim 10

A terminal device, comprising:
at least one processor; and
a computer readable storage, coupled to the at least one processor and storing at least one computer executable instruction thereon which, when executed by the at least one processor, cause the at least one processor to carry out actions, comprising;
recording a sound signal of external environment when a headphone is in a playing state;
identifying feature audio in the sound signal and acquiring reminding information corresponding to the feature audio;
inquiring of a user whether recorded sound signal is critical according to the reminding information, in response to the headphone being paused; and
detecting an input operation of the user and processing the sound signal according to the input operation of the user.

### Claim 11 (depends on 10)

The terminal device of claim 10, wherein the at least one processor carrying out the action of recording the sound signal of external environment when the headphone is in the playing state is caused to carry out actions, comprising:
acquiring the sound signal of the external environment within a preset time period when playing music through the headphone, the preset time period being determined according to a time period in which the music is played; and
generating and storing an audio file corresponding to the sound signal recorded.

### Claim 12 (depends on 10)

The terminal device of claim 10, wherein the at least one processor is further caused to carry out actions, comprising:
detecting whether the sound signal contains a valid sound signal; and
conducting a smooth-filter process on the sound signal when the sound signal contains the valid sound signal.

### Claim 13 (depends on 10)

The terminal device of claim 10, wherein the at least one processor carrying out the action of identifying the feature audio in the sound signal and acquiring the reminding information corresponding to the feature audio is caused to carry out actions, comprising:
determining whether the sound signal contains the feature audio according to a preset sound model; and
determining the reminding information corresponding to the feature audio according to a correspondence between feature audio and reminding information, based on a determination that the sound signal contains the feature audio.

### Claim 14 (depends on 13)

The terminal device of claim 13, wherein the at least one processor carrying out the action of determining whether the sound signal contains the feature audio according to the preset sound model is caused to carry out actions, comprising at least one of:
extracting noise information in the sound signal and determining whether the noise information matches a preset noise model;
extracting voiceprint information in the sound signal and determining whether the voiceprint information matches a sample voiceprint information; and
extracting sensitive information in the sound signal, determining whether the sensitive information matches a preset keyword.

### Claim 15 (depends on 10)

The terminal device of claim 10, wherein the at least one processor carrying out the action of inquiring of the user whether recorded sound signal is critical according to the reminding information, in response to the headphone being paused is caused to carry out actions, comprising one of:
inquiring of the user whether the recorded sound signal is critical according to the reminding information in response to music switching being detected, in a process of playing music through the headphone; or
inquiring of the user whether the recorded sound signal is critical according to the reminding information in response to a music pause instruction being received, in the process of playing music through the headphone.

### Claim 16 (depends on 10)

The terminal device of claim 10, wherein the at least one processor carrying out the action of detecting the input operation of the user and processing the sound signal according to the input operation is caused to carry out actions, comprising:
receiving the input operation of the user on the headphone and determining whether to play the sound signal according to the input operation; and
playing the sound signal based on a determination that the sound signal is to be played; or
deleting a stored audio file corresponding to the sound signal based on a determination that the sound signal is not to be played.

### Claim 17 (depends on 16)

The terminal device of claim 16, wherein the at least one processor carrying out the action of playing the sound signal is caused to carry out actions, comprising:
acquiring, via the headphone, at least one of geographic location information and time information of the sound signal; and
generating a target audio file according to the sound signal and the at least one of geographic location information and time information of the sound signal, and playing the target audio file.

### Claim 18

A non-transitory computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to carry out actions, comprising:
recording a sound signal of external environment when a headphone is in a playing state;
identifying feature audio in the sound signal and acquiring reminding information corresponding to the feature audio;
inquiring of a user whether recorded sound signal is critical according to the reminding information, in response to the headphone being paused; and
detecting an input operation of the user and processing the sound signal according to the input operation of the user.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the computer program which, when executed by a processor, further causes the processor to carry out actions, comprising:
detecting whether the sound signal contains a valid sound signal; and
conducting a smooth-filter process on the sound signal when the sound signal contains the valid sound signal.

### Claim 20 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the computer program which, when executed by a processor, causing the processor to carry out actions of identifying the feature audio in the sound signal and acquiring the reminding information corresponding to the feature audio comprising further causes the processor to carry out actions, comprising:
determining whether the sound signal contains the feature audio according to a preset sound model; and
determining the reminding information corresponding to the feature audio according to a correspondence between feature audio and reminding information, based on a determination that the sound signal contains the feature audio.
