# US 2025/0095640 A1 · Improving detection of voice-based keywords using falsely rejected data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095640 A1
- Document ID: US20250095640A1
- Status: Published application
- Kind: A1
- Application number: 18/292,297
- Filed: 2021-09-26
- Published: 2025-03-20
- Earliest claimed: 2021-09-26
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Jun WEI; Xiaoxia DONG; Qimeng PAN
- Web page: https://patentgrep.com/patent/US20250095640A1

## CPC

- G10L 15/07: to the speaker
- G10L 15/063: {Training}
- G10L 15/083: {Recognition networks (G10L15/142, G10L15/16 take precedence)}
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 2015/0635: {updating or merging of old and new templates; Mean values; Weighting}
- G10L 2015/088: {Word spotting}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Techniques described herein are directed to improving a user keyword detection model using user audio samples that have been falsely rejected. In some embodiments, user equipment (UE) may detect multiple attempts by a user at uttering a keyword. A true keyword that matches keyword models implemented by the UE may activate a desired function, such as initiating an assistant application, initiating a specific application, waking up from a lower power state, transitioning to a lower power state, toggling a power-saving mode, unlocking or locking the device, etc. Any true keywords uttered prior to detection of the true keyword but which have been falsely rejected may be sent to a server to train the keyword model and generate an updated keyword model. The updated keyword model may be received by the UE to replace the keyword model being used, allowing the UE to continually improve keyword detection accuracy.

## Claims

### Claim 1

A method of updating a user audio detection model on a user equipment, the method comprising:
implementing the user audio detection model, the user audio detection model configured to change an operational state of the user equipment based on true keyword samples detected;
detecting audio from a user;
detecting, using the user audio detection model, presence of a true keyword sample in the audio from the user;
responsive to the detecting of the audio from the user, obtaining a plurality of user audio data preceding the true keyword sample, the plurality of user audio data comprising one or more falsely rejected true keyword samples, the one or more falsely rejected true keyword samples being insufficient to change the operational state of the user equipment;
transmitting at least a portion of the one or more falsely rejected true keyword samples to a networked entity, or accessing the at least portion of the one or more falsely rejected true keyword samples locally at the user equipment, the at least portion of the one or more falsely rejected true keyword samples configured to be used in generation of an updated user audio detection model; and
receiving the updated user audio detection model from the networked entity, or locally generating the updated user audio detection model using the at least portion of the one or more falsely rejected true keyword samples.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the plurality of user audio data further comprises one or more false keyword samples; and
the method further comprises separating the one or more falsely rejected true keyword samples from the one or more false keyword samples prior to the transmitting of the at least portion of the one or more falsely rejected true keyword samples to the networked entity.

### Claim 3 (depends on 2)

The method of claim 2, further comprising discarding the one or more false keyword samples.

### Claim 4 (depends on 1)

The method of claim 1, further comprising transmitting the user audio detection model to the networked entity prior to the transmitting of the at least portion of the one or more falsely rejected true keyword samples to the networked entity, the networked entity comprising a server apparatus.

### Claim 5 (depends on 1)

The method of claim 1, further comprising determining a presence of the one or more falsely rejected keyword true samples in the plurality of user audio data based on a first similarity threshold associated with the user audio detection model being met or exceeded but not meeting or exceeding a second similarity threshold.

### Claim 6 (depends on 1)

The method of claim 1, further comprising determining a presence of the one or more falsely rejected keyword true samples in the plurality of user audio data based on another user audio detection model, the another user audio detection model comprising at least a different detection criterion from the user audio detection model.

### Claim 7 (depends on 1)

The method of claim 1, further comprising replacing the user audio detection model with the received updated user audio detection model.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
detecting one or more second falsely rejected true samples subsequent to the receiving of the updated user audio detection model;
transmitting at least a portion of the one or more second falsely rejected true samples to the networked entity, the at least portion of the one or more second falsely rejected true samples configured to be used in generation of a second updated user audio detection model;
receiving the second updated user audio detection model from the networked entity; and
replacing the updated user audio detection model with the second updated user audio detection model.

### Claim 9 (depends on 1)

The method of claim 1, further comprising detecting one or more subsequent true samples, and transmitting at least a portion of the one or more subsequent true samples to the networked entity, the at least portion of the one or more subsequent true samples configured to be used in the generation of the updated user audio detection model.

### Claim 10 (depends on 1)

The method of claim 1, further comprising training the user audio detection model based on one or more true keyword samples, wherein the one or more true keyword samples and the plurality of user audio data comprise audio data associated with voice of the user.

### Claim 11 (depends on 1)

The method of claim 1, further comprising maintaining an audio buffer, and temporarily storing the audio from the user in the audio buffer for a prescribed length, the audio buffer comprising the true keyword sample and the one or more falsely rejected true keyword samples.

### Claim 12

User equipment capable of improving a user audio detection model, the user equipment comprising:
a memory; and
a processor, coupled to the memory, and operably configured to:
implement the user audio detection model, the user audio detection model configured to change an operational state of the user equipment based on true keyword samples detected;
detect audio from a user;
detect, using the user audio detection model, presence of a true keyword sample in the audio from the user;
responsive to the detecting of the audio from the user, obtain a plurality of user audio data preceding the true keyword sample, the plurality of user audio data comprising one or more falsely rejected true keyword samples, the one or more falsely rejected true keyword samples being insufficient to change the operational state of the user equipment;
transmit at least a portion of the one or more falsely rejected true keyword samples to a networked entity, or access the at least portion of the one or more falsely rejected true keyword samples locally at the user equipment, the at least portion of the one or more falsely rejected true keyword samples configured to be used in generation of an updated user audio detection model; and
receive the updated user audio detection model from the networked entity, or locally generate the updated user audio detection model using the at least portion of the one or more falsely rejected true keyword samples.

### Claim 13 (depends on 12)

The user equipment of claim 12, wherein:
the plurality of user audio data further comprises one or more false keyword samples; and
the processor is further configured to separate the one or more falsely rejected true keyword samples from the one or more false keyword samples prior to the transmitting of the at least portion of the one or more falsely rejected true keyword samples to the networked entity.

### Claim 14 (depends on 13)

The user equipment of claim 13, wherein the processor is further configured to discard the one or more false keyword samples.

### Claim 15 (depends on 12)

The user equipment of claim 12, wherein the processor is further configured to transmit the user audio detection model to the networked entity prior to the transmitting of the at least portion of the one or more falsely rejected true keyword samples to the networked entity, the networked entity comprising a server apparatus.

### Claim 16 (depends on 12)

The user equipment of claim 12, wherein the processor is further configured to determine a presence of the one or more falsely rejected true keyword samples in the plurality of user audio data based on a first similarity threshold associated with the user audio detection model being met or exceeded but not meeting or exceeding a second similarity threshold.

### Claim 17 (depends on 12)

The user equipment of claim 12, wherein the processor is further configured to determine a presence of the one or more falsely rejected true keyword samples in the plurality of user audio data based on another user audio detection model, the another user audio detection model comprising at least a different detection criterion from the user audio detection model.

### Claim 18 (depends on 12)

The user equipment of claim 12, wherein the processor is further configured to replace the user audio detection model with the received updated user audio detection model.

### Claim 19 (depends on 12)

The user equipment of claim 12, wherein the processor is further configured to detect one or more subsequent true samples, and transmit at least a portion of the one or more subsequent true samples to the networked entity, the at least portion of the one or more subsequent true samples configured to be used in the generation of the updated user audio detection model.

### Claim 20 (depends on 12)

The user equipment of claim 12, wherein the processor is further configured to train the user audio detection model based on one or more true keyword samples, wherein the one or more true keyword samples and the plurality of user audio data comprise audio data associated with voice of the user.

### Claim 21 (depends on 12)

The user equipment of claim 12, wherein the processor is further configured to maintain an audio buffer, and temporarily store the audio from the user in the audio buffer for a prescribed length, the audio buffer comprising the true keyword sample and the one or more falsely rejected true keyword samples.

### Claim 22

A non-transitory computer-readable apparatus comprising a storage medium, the storage medium comprising a plurality of instructions configured to, when executed by one or more processors, cause user equipment to:
implement a user audio detection model, the user audio detection model configured to change an operational state of the user equipment based on true keyword samples detected;
detect audio from a user;
detect, using the user audio detection model, presence of a true keyword sample in the audio from the user;
responsive to the detecting of the audio from the user, obtain a plurality of user audio data preceding the true keyword sample, the plurality of user audio data comprising one or more falsely rejected true keyword samples, the one or more falsely rejected true keyword samples being insufficient to change the operational state of the user equipment;
transmit at least a portion of the one or more falsely rejected true keyword samples to a networked entity, or access the at least portion of the one or more falsely rejected true keyword samples locally at the user equipment, the at least portion of the one or more falsely rejected true keyword samples configured to be used in generation of an updated user audio detection model; and
receive the updated user audio detection model from the networked entity, or locally generate the updated user audio detection model using the at least portion of the one or more falsely rejected true keyword samples.

### Claim 23 (depends on 22)

The non-transitory computer-readable apparatus of claim 22, wherein the plurality of instructions are further configured to, when executed by the one or more processors, cause the user equipment to maintain an audio buffer, and temporarily store audio data associated with voice of the user in the audio buffer for a prescribed length, the audio buffer comprising the true keyword sample and the one or more falsely rejected true keyword samples.

### Claim 24 (depends on 22)

The non-transitory computer-readable apparatus of claim 22, wherein:
the plurality of user audio data further comprises one or more false keyword samples; and
the plurality of instructions are further configured to, when executed by the one or more processors, cause the user equipment to separate the one or more falsely rejected true keyword samples from the one or more false keyword samples prior to the transmitting of the at least portion of the one or more falsely rejected true keyword samples to the networked entity.

### Claim 25 (depends on 22)

The non-transitory computer-readable apparatus of claim 22, wherein the plurality of instructions are further configured to, when executed by the processor apparatus, cause the user equipment to determine a presence of the one or more falsely rejected true keyword samples in the plurality of user audio data based on a first similarity threshold associated with the user audio detection model being met or exceeded but not meeting or exceeding a second similarity threshold.

### Claim 26 (depends on 22)

The non-transitory computer-readable apparatus of claim 22, wherein the plurality of instructions are further configured to, when executed by the processor apparatus, cause the user equipment to replace the user audio detection model with the received updated user audio detection model.

### Claim 27

User equipment comprising:
means for implementing a user audio detection model, the user audio detection model configured to change an operational state of the user equipment based on true keyword samples detected;
means for detecting audio from a user;
means for detecting, using the user audio detection model, presence of a true keyword sample in the audio from the user;
means for, responsive to the detecting of the audio from the user, obtaining a plurality of user audio data preceding the true keyword sample, the plurality of user audio data comprising one or more falsely rejected true keyword samples, the one or more falsely rejected true keyword samples being insufficient to change the operational state of the user equipment;
means for transmitting at least a portion of the one or more falsely rejected true keyword samples to a networked entity, or accessing the at least portion of the one or more falsely rejected true keyword samples locally at the user equipment, the at least portion of the one or more falsely rejected true keyword samples configured to be used in generation of an updated user audio detection model; and
means for receiving the updated user audio detection model from the networked entity, or locally generating the updated user audio detection model using the at least portion of the one or more falsely rejected true keyword samples.

### Claim 28 (depends on 27)

The user equipment of claim 27, wherein:
the plurality of user audio data further comprises one or more false keyword samples; and
the user equipment further comprises means for separating the one or more falsely rejected true keyword samples from the one or more false keyword samples prior to the transmitting of the at least portion of the one or more falsely rejected true keyword samples to the networked entity.

### Claim 29 (depends on 27)

The user equipment of claim 27, further comprising means for determining a presence of the one or more falsely rejected keyword true samples in the plurality of user audio data based on a first similarity threshold associated with the user audio detection model being met or exceeded but not meeting or exceeding a second similarity threshold.

### Claim 30 (depends on 27)

The user equipment of claim 27, wherein:
the one or more true keyword samples and the plurality of user audio data comprise audio data associated with voice of the user; and
the user equipment further comprises means for maintaining an audio buffer, and temporarily storing the audio data associated with voice of the user in the audio buffer for a prescribed length, the audio buffer comprising the true keyword sample and the one or more falsely rejected true keyword samples.
