# US 2024/0177707 A1 · Wake-up processing method and device, voice apparatus, and computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177707 A1
- Document ID: US20240177707A1
- Status: Published application
- Kind: A1
- Application number: 18/431,630
- Filed: 2024-02-02
- Published: 2024-05-30
- Earliest claimed: 2021-08-06
- Assignees: Foshan Shunde Midea Electric Science and Technology Co., Ltd.; Gd Midea Air-Conditioning Equipment Co., Ltd.
- Applicants: Foshan Shunde Midea Electric Science and Technology Co., Ltd.; Gd Midea Air-Conditioning Equipment Co., Ltd.
- Inventors: Baiyang CHEN; Yirong CHEN; Weiming HUO
- Web page: https://patentgrep.com/patent/US20240177707A1

## CPC

- G10L 15/08: Speech classification or search
- G10L 15/063: {Training}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 25/30: using neural networks
- G10L 2015/088: {Word spotting}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Provided are a wake-up processing method and device, a voice apparatus, and a computer-readable storage medium. The method includes: obtaining to-be-recognized audio; processing the to-be-recognized audio using a wake-up model and at least two groups of training data separately, to obtain at least two confidence levels and respective confidence level thresholds corresponding to the at least two confidence levels, the at least two groups of training data being obtained by separately with training at least two groups of wake-up word training sets using the wake-up model; and triggering a wake-up event of the voice apparatus based on a comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels.

## Claims

### Claim 1

A wake-up processing method, applicable in a voice apparatus, the method comprising:
obtaining to-be-recognized audio;
processing the to-be-recognized audio using a wake-up model and at least two groups of training data separately, to obtain at least two confidence levels and respective confidence level thresholds corresponding to the at least two confidence levels, wherein the at least two groups of training data are obtained by separately training with at least two groups of wake-up word training sets using the wake-up model; and
triggering a wake-up event of the voice apparatus based on a comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels.

### Claim 2 (depends on 1)

The method according to claim 1, wherein said obtaining the to-be-recognized audio comprises:
performing a data collection through a sound collection device to obtain initial voice data; and
pre-processing the initial voice data to obtain the to-be-recognized audio.

### Claim 3 (depends on 1)

The method according to claim 1, wherein:
each of the at least two groups of training data comprises a model parameter and a confidence level threshold; and
said processing the to-be-recognized audio using the wake-up model and the at least two groups of training data separately, to obtain the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels comprises:
processing the to-be-recognized audio using the wake-up model and the model parameters in the at least two groups of training data separately to obtain the at least two confidence levels, and obtaining the respective confidence level thresholds corresponding to the at least two confidence levels from the at least two groups of training data.

### Claim 4 (depends on 1)

The method according to claim 1, wherein:
the at least two groups of training data comprise a first group of training data and a second group of training data, the first group of training data comprising a first model parameter and a first confidence level threshold, and the second group of training data comprising a second model parameter and a second confidence level threshold; and
said processing the to-be-recognized audio using the wake-up model and the at least two groups of training data separately, to obtain the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels comprises:
processing the to-be-recognized audio using the wake-up model and the first model parameter in the first group of training data to obtain a first confidence level, and determining the first confidence level threshold corresponding to the first confidence level from the first group of training data; and
processing the to-be-recognized audio using the wake-up model and the second model parameter in the second group of training data to obtain a second confidence level, and determining the second confidence level threshold corresponding to the second confidence level from the second group of training data.

### Claim 5 (depends on 4)

The method according to claim 4, wherein said triggering the wake-up event of the voice apparatus based on the comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels comprises:
triggering the wake-up event of the voice apparatus when the first confidence level is greater than or equal to the first confidence level threshold or the second confidence level is greater than or equal to the second confidence level threshold.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the wake-up event comprises a first wake-up event and/or a second wake-up event, the first wake-up event having an association relation with a wake-up word corresponding to the first group of training data, and the second wake-up event having an association relation with a wake-up word corresponding to the second group of training data.

### Claim 7 (depends on 6)

The method according to claim 6, wherein said triggering the wake-up event of the voice apparatus based on the comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels comprises:
triggering the first wake-up event of the voice apparatus when the first confidence level is greater than or equal to the first confidence level threshold and the second confidence level is smaller than the second confidence level threshold.

### Claim 8 (depends on 6)

The method according to claim 6, wherein said triggering the wake-up event of the voice apparatus based on the comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels comprises:
triggering the second wake-up event of the voice apparatus when the second confidence level is greater than or equal to the second confidence level threshold and the first confidence level is smaller than the first confidence level threshold.

### Claim 9 (depends on 6)

The method according to claim 6, wherein said triggering the wake-up event of the voice apparatus based on the comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels comprises:
calculating, when the first confidence level is greater than or equal to the first confidence level threshold and the second confidence level is greater than or equal to the second confidence level threshold, a first value by which the first confidence level exceeds the first confidence level threshold and a second value by which the second confidence level exceeds the second confidence level threshold, and triggering a target wake-up event of the voice apparatus based on the first value and the second value.

### Claim 10 (depends on 7)

The method according to claim 7, wherein said triggering the target wake-up event of the voice apparatus based on the first value and the second value comprises:
when the first value is greater than or equal to the second value, determining the target wake-up event as the first wake-up event and triggering the first wake-up event.

### Claim 11 (depends on 7)

The method according to claim 7, wherein said triggering the target wake-up event of the voice apparatus based on the first value and the second value comprises:
when the first value is smaller than the second value, determining the target wake-up event as the second wake-up event and triggering the second wake-up event.

### Claim 12 (depends on 8)

The method according to claim 8, wherein said triggering the target wake-up event of the voice apparatus based on the first value and the second value comprises:
when the first value is greater than or equal to the second value, determining the target wake-up event as the first wake-up event and triggering the first wake-up event.

### Claim 13 (depends on 8)

The method according to claim 8, wherein said triggering the target wake-up event of the voice apparatus based on the first value and the second value comprises:
when the first value is smaller than the second value, determining the target wake-up event as the second wake-up event and triggering the second wake-up event.

### Claim 14 (depends on 8)

The method according to claim 8, wherein said triggering the target wake-up event of the voice apparatus based on the first value and the second value comprises:
when the first value is greater than or equal to the second value, determining the target wake-up event as the first wake-up event and triggering the first wake-up event.

### Claim 15 (depends on 8)

The method according to claim 8, wherein said triggering the target wake-up event of the voice apparatus based on the first value and the second value comprises:
when the first value is smaller than the second value, determining the target wake-up event as the second wake-up event and triggering the second wake-up event.

### Claim 16 (depends on 1)

The method according to claim 1, further comprising:
obtaining the at least two groups of wake-up word training sets; and
training the wake-up model using the at least two groups of wake-up word training sets, to obtain the at least two groups of training data, wherein each of the at least two groups of training data comprises a model parameter and a confidence level threshold.

### Claim 17 (depends on 16)

The method according to claim 16, wherein said obtaining the at least two groups of wake-up word training sets comprises:
obtaining an initial training set, wherein the initial training set comprises at least two wake-up words; and
grouping the initial training set based on different wake-up words to obtain the at least two groups of wake-up word training sets.

### Claim 18

A wake-up processing device, applicable in a voice apparatus, the device comprising one or more processors, wherein the one or more processors are configured to:
obtain to-be-recognized audio;
process the to-be-recognized audio using a wake-up model and at least two groups of training data separately, to obtain at least two confidence levels and respective confidence level thresholds corresponding to the at least two confidence levels, wherein the at least two groups of training data are obtained by separately with training at least two groups of wake-up word training sets using the wake-up model; and
trigger a wake-up event of the voice apparatus based on a comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels.

### Claim 19

A voice apparatus comprising a memory and one or more processors, wherein:
the memory is configured to store one or more computer programs executable by the processor; and
the one or more processors are configured to perform, when executing the one or more computer programs, a wake-up processing method applicable in a voice apparatus, the method comprising:
obtaining to-be-recognized audio;
processing the to-be-recognized audio using a wake-up model and at least two groups of training data separately, to obtain at least two confidence levels and respective confidence level thresholds corresponding to the at least two confidence levels, wherein the at least two groups of training data are obtained by separately training with at least two groups of wake-up word training sets using the wake-up model; and
triggering a wake-up event of the voice apparatus based on a comparison result between the at least two confidence levels and the respective confidence level thresholds corresponding to the at least two confidence levels.

### Claim 20 (depends on 1)

A computer-readable storage medium, having one or more computer programs stored thereon, wherein the one or more computer programs, when executed by at least one processor, cause the one or more processors to implement the method according to claim 1.
