# US 12,002,468 B2 · Providing pre-computed hotword models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,002,468 B2
- Document ID: US12002468B2
- Status: Granted
- Kind: B2
- Application number: 18/313,756
- Filed: 2023-05-08
- Published: 2023-08-31
- Granted: 2024-06-04
- Earliest claimed: 2014-07-25
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Matthew Sharifi
- Web page: https://patentgrep.com/patent/US12002468B2

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/063: {Training}
- G10L 15/08: Speech classification or search
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G10L 15/18: using natural language modelling
- G10L 2015/0631: {Creating reference templates; Clustering}
- G10L 2015/0638: {Interactive procedures}
- G10L 2015/088: {Word spotting}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for obtaining, for each of multiple words or sub-words, audio data corresponding to multiple users speaking the word or sub-word; training, for each of the multiple words or sub-words, a pre-computed hotword model for the word or sub-word based on the audio data for the word or sub-word; receiving a candidate hotword from a computing device; identifying one or more pre-computed hotword models that correspond to the candidate hotword; and providing the identified, pre-computed hotword models to the computing device.

## Claims

### Claim 1

A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:
receiving a candidate hotword from a user device, the candidate hotword input by a user of the user device via a graphical user interface executing on the user device;
identifying, from multiple waveforms stored on memory hardware in communication with the data processing hardware, a matching waveform associated with the candidate hotword;
based on the identified matching waveform, dynamically creating a hotword model that corresponds to the candidate hotword; and
transmitting the dynamically created hotword model to the user device.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the graphical user interface executing on the user device is configured to display a prompt requesting the user to provide the candidate hotword.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the graphical user interface executing on the user device is configured to display text corresponding to the candidate hotword.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the operations further comprise receiving a user input indication indicating that the user accepts the text corresponding to the candidate hotword displayed in the graphical user interface.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the candidate hotword comprises one word.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the candidate hotword comprises two or more words.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the candidate hotword is input by the user as a text-based input via the graphical user interface.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the user inputs the candidate hotword by speaking the candidate hotword.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the hotword model comprises a neural network.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the dynamically created hotword model is configured to detect the candidate hotword in spoken utterances.

### Claim 11

A system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware and storing instructions that when executed by the data processing hardware cause the data processing hardware to perform operations comprising:
receiving a candidate hotword from a user device, the candidate hotword input by a user of the user device via a graphical user interface executing on the user device;
identifying, from multiple waveforms stored on the memory, a matching waveform associated with the candidate hotword;
based on the identified matching waveform, dynamically creating a hotword model that corresponds to the candidate hotword; and
transmitting the dynamically created hotword model to the user device.

### Claim 12 (depends on 11)

The system of claim 11, wherein the graphical user interface executing on the user device is configured to display a prompt requesting the user to provide the candidate hotword.

### Claim 13 (depends on 11)

The system of claim 11, wherein the graphical user interface executing on the user device is configured to display text corresponding to the candidate hotword.

### Claim 14 (depends on 13)

The system of claim 13, wherein the operations further comprise receiving a user input indication indicating that the user accepts the text corresponding to the candidate hotword displayed in the graphical user interface.

### Claim 15 (depends on 11)

The system of claim 11, wherein the candidate hotword comprises one word.

### Claim 16 (depends on 11)

The system of claim 11, wherein the candidate hotword comprises two or more words.

### Claim 17 (depends on 11)

The system of claim 11, wherein the candidate hotword is input by the user as a text-based input via the graphical user interface.

### Claim 18 (depends on 11)

The system of claim 11, wherein the user inputs the candidate hotword by speaking the candidate hotword.

### Claim 19 (depends on 11)

The system of claim 11, wherein the hotword model comprises a neural network.

### Claim 20 (depends on 11)

The system of claim 11, wherein the dynamically created hotword model is configured to detect the candidate hotword in spoken utterances.
