# US 9,520,130 B2 · Providing pre-computed hotword models > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,520,130 B2 - Document ID: US9520130B2 - Status: Granted - Kind: B2 - Application number: 15/001,894 - Filed: 2016-01-20 - Published: 2016-05-19 - Granted: 2016-12-13 - Earliest claimed: 2014-07-25 - Assignees: Google Inc. - Applicants: Google Inc. - Inventors: Matthew Sharifi - Web page: https://patentgrep.com/patent/US9520130B2 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/063: {Training} - G10L 15/08: Speech classification or search - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G10L 15/18: using natural language modelling - G10L 2015/0631: {Creating reference templates; Clustering} - G10L 2015/0638: {Interactive procedures} - G10L 2015/088: {Word spotting} - G10L 2015/223: {Execution procedure of a spoken command} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for obtaining, for each of multiple words or sub-words, audio data corresponding to multiple users speaking the word or sub-word; training, for each of the multiple words or sub-words, a pre-computed hotword model for the word or sub-word based on the audio data for the word or sub-word; receiving a candidate hotword from a computing device; identifying one or more pre-computed hotword models that correspond to the candidate hotword; and providing the identified, pre-computed hotword models to the computing device. ## Claims ### Claim 1 A computer-implemented method comprising: receiving, by a computing device, a candidate hotword; in response to receiving the candidate hotword, generating a prompt that requests that a user confirm whether to designate the candidate hotword as a hotword; receiving a confirmation that the user confirms that the candidate hotword is to be designated as a hotword; and in response to receiving the confirmation that the user confirms that the candidate hotword is to be designated as a hotword, processing an utterance beginning with the candidate hotword as a voice command. ### Claim 2 (depends on 1) The method of claim 1, wherein generating a prompt that requests that a user confirm whether to designate the candidate hotword as a hotword comprises: providing a graphical user interface on a display of the computing device, wherein the graphical user interface includes a transcription of the candidate hotword and one or more graphical elements that can be selected to confirm that the candidate hotword represented by the transcription is to be designated as a hotword. ### Claim 3 (depends on 1) The method of claim 1, wherein a hotword comprises a sequence of one or more words that causes the computing device to process an utterance beginning with the hotword as a voice command. ### Claim 4 (depends on 1) The method of claim 1, wherein receiving the candidate hotword comprises receiving audio data corresponding to an utterance of the candidate hotword. ### Claim 5 (depends on 1) The method of claim 1, comprising in response to receiving the confirmation that the user confirms that the candidate hotword is to be designated as a hotword, obtaining a hotword model for the candidate hotword. ### Claim 6 (depends on 5) The method of claim 5, wherein obtaining the hotword model for the candidate hotword comprises: training one or more hotword models for the candidate hotword based on audio data. ### Claim 7 (depends on 6) The method of claim 6, wherein training one or more hotword models for the candidate hotword based on audio data comprises: obtaining audio data corresponding to multiple users speaking a word or a sub-word; identifying a subset of the audio data that corresponds to the multiple users speaking the candidate hotword; and training the one or more hotwords models using the subset of the audio data. ### Claim 8 (depends on 7) The method of claim 7, wherein identifying the subset of the audio data is based on a geographic location of the computing device. ### Claim 9 A system comprising: one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising: receiving, by a computing device, a candidate hotword; in response to receiving the candidate hotword, generating a prompt that requests that a user confirm whether to designate the candidate hotword as a hotword; receiving a confirmation that the user confirms that the candidate hotword is to be designated as a hotword; and in response to receiving the confirmation that the user confirms that the candidate hotword is to be designated as a hotword, processing an utterance beginning with the candidate hotword as a voice command. ### Claim 10 (depends on 9) The system of claim 9, wherein a hotword comprises a sequence of one or more words that causes the computing device to process an utterance beginning with the hotword as a voice command. ### Claim 11 (depends on 9) The system of claim 9, wherein receiving the candidate hotword comprises receiving audio data corresponding to an utterance of the candidate hotword. ### Claim 12 (depends on 9) The system of claim 9, the operations comprising in response to receiving the confirmation that the user confirms that the candidate hotword is to be designated as a hotword, obtaining a hotword model for the candidate hotword. ### Claim 13 (depends on 12) The system of claim 12, wherein obtaining the hotword model for the candidate hotword comprises: training one or more hotword models for the candidate hotword based on audio data. ### Claim 14 (depends on 13) The system of claim 13, wherein training one or more hotword models for the candidate hotword based on audio data comprises: obtaining audio data corresponding to multiple users speaking a word or a sub-word; identifying a subset of the audio data that corresponds to the multiple users speaking the candidate hotword; and training the one or more hotwords models using the subset of the audio data. ### Claim 15 (depends on 14) The system of claim 14, wherein identifying the subset of the audio data is based on a geographic location of the computing device. ### Claim 16 A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising: receiving, by a computing device, a candidate hotword; in response to receiving the candidate hotword, generating a prompt that requests that a user confirm whether to designate the candidate hotword as a hotword; receiving a confirmation that the user confirms that the candidate hotword is to be designated as a hotword; and in response to receiving the confirmation that the user confirms that the candidate hotword is to be designated as a hotword, processing an utterance beginning with the candidate hotword as a voice command. ### Claim 17 (depends on 16) The medium of claim 16, wherein a hotword comprises a sequence of one or more words that causes the computing device to process an utterance beginning with the hotword as a voice command. ### Claim 18 (depends on 16) The medium of claim 16, wherein receiving the candidate hotword comprises receiving audio data corresponding to an utterance of the candidate hotword. ### Claim 19 (depends on 16) The medium of claim 16, the operations comprising in response to receiving the confirmation that the user confirms that the candidate hotword is to be designated as a hotword, obtaining a hotword model for the candidate hotword. ### Claim 20 (depends on 19) The medium of claim 19, wherein obtaining the hotword model for the candidate hotword comprises: training one or more hotword models for the candidate hotword based on audio data.