# US 10,769,385 B2 · System and method for inferring user intent from speech inputs > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,769,385 B2 - Document ID: US10769385B2 - Status: Granted - Kind: B2 - Application number: 16/204,467 - Filed: 2018-11-29 - Published: 2019-06-13 - Granted: 2020-09-08 - Earliest claimed: 2013-06-09 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Gunnar Evermann - Web page: https://patentgrep.com/patent/US10769385B2 ## CPC - G06F 40/35: Discourse or dialogue representation - G10L 15/1822: {Parsing for meaning understanding} - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A text string with a first and a second portion is provided. A domain of the text string is determined by applying a first word-matching process to the first portion of the text string. It is then determined whether the second portion of the text string matches a word of a set of words associated with the domain by applying a second word-matching process to the second portion of the text string. Upon determining that the second portion of the text string matches the word of the set of words, it is determined whether a user intent from the text string based at least in part on the domain and the word of the set of words. ## Claims ### Claim 1 A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with one or more processors and memory, cause the device to: receive audio input containing a user utterance; perform speech-to-text processing on the audio input to determine a plurality of text representations of the user utterance and a plurality of speech recognition scores for the plurality of text representations; perform natural language processing on each of the plurality of text representations to determine a plurality of candidate user intents and a plurality of intent deduction scores for the plurality of candidate user intents; determine a plurality of composite scores for the plurality of candidate user intents based on a combination of the plurality of speech recognition scores and the plurality of intent deduction scores; select a user intent from the plurality of candidate user intents based on the plurality of composite scores; and perform a task corresponding to the selected user intent. ### Claim 2 (depends on 1) The computer readable storage medium of claim 1, wherein each intent deduction score of the plurality of intent deduction scores is based on a number of words in a respective text representation of the plurality of text representations that correspond to a domain of a respective candidate user intent of the plurality of candidate user intents. ### Claim 3 (depends on 1) The computer readable storage medium of claim 1, wherein each intent deduction score of the plurality of intent deduction scores is based on a quality of match between words in a respective text representation of the plurality of text representations and predefined words corresponding to a domain of a respective candidate user intent of the plurality of candidate user intents. ### Claim 4 (depends on 1) The computer readable storage medium of claim 1, wherein each intent deduction score of the plurality of intent deduction scores is based on whether or not a property of a domain of a respective candidate user intent of the plurality of candidate user intents can be resolved from a respective text representation of the plurality of text representations. ### Claim 5 (depends on 1) The computer readable storage medium of claim 1, wherein each intent deduction score of the plurality of intent deduction scores is based on whether or not a natural language processor is able to identify a specific task from a respective text representation of the plurality of text representations. ### Claim 6 (depends on 1) The computer readable storage medium of claim 1, wherein the selected user intent is determined from a first text representation of the plurality of text representations, and wherein an intent deduction score for the selected user intent is a highest score among the plurality of intent deduction scores, and wherein a speech recognition score for the first text representation is not a highest score among the plurality of speech recognition scores. ### Claim 7 (depends on 1) The computer readable storage medium of claim 1, wherein the instructions further cause the device to: rank the plurality of candidate user intents according to the plurality of composite scores, wherein the selected user intent has a highest composite score of the plurality of composite scores. ### Claim 8 An electronic device, comprising: one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: receiving audio input containing a user utterance; performing speech-to-text processing on the audio input to determine a plurality of text representations of the user utterance and a plurality of speech recognition scores for the plurality of text representations; performing natural language processing on each of the plurality of text representations to determine a plurality of candidate user intents and a plurality of intent deduction scores for the plurality of candidate user intents; determining a plurality of composite scores for the plurality of candidate user intents based on a combination of the plurality of speech recognition scores and the plurality of intent deduction scores; selecting a user intent from the plurality of candidate user intents based on the plurality of composite scores; and performing a task corresponding to the selected user intent. ### Claim 9 (depends on 8) The device of claim 8, wherein each intent deduction score of the plurality of intent deduction scores is based on a number of words in a respective text representation of the plurality of text representations that correspond to a domain of a respective candidate user intent of the plurality of candidate user intents. ### Claim 10 (depends on 8) The device of claim 8, wherein each intent deduction score of the plurality of intent deduction scores is based on a quality of match between words in a respective text representation of the plurality of text representations and predefined words corresponding to a domain of a respective candidate user intent of the plurality of candidate user intents. ### Claim 11 (depends on 8) The device of claim 8, wherein each intent deduction score of the plurality of intent deduction scores is based on whether or not a property of a domain of a respective candidate user intent of the plurality of candidate user intents can be resolved from a respective text representation of the plurality of text representations. ### Claim 12 (depends on 8) The device of claim 8, wherein each intent deduction score of the plurality of intent deduction scores is based on whether or not a natural language processor is able to identify a specific task from a respective text representation of the plurality of text representations. ### Claim 13 (depends on 8) The device of claim 8, wherein the selected user intent is determined from a first text representation of the plurality of text representations, and wherein an intent deduction score for the selected user intent is a highest score among the plurality of intent deduction scores, and wherein a speech recognition score for the first text representation is not a highest score among the plurality of speech recognition scores. ### Claim 14 (depends on 8) The device of claim 8, wherein the one or more programs further include instructions for: ranking the plurality of candidate user intents according to the plurality of composite scores, wherein the selected user intent has a highest composite score of the plurality of composite scores. ### Claim 15 A method for inferring user intent from speech input, comprising: at an electronic device with one or more processors and memory storing one or more programs for execution by the one or more processors: receiving audio input containing a user utterance; performing speech-to-text processing on the audio input to determine a plurality of text representations of the user utterance and a plurality of speech recognition scores for the plurality text representations; performing natural language processing on each of the plurality of text representations to determine a plurality of candidate user intents and a plurality of intent deduction scores for the plurality of candidate user intents; determining a plurality of composite scores for the plurality of candidate user intents based on a combination of the plurality of speech recognition scores and the plurality of intent deduction scores; selecting a user intent from the plurality of candidate user intents based on the plurality of composite scores; and performing a task corresponding to the selected user intent. ### Claim 16 (depends on 15) The method of claim 15, wherein each intent deduction score of the plurality of intent deduction scores is based on a number of words in a respective text representation of the plurality of text representations that correspond to a domain of a respective candidate user intent of the plurality of candidate user intents. ### Claim 17 (depends on 15) The method of claim 15, wherein each intent deduction score of the plurality of intent deduction scores is based on a quality of match between words in a respective text representation of the plurality of text representations and predefined words corresponding to a domain of a respective candidate user intent of the plurality of candidate user intents. ### Claim 18 (depends on 15) The method of claim 15, wherein each intent deduction score of the plurality of intent deduction scores is based on whether or not a property of a domain of a respective candidate user intent of the plurality of candidate user intents can be resolved from a respective text representation of the plurality of text representations. ### Claim 19 (depends on 15) The method of claim 15, wherein each intent deduction score of the plurality of intent deduction scores is based on whether or not a natural language processor is able to identify a specific task from a respective text representation of the plurality of text representations. ### Claim 20 (depends on 15) The method of claim 15, wherein the selected user intent is determined from a first text representation of the plurality of text representations, and wherein an intent deduction score for the selected user intent is a highest score among the plurality of intent deduction scores, and wherein a speech recognition score for the first text representation is not a highest score among the plurality of speech recognition scores. ### Claim 21 (depends on 15) The method of claim 15, further comprising: ranking the plurality of candidate user intents according to the plurality of composite scores, wherein the selected user intent has a highest composite score of the plurality of composite scores.