US 11,238,862 B2 · User-programmable automated assistant

Abstract

Techniques described herein relate to allowing users to employ voice-based human-to-computer dialog to program automated assistants with customized routines, or “dialog routines,” that can later be invoked to accomplish task(s). In various implementations, a first free form natural language input—that identifies a command to be mapped to a task and slot(s) required to be filled with values to fulfill the task—may be received from a user. A dialog routine may be stored that includes a mapping between the command and the task, and which accepts, as input, value(s) to fill the slot(s). Subsequent free form natural language input may be received from the user to (i) invoke the dialog routine based on the mapping, and/or (ii) to identify value(s) to fill the slot(s). Data indicative of at least the value(s) may be transmitted to a remote computing device for fulfillment of the task.

Claims20

Dependent claims

A method implemented by one or more processors, comprising:

receiving, from a user at one or more input components of a computing device, one or more speech inputs directed at an automated assistant executed by one or more of the processors;
performing speech recognition processing on the one or more speech inputs to generate speech recognition output;
semantically processing the speech recognition output to identify, (i) a custom voice command, (ii) a task to be performed in response to receipt of the custom voice command by the automated assistant, and (iii) one or more slots that are required to be filled with values in order to fulfill the task;
creating and storing a custom dialog routine that includes a mapping between the custom voice command and the task, and which accepts, as input, one or more values to fill the one or more slots, wherein subsequent utterance of the custom command causes the automated assistant to engage in the custom dialog routine.

1 more element

A system comprising one or more processors and memory storing instructions that, in response to execution of the instructions by the one or more processors, cause the one or more processors to perform the following operations

receive, from a user at one or more input components of a computing device, one or more speech inputs directed at an automated assistant executed by one or more of the processors;
perform speech recognition processing on the one or more speech inputs to generate speech recognition output;
semantically process the speech recognition output to identify, wherein the (i) a custom voice command, (ii) a task to be performed in response to receipt of the custom voice command by the automated assistant, and (iii) one or more slots that are required to be filled with values in order to fulfill the task;
create and storing a custom dialog routine that includes a mapping between the custom voice command and the task, and which accepts, as input, one or more values to fill the one or more slots, wherein subsequent utterance of the custom command causes the automated assistant to engage in the custom dialog routine.

1 more element

At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to perform the following operations:

receive, from a user at one or more input components of a computing device, one or more speech inputs directed at an automated assistant executed by one or more of the processors;
perform speech recognition processing on the one or more speech inputs to generate speech recognition output;
semantically process the speech recognition output to identify, (i) a custom voice command, (ii) a task to be performed in response to receipt of the custom voice command by the automated assistant, and (iii) one or more slots that are required to be filled with values in order to fulfill the task;
create and store a custom dialog routine that includes a mapping between the custom voice command and the task, and which accepts, as input, one or more values to fill the one or more slots, wherein subsequent utterance of the custom command causes the automated assistant to engage in the custom dialog routine.

1 more element

Dependencies are inferred from the claim text.

User-programmable automated assistant

Life of this patent

User-programmable automated assistant

Life of this patent

Abstract

Claims20