US 11,887,595 B2 · User-programmable automated assistant

Abstract

Techniques described herein relate to allowing users to employ voice-based human-to-computer dialog to program automated assistants with customized routines, or “dialog routines,” that can later be invoked to accomplish task(s). In various implementations, a first free form natural language input—that identifies a command to be mapped to a task and slot(s) required to be filled with values to fulfill the task—may be received from a user. A dialog routine may be stored that includes a mapping between the command and the task, and which accepts, as input, value(s) to fill the slot(s). Subsequent free form natural language input may be received from the user to (i) invoke the dialog routine based on the mapping, and/or (ii) to identify value(s) to fill the slot(s). Data indicative of at least the value(s) may be transmitted to a remote computing device for fulfillment of the task.

Claims20

Dependent claims

A method implemented by an automated assistant executed by one or more processors, comprising:

receiving, from a user at one or more input components of a computing device, a speech input directed at the automated assistant executed by one or more of the processors;
performing speech recognition processing on the speech input to generate speech recognition output;
semantically processing the speech recognition output to identify (i) an action to be performed, and (ii) an object of the action to be performed;
matching the action to be performed and the object of the action to be performed to one or more third party tasks of a plurality of candidate third party tasks that can be invoked remotely by the automated assistant;
and
transmitting, to a remote computing device configured to fulfill one or more of the matched third party tasks, data indicative of the action and the object, wherein the transmitting causes the remote computing device to at least partially fulfill one or more of the matched third party tasks.

3 more elements

A system for implementing an automated assistant, the system comprising one or more processors and memory storing instructions that cause the one or more processors to:

receive, from a user at one or more input components of a computing device, a speech input directed at the automated assistant executed by one or more of the processors;
perform speech recognition processing on the speech input to generate speech recognition output;
semantically process the speech recognition output to identify (i) an action to be performed, and (ii) an object of the action to be performed;
match the action to be performed and the object of the action to be performed to one or more third party tasks of a plurality of candidate third party tasks that can be invoked remotely by the automated assistant;
and
transmit, to a remote computing device configured to fulfill one or more of the matched third party tasks, data indicative of the action and the object, wherein the transmitting causes the remote computing device to at least partially fulfill one or more of the matched third party tasks.

3 more elements

A non-transitory computer-readable medium for implementing an automated assistant, the medium comprising instructions that cause one or more processors to:

receive, from a user at one or more input components of a computing device, a speech input directed at the automated assistant executed by one or more of the processors;
perform speech recognition processing on the speech input to generate speech recognition output;
semantically process the speech recognition output to identify (i) an action to be performed, and (ii) an object of the action to be performed;
match the action to be performed and the object of the action to be performed to one or more third party tasks of a plurality of candidate third party tasks that can be invoked remotely by the automated assistant;
and
transmit, to a remote computing device configured to fulfill one or more of the matched third party tasks, data indicative of the action and the object, wherein the transmitting causes the remote computing device to at least partially fulfill one or more of the matched third party tasks.

3 more elements

Dependencies are inferred from the claim text.

User-programmable automated assistant

Life of this patent

User-programmable automated assistant

Life of this patent

Abstract

Claims20