Back to results
US 11,238,294 B2Granted
Enrollment with an automated assistant
AssigneeGoogle Inc.
InventorsDiego Melendo Casado, Tuan Nguyen, Jaclyn Konzelmann, Gustavo Moura, Tanya Kraljic
Life of this patent
Estimating the term…
Abstract
Techniques are described herein for dialog-based enrollment of individual users for single- and/or multi-modal recognition by an automated assistant, as well as determining how to respond to a particular user's request based on the particular user being enrolled and/or recognized. Rather than requiring operation of a graphical user interface for individual enrollment, dialog-based enrollment enables users to enroll themselves (or others) by way of a human-to-computer dialog with the automated assistant.
Claims19
A method implemented using one or more processors, comprising:
- detecting an initial connection of a computing device to one or more local area networks, wherein an automated assistant is executed at least in part on the computing device;
- and
- in response to detecting the initial connection of the computing device to one or more of the local area networks, engaging in a human-to-computer dialog enrollment routine in which one or more users are solicited to enroll with the automated assistant, wherein the human-to-computer dialog enrollment routine comprises:
- determining, based on user interface input received at a user interface of the computing device, that an initial user of the computing device has linked an account of the initial user with the automated assistant at the computing device;
- determining, based on additional user interface input received at the user interface of the computing device, whether to associate at least one additional account of at least one additional user, of the one or more users, with the automated assistant;
- processing, based on the additional user interface input to associate the at least one additional account of the at least one additional user with the automated assistant, one or more sensor signals generated by one or more hardware sensors integral with the computing device, wherein the one or more hardware sensors include at least a vision sensor to capture a current image of the at least one additional user;
- and
- enrolling, based on the one or more sensor signals, the at least one additional user with the automated assistant, wherein the enrolling includes storing an association between the at least one additional user and the automated assistant, and wherein enrolling the at least one additional user comprises:
- identifying one or more distinguishing attributes of the at least one additional user to be associated with the automated assistant, wherein one or more of the distinguishing attributes include a visual profile of the at least one additional user created based on the current image.
6 more elements
A method implemented using one or more processors, comprising:
- as part of a single dialog session during an onboarding routine of a computing device:
- engaging in a human-to-computer dialog enrollment routine in which one or more users are solicited to enroll with an automated assistant, wherein the automated assistant is executed at least in part on the computing device, and wherein the human-to-computer dialog enrollment routine comprises:
- determining, based on user interface input received at a user interface of the computing device, that an initial user of the computing device has linked an account of the initial user with the automated assistant at the computing device;
- determining, based on additional user interface input received at the user interface of the computing device, whether to associate at least one additional account of at least one additional user, of the one or more users, with the automated assistant;
- processing, based on the additional user interface input to associate the at least one additional account of the at least one additional user with the automated assistant, one or more sensor signals generated by one or more hardware sensors integral with the computing device, wherein the one or more hardware sensors include at least a vision sensor to capture a current image of the at least one additional user;
- and
- enrolling, based on the one or more sensor signals, the at least one additional user with the automated assistant, wherein the enrolling includes storing an association between the at least one additional user, and wherein enrolling the at least one additional user comprises:
- identifying one or more distinguishing attributes of the at least one additional user to be associated with the automated assistant, wherein one or more of the distinguishing attributes include a visual profile of the at least one additional user created based on the current image.
5 more elements
A system comprising one or more processors and memory storing instructions that, in response to execution of the instructions by the one or more processors, cause the one or more processors to:
- as part of a single dialog session during an onboarding routine of a computing device:
- engage in a human-to-computer dialog enrollment routine in which one or more users are solicited to enroll with an automated assistant, wherein the automated assistant is executed at least in part on the computing device, and wherein the human-to-computer dialog enrollment routine comprises:
- determine, based on user interface input received at a user interface the computing device, that an initial user of the computing device has linked an account of the initial user with the automated assistant at the computing device;
- determine, based on additional user interface input received at the user interface of the computing device, whether to associate at least one additional account of at least one additional user, of the one or more users, with the automated assistant;
- process, based on the additional user interface input to associate the at least one additional account of the at least one additional user with the automated assistant, one or more sensor signals generated by one or more hardware sensors integral with the computing device, wherein the one or more hardware sensors include at least a vision sensor to capture a current image of the at least one additional user;
- and
- enroll, based on the one or more sensor signals, the at least one additional user with the automated assistant, wherein the enrolling includes storing an association between the at least one additional user, and wherein the instructions to enroll the at least one additional user comprise instructions to:
- identify one or more distinguishing attributes of the at least one additional user to be associated with the automated assistant, wherein one or more of the distinguishing attributes include a visual profile of the at least one additional user created based on the current image.
5 more elements
Dependencies are inferred from the claim text.