# US 2018/0322380 A1 · Virtual assistant configured to recommended actions in furtherance of an existing conversation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322380 A1
- Document ID: US20180322380A1
- Status: Published application
- Kind: A1
- Application number: 15/588,055
- Filed: 2017-05-05
- Published: 2018-11-08
- Earliest claimed: 2017-05-05
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Vikram Aggarwal
- Web page: https://patentgrep.com/patent/US20180322380A1

## CPC

- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06Q 10/10: Office automation; Time management
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A system is described that determines, based on information associated with a user of a computing device, an event for initiating an interaction between the user and an assistant executing at the computing device. The system selects, based on the event and from a plurality of actions performed by the assistant, at least one action associated with the event. The system determines, based on the at least one action, whether to output a notification of the event which includes an indication of the event and a request to perform the at least one action associated with the event. Responsive to determining to output the notification of the event, the system sends, to the assistant, the notification of the event for output during the interaction between the user and the assistant

## Claims

### Claim 1

A method comprising:
determining, based on information associated with a user of a computing device, an event for initiating an interaction between the user and an assistant executing at the computing device, wherein the assistant is configured to perform a plurality of actions;
selecting, based on the event and from the plurality of actions, at least one action associated with the event;
determining, based on the at least one action, whether to output a notification of the event, wherein the notification includes an indication of the event and a request to perform the at least one action associated with the event; and
responsive to determining to output the notification of the event, sending, to the assistant, the notification of the event for output during the interaction between the user and the assistant.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
scoring, based on the event, each of the plurality of actions; and
selecting, the at least one action with a respective scoring that satisfies a threshold.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining whether to output the notification of the event includes determining whether to output the notification of the event based at least in part on how recently a previous interaction occurred between the user and the assistant.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining whether to output the notification of the event includes:
determining a degree of likelihood that the user will accept the request to perform the at least one action associated with the event; and
determining whether to output the notification of the event based at least in part on the degree of likelihood that the user will accept the request to perform the at least one action associated with the event.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
determining a severity level of the event; and
determining whether to output the notification of the event based further on the severity level of the event.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining whether to output the notification of the event includes determining whether to output the notification of the event based at least in part on a combination of how recently a previous interaction occurred between the user and the assistant and a frequency of previous interactions between the user and the assistant.

### Claim 7 (depends on 1)

The method of claim 1, wherein the at least one action associated with the event is associated with an application configured to perform the at least one action, the application being different than the assistant.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one action is a single action.

### Claim 9 (depends on 1)

The method of claim 1, wherein the at least one action includes multiple actions.

### Claim 10

A computing device comprising:
an output device;
at least one processor; and
at least one memory comprising instructions that when executed, cause the at least one processor to execute an assistant configured to:
determine, based on information associated with a user of the computing device, an event for initiating an interaction between the user and the assistant, wherein the assistant is configured to perform a plurality of actions;
select, based on the event and from the plurality of actions, at least one action associated with the event;
determine, based on the at least one action, whether to output a notification of the event wherein the notification includes an indication of the event and a request to perform the at least one action associated with the event; and
responsive to determining to output the notification of the event, output, via the output device, the notification of the event during the interaction between the user and the assistant.

### Claim 11 (depends on 10)

The computing device of claim 10, further comprising an input device, wherein the assistant is further configured to:
receive, via the input device, user input commanding the assistant to perform the at least one action;
response to receiving the user input, perform the at least one action.

### Claim 12 (depends on 10)

The computing device of claim 10, wherein the assistant is further configured to perform the at least one action by invoking an application executing at the at least one processor that is configured to perform the at least one action, the application being different than the assistant.

### Claim 13 (depends on 10)

The computing device of claim 10, wherein the at least one action includes multiple actions.

### Claim 14 (depends on 13)

The computing device of claim 13, further comprising an input device, wherein the assistant is further configured to:
receive, via the input device, user input commanding the assistant to perform a particular action from the multiple actions; and
response to receiving the user input, perform the particular action.

### Claim 15 (depends on 10)

The computing device of claim 10, wherein the assistant is further configured to receive the event from a remote computing system that is configured to determine the event for initiating an interaction between the user and the assistant.

### Claim 16 (depends on 10)

The computing device of claim 10, wherein the output device is configured to output audio and the notification is a voice notification.

### Claim 17 (depends on 10)

The computing device of claim 10, wherein the assistant is further configured to:
output the notification of the event to initiate the interaction; and
after outputting the notification of the event, receive, via the input device, user input commanding the assistant to perform the at least one action; and
response to receiving the user input, perform the at least one action.

### Claim 18

A computer-readable storage medium comprising instructions that, when executed cause at least one processor of a digital assistant system to:
determine, based on information associated with a user of a computing device, an event for initiating an interaction between the user and an assistant executing at the computing device, wherein the assistant is configured to perform a plurality of actions;
select, based on the event and from the plurality of actions, at least one action associated with the event;
determine, based on the at least one action, whether to output a notification of the event, wherein the notification includes an indication of the event and a request to perform the at least one action associated with the event; and
responsive to determining to output the notification of the event, send, to the assistant, the notification of the event for output during the interaction between the user and the assistant.

### Claim 19 (depends on 17)

The computer-readable storage medium of claim 17, wherein the instructions, when executed by the at least one processor, cause the digital assistant system to determine whether to output the notification of the event by at least determining whether to output the notification of the event based at least in part on how recently a previous interaction occurred between the user and the assistant.

### Claim 20 (depends on 17)

The computer-readable storage medium of claim 17, wherein the at least one action is associated with a third device that is different than the computing device and the digital assistant system.
