# US 12,770,620 B1 · Interacting with a virtual assistant to coordinate and perform actions > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,770,620 B1 - Document ID: US12770620B1 - Status: Granted - Kind: B1 - Application number: 18/771,301 - Filed: 2024-07-12 - Granted: 2026-10-20 - Earliest claimed: 2019-09-05 - Assignees: Amazon Technologies, Inc. - Applicants: Amazon Technologies, Inc. - Inventors: Gary Zhong; Jonathan Alan Leblang; Aakarsh Nair; Collin Charles Davis - Web page: https://patentgrep.com/patent/US12770620B1 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06N 5/04: Inference or reasoning models - G06N 20/00: Machine learning - G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning} - G10L 2015/223: {Execution procedure of a spoken command} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Technologies are disclosed for interacting with a virtual assistant to coordinate, recommend and perform actions. According to some examples, a user may use their voice to interact with a virtual assistant to receive recommendations relating to determining when to perform one or more actions. For example, a user may interact with a virtual assistant to request a recommendation as to when they should leave for the office, leave the office for the day, perform a task, and the like. The recommendation system accesses selected data sources (e.g., calendars, task lists, traffic, transportation schedules, maps, . . . ) to obtain data used in generating the recommendation. In addition, to providing a recommended time, the virtual assistant may also recommend actions to perform. The virtual assistant may also provide notifications to one or more other users that includes information relating to the user leaving. ## Claims ### Claim 1 A method comprising: accessing calendar data associated with a user, the calendar data indicating one or more times during which the user is available to travel to a destination; accessing traffic data indicating traffic between a current location of the user and the destination; determining, based at least in part on the calendar data and the traffic data, a recommended time to begin travel to the destination; and outputting the recommended time to begin travel to the destination. ### Claim 2 (depends on 1) The method as recited in claim 1, further comprising: accessing updated traffic data indicating traffic between the current location of the user and the destination; determining, based at least in part on the calendar data and the updated traffic data, an updated recommended time to begin travel to the destination; and outputting the updated recommended time. ### Claim 3 (depends on 1) The method as recited in claim 1, wherein the user comprises a first user, and further comprising sending notification data to an electronic device associated with a second user, the notification data indicating that the first user has begun travel to the destination. ### Claim 4 (depends on 1) The method as recited in claim 1, wherein the user comprises a first user, and further comprising sending notification data to an electronic device associated with a second user, the notification data indicating an expected arrival time of the first user at the destination. ### Claim 5 (depends on 1) The method as recited in claim 1, wherein the user comprises a first user, and further comprising: sending first notification data to an electronic device associated with a second user, the first notification data indicating an expected arrival time of the first user at the destination; determining a delay associated with the first user traveling to the destination; and sending second notification data to an electronic device associated with a second user, the second notification data indicating an updated expected arrival time of the first user at the destination. ### Claim 6 (depends on 1) The method as recited in claim 1, further comprising accessing weather data indicating weather in a geographical area proximate at least one of the current location of the user or the destination, and wherein the determining comprises determining, based at least in part on the calendar data, the traffic data, and the weather data, the recommend time to begin travel to the destination. ### Claim 7 (depends on 1) The method as recited in claim 1, further comprising receiving, from an electronic device associated with the user, request data indicating a request regarding when to begin travel to the destination, and wherein the determining comprises determining the recommended time to begin travel to the destination responsive to receiving the request data. ### Claim 8 (depends on 1) The method as recited in claim 1, further comprising receiving, from an electronic device associated with the user, selection data indicating data sources to be accessed for determining the recommended time to begin travel to the destination, and wherein the selection data indicates selection, by the user, of the calendar data and the traffic data. ### Claim 9 A system comprising: one or more processors; and one or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising: accessing calendar data associated with a user, the calendar data indicating one or more times during which the user is available to travel to a destination; accessing traffic data indicating traffic between a current location of the user and the destination; determining, based at least in part on the calendar data and the traffic data, a recommended time to begin travel to the destination; and outputting the recommended time to begin travel to the destination. ### Claim 10 (depends on 9) The system as recited in claim 9, the acts further comprising: accessing updated traffic data indicating traffic between the current location of the user and the destination; determining, based at least in part on the calendar data and the updated traffic data, an updated recommended time to begin travel to the destination; and outputting the updated recommended time. ### Claim 11 (depends on 9) The system as recited in claim 9, wherein the user comprises a first user, and the acts further comprising sending notification data to an electronic device associated with a second user, the notification data indicating that the first user has begun travel to the destination. ### Claim 12 (depends on 9) The system as recited in claim 9, wherein the user comprises a first user, and the acts further comprising sending notification data to an electronic device associated with a second user, the notification data indicating an expected arrival time of the first user at the destination. ### Claim 13 (depends on 9) The system as recited in claim 9, wherein the user comprises a first user, and the acts further comprising: sending first notification data to an electronic device associated with a second user, the first notification data indicating an expected arrival time of the first user at the destination; determining a delay associated with the first user traveling to the destination; and sending second notification data to an electronic device associated with a second user, the second notification data indicating an updated expected arrival time of the first user at the destination. ### Claim 14 (depends on 9) The system as recited in claim 9, the acts further comprising accessing weather data indicating weather in a geographical area proximate at least one of the current location of the user or the destination, and wherein the determining comprises determining, based at least in part on the calendar data, the traffic data, and the weather data, the recommend time to begin travel to the destination. ### Claim 15 (depends on 9) The system as recited in claim 9, the acts further comprising receiving, from an electronic device associated with the user, request data indicating a request regarding when to begin travel to the destination, and wherein the determining comprises determining the recommended time to begin travel to the destination responsive to receiving the request data. ### Claim 16 (depends on 9) The system as recited in claim 9, the acts further comprising receiving, from an electronic device associated with the user, selection data indicating data sources to be accessed for determining the recommended time to begin travel to the destination, and wherein the selection data indicates selection, by the user, of the calendar data and the traffic data. ### Claim 17 One or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising: accessing calendar data associated with a user, the calendar data indicating one or more times during which the user is available to travel to a destination; accessing traffic data indicating traffic between a current location of the user and the destination; determining, based at least in part on the calendar data and the traffic data, a recommended time to begin travel to the destination; and outputting the recommended time to begin travel to the destination. ### Claim 18 (depends on 17) The one or more non-transitory computer-readable media as recited in claim 17, the acts further comprising: accessing updated traffic data indicating traffic between the current location of the user and the destination; determining, based at least in part on the calendar data and the updated traffic data, an updated recommended time to begin travel to the destination; and outputting the updated recommended time. ### Claim 19 (depends on 17) The one or more non-transitory computer-readable media as recited in claim 17, wherein the user comprises a first user, and the acts further comprising sending notification data to an electronic device associated with a second user, the notification data indicating that the first user has begun travel to the destination. ### Claim 20 (depends on 17) The one or more non-transitory computer-readable media as recited in claim 17, wherein the user comprises a first user, and the acts further comprising sending notification data to an electronic device associated with a second user, the notification data indicating an expected arrival time of the first user at the destination.