# US 11,908,473 B2 · Task modification after task initiation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,908,473 B2
- Document ID: US11908473B2
- Status: Granted
- Kind: B2
- Application number: 17/949,941
- Filed: 2022-09-21
- Published: 2023-11-16
- Granted: 2024-02-20
- Earliest claimed: 2022-05-10
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Yi Ma; Arash Dawoodi; Antoine R. Raux; Humza M. Siddiqui
- Web page: https://patentgrep.com/patent/US11908473B2

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 9/453: {Help systems}
- G06Q 10/10: Office automation; Time management
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 15/08: Speech classification or search
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 2015/228: {of application context}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Systems and processes for operating an intelligent automated assistant are provided. An example process includes, at an electronic device having one or more processors and memory: performing a first task specified in a first user speech input; receiving a second user speech input; and in accordance with a determination that the second user speech input includes a modification to the first task, performing a second task, wherein performance of the second task modifies at least a portion of the performance of the first task.

## Claims

### Claim 1

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:
performing a first task specified in a first user speech input;
receiving a second user speech input; and
in accordance with a determination that the second user speech input includes an intent to undo an action performed by the first task, performing a second task, wherein performance of the second task returns an electronic device performing the first task to a state prior to performance of the first task by recreating a previously deleted object.

### Claim 2 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the second user speech input includes a predetermined word or phrase.

### Claim 3 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the second user speech input is received within a predetermined time of performing the first task.

### Claim 4 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the first task includes a reversible property.

### Claim 5 (depends on 4)

The non-transitory computer-readable storage medium of claim 4, wherein the reversible property of the first task is included in a domain associated with the first task.

### Claim 6 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein a machine learning model performs the determination of whether the second user speech input includes the intent to undo the action.

### Claim 7 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the one or more programs further include instructions for:
in accordance with a determination that the second user speech input includes a modification to the first task:
in accordance with a determination that the second user speech input includes a third task, performing the third task after performing the second task.

### Claim 8 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the one or more programs further include instructions for:
after completing the first task, providing a first audio output including a description of the first task.

### Claim 9 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the one or more programs further include instructions for:
providing a second audio output after completion of the second task.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the second audio output includes an indication that the first task was modified.

### Claim 11 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the second audio output includes an indication that a third task was performed.

### Claim 12 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the one or more programs further include instructions for:
receiving a third user speech input; and
in accordance with a determination that the third user speech input includes a modification to the second task, performing a fourth task, wherein performance of the fourth task modifies at least a portion of the performance of the second task.

### Claim 13 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the second task includes transferring data from a first application to a second application.

### Claim 14 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the second task includes changing a state of an electronic device.

### Claim 15

An electronic device, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
performing a first task specified in a first user speech input;
receiving a second user speech input; and
in accordance with a determination that the second user speech input includes an intent to undo an action performed by the first task, performing a second task, wherein performance of the second task returns an electronic device performing the first task to a state prior to performance of the first task by recreating a previously deleted object.

### Claim 16

A method, comprising:
at an electronic device with one or more processors and memory:
performing a first task specified in a first user speech input;
receiving a second user speech input; and
in accordance with a determination that the second user speech input includes an intent to undo an action performed by the first task, performing a second task, wherein performance of the second task returns an electronic device performing the first task to a state prior to performance of the first task by recreating a previously deleted object.

### Claim 17 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein recreating the previously deleted object includes:
determining whether the task of deleting the object includes a reversible property that recreates the deleted object.

### Claim 18 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, the one or more programs further including instructions for:
after performing the first task specified in the first user speech input, storing a possible task reversing the first task specified in the first user speech input; and
wherein recreating the previously deleted object includes performing the possible task reversing the first task specified in the first user speech input.

### Claim 19 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein recreating the previously deleted object includes:
determining, based on the intent to undo the action performed by the first task, that the second task is to recreate the previously deleted object; and
determining, based on a link between the first task and the second task in a related domain, a target for the second task is the previously deleted object.

### Claim 20 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, the one or more programs further including instructions for:
displaying the recreated object as an indication of completing the second task.

### Claim 21 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the second task is provided by a domain associated with the first task.

### Claim 22 (depends on 21)

The non-transitory computer-readable storage medium of claim 21, wherein the second task is linked to the first task in the domain.

### Claim 23 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, the one or more programs further including instructions for:
determining a target for the second task based on the link between the second task and the first task in the domain.

### Claim 24 (depends on 15)

The electronic device of claim 15, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the second user speech input includes a predetermined word or phrase.

### Claim 25 (depends on 15)

The electronic device of claim 15, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the second user speech input is received within a predetermined time of performing the first task.

### Claim 26 (depends on 15)

The electronic device of claim 15, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the first task includes a reversible property.

### Claim 27 (depends on 15)

The electronic device of claim 15, wherein the reversible property of the first task is included in a domain associated with the first task.

### Claim 28 (depends on 15)

The electronic device of claim 15, wherein a machine learning model performs the determination of whether the second user speech input includes the intent to undo the action.

### Claim 29 (depends on 15)

The electronic device of claim 15, the one or more programs further including instructions for:
in accordance with a determination that the second user speech input includes a modification to the first task:
in accordance with a determination that the second user speech input includes a third task, performing the third task after performing the second task.

### Claim 30 (depends on 15)

The electronic device of claim 15, the one or more programs further including instructions for:
after completing the first task, providing a first audio output including a description of the first task.

### Claim 31 (depends on 15)

The electronic device of claim 15, the one or more programs further including instructions for:
providing a second audio output after completion of the second task.

### Claim 32 (depends on 31)

The electronic device of claim 31, wherein the second audio output includes an indication that the first task was modified.

### Claim 33 (depends on 31)

The electronic device of claim 31, wherein the second audio output includes an indication that a third task was performed.

### Claim 34 (depends on 15)

The electronic device of claim 15, the one or more programs further including instructions for:
receiving a third user speech input; and
in accordance with a determination that the third user speech input includes a modification to the second task, performing a fourth task, wherein performance of the fourth task modifies at least a portion of the performance of the second task.

### Claim 35 (depends on 15)

The electronic device of claim 15, wherein the second task includes transferring data from a first application to a second application.

### Claim 36 (depends on 15)

The electronic device of claim 15, wherein the second task includes changing a state of an electronic device.

### Claim 37 (depends on 15)

The electronic device of claim 15, wherein recreating the previously deleted object includes:
determining whether the task of deleting the object includes a reversible property that recreates the deleted object.

### Claim 38 (depends on 15)

The electronic device of claim 15, the one or more programs further including instructions for:
after performing the first task specified in the first user speech input, storing a possible task reversing the first task specified in the first user speech input; and
wherein recreating the previously deleted object includes performing the possible task reversing the first task specified in the first user speech input.

### Claim 39 (depends on 15)

The electronic device of claim 15, wherein recreating the previously deleted object includes:
determining, based on the intent to undo the action performed by the first task, that the second task is to recreate the previously deleted object; and
determining, based on a link between the first task and the second task in a related domain, a target for the second task is the previously deleted object.

### Claim 40 (depends on 15)

The electronic device of claim 15, the one or more programs further including instructions for:
displaying the recreated object as an indication of completing the second task.

### Claim 41 (depends on 15)

The electronic device of claim 15, wherein the second task is provided by a domain associated with the first task.

### Claim 42 (depends on 41)

The electronic device of claim 41, wherein the second task is linked to the first task in the domain.

### Claim 43 (depends on 42)

The electronic device of claim 42, the one or more programs further including instructions for:
determining a target for the second task based on the link between the second task and the first task in the domain.

### Claim 44 (depends on 16)

The method of claim 16, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the second user speech input includes a predetermined word or phrase.

### Claim 45 (depends on 16)

The method of claim 16, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the second user speech input is received within a predetermined time of performing the first task.

### Claim 46 (depends on 16)

The method of claim 16, wherein determining that the second user speech input includes the intent to undo the action further comprises:
determining whether the first task includes a reversible property.

### Claim 47 (depends on 46)

The method of claim 46, wherein the reversible property of the first task is included in a domain associated with the first task.

### Claim 48 (depends on 16)

The method of claim 16, wherein a machine learning model performs the determination of whether the second user speech input includes the intent to undo the action.

### Claim 49 (depends on 16)

The method of claim 16, further comprising:
in accordance with a determination that the second user speech input includes a modification to the first task:
in accordance with a determination that the second user speech input includes a third task, performing the third task after performing the second task.

### Claim 50 (depends on 16)

The method of claim 16, further comprising:
after completing the first task, providing a first audio output including a description of the first task.

### Claim 51 (depends on 16)

The method of claim 16, further comprising:
providing a second audio output after completion of the second task.

### Claim 52 (depends on 51)

The method of claim 51, wherein the second audio output includes an indication that the first task was modified.

### Claim 53 (depends on 51)

The method of claim 51, wherein the second audio output includes an indication that a third task was performed.

### Claim 54 (depends on 16)

The method of claim 16, further comprising:
receiving a third user speech input; and
in accordance with a determination that the third user speech input includes a modification to the second task, performing a fourth task, wherein performance of the fourth task modifies at least a portion of the performance of the second task.

### Claim 55 (depends on 16)

The method of claim 16, wherein the second task includes transferring data from a first application to a second application.

### Claim 56 (depends on 16)

The method of claim 16, wherein the second task includes changing a state of an electronic device.

### Claim 57 (depends on 16)

The method of claim 16, wherein recreating the previously deleted object includes:
determining whether the task of deleting the object includes a reversible property that recreates the deleted object.

### Claim 58 (depends on 16)

The method of claim 16, the one or more programs further including instructions for:
after performing the first task specified in the first user speech input, storing a possible task reversing the first task specified in the first user speech input; and
wherein recreating the previously deleted object includes performing the possible task reversing the first task specified in the first user speech input.

### Claim 59 (depends on 16)

The method of claim 16, wherein recreating the previously deleted object includes:
determining, based on the intent to undo the action performed by the first task, that the second task is to recreate the previously deleted object; and
determining, based on a link between the first task and the second task in a related domain, a target for the second task is the previously deleted object.

### Claim 60 (depends on 16)

The method of claim 16, further comprising:
displaying the recreated object as an indication of completing the second task.

### Claim 61 (depends on 16)

The method of claim 16, wherein the second task is provided by a domain associated with the first task.

### Claim 62 (depends on 61)

The method of claim 61, wherein the second task is linked to the first task in the domain.

### Claim 63 (depends on 62)

The method of claim 62, further comprising:
determining a target for the second task based on the link between the second task and the first task in the domain.