# US 11,442,607 B2 · Task shortcut user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,442,607 B2
- Document ID: US11442607B2
- Status: Granted
- Kind: B2
- Application number: 16/990,867
- Filed: 2020-08-11
- Published: 2021-11-11
- Granted: 2022-09-13
- Earliest claimed: 2020-05-11
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Ayaka Nonaka; Daniel Sean Hsu; Ian J. McDowell; Nicholas Christian Frey; Charles B. Etzel; Conrad B. Kramer; Jay Moon; Elizabeth Elsa Perakis; Ari Weinstein
- Web page: https://patentgrep.com/patent/US11442607B2

## CPC

- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and processes for operating an intelligent automated assistant are provided. An example process for performing a task includes, at an electronic device having one or more processors and memory, determining whether a shortcut criteria is met and in accordance with a determination that the shortcut criteria is met: displaying a first affordance corresponding to a first task of a shortcut over a user interface, determining whether the first task can be completed without displaying an application interface corresponding to the first task, in accordance with a determination that the first task can be completed without displaying the application interface, performing the first task while displaying the first affordance, and in accordance with a determination that the first task cannot be completed without displaying the application interface, displaying the application interface, and completing the first task using the application interface.

## Claims

### Claim 1

A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
display a first affordance corresponding to a first task of a shortcut over a user interface;
in accordance with a determination that the first task of the shortcut can be completed without displaying an application interface corresponding to the first task, perform the first task while displaying the first affordance corresponding to the first task of the shortcut; and
in accordance with a determination that the first task of the shortcut cannot be completed without displaying an application interface corresponding to the first task, complete the first task while displaying the application interface.

### Claim 2 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
display a widget affordance including an affordance corresponding to the shortcut in the user interface.

### Claim 3 (depends on 2)

The non-transitory computer-readable storage medium of claim 2, wherein the shortcut criteria includes the affordance corresponding to the shortcut being selected.

### Claim 4 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the shortcut criteria is established during creation of the shortcut.

### Claim 5 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the first affordance corresponding to the first task of the shortcut descends from the top of the displayed user interface.

### Claim 6 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the first affordance replaces a predetermined portion of the displayed user interface.

### Claim 7 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein determining whether the first task of the shortcut can be completed without displaying an application interface corresponding to the first task further comprises:
determining whether information to be displayed during performance of the task is capable of being displayed in the first affordance.

### Claim 8 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein displaying the application interface corresponding to the first task further comprises:
replacing the user interface with the application interface corresponding to the first task.

### Claim 9 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
determine whether additional information is required to complete the first task of the shortcut; and
in accordance with the determination that additional information is required to complete the first task of the shortcut, provide a prompt for the additional information.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein providing the prompt for the additional information further comprises:
providing an entry field in the first affordance corresponding to the first task of the shortcut.

### Claim 11 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein providing the prompt for the additional information further comprises:
providing a stepper field in the first affordance corresponding to the first task of the shortcut.

### Claim 12 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein providing the prompt for the additional information further comprises:
providing a calendar field in the first affordance corresponding to the first task of the shortcut.

### Claim 13 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein providing the prompt for the additional information further comprises:
displaying a second affordance corresponding to the prompt for additional information.

### Claim 14 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the second affordance is displayed in a second predetermined portion of the user interface.

### Claim 15 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
in response to displaying the second affordance, cease to display the first affordance.

### Claim 16 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
receive the additional information; and
perform the task with the additional information.

### Claim 17 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein a portion of the displayed user interface that is not displaying the first affordance is partially opaque.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
determine whether performing the first task of the shortcut includes displaying a progress bar in the first affordance; and
in accordance with a determination that performing the first task of the shortcut includes displaying a progress bar in the first affordance:
display the progress bar in the first affordance; and
display a partially opaque version of the portion of the user interface that is not displaying the first affordance.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein determining whether performing the first task of the shortcut includes displaying a progress bar in the first affordance further comprises:
determining whether the first task is of a predetermined task type;
determining whether the first task is being performed with a predetermined application; and
in accordance with the determination that the first task is of the predetermined task type or the first task is being performed with the predetermined application, determining that performing the first task of the shortcut includes displaying the progress bar in the first affordance.

### Claim 20 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
in accordance with a determination that performing the first task of the shortcut includes displaying a progress bar in the first affordance:
display a stop affordance in the first affordance.

### Claim 21 (depends on 20)

The non-transitory computer-readable storage medium of claim 20, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
detect a selection of the stop affordance; and
in response to detecting the selection of the stop affordance:
cease performance of the first task; and
cease display of the first affordance.

### Claim 22 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
display a third affordance corresponding to a second task of the shortcut over the user interface;
determine whether the second task of the shortcut can be completed without displaying an application interface corresponding to the second task;
in accordance with a determination that the second task of the shortcut can be completed without displaying the application interface corresponding to the second task, perform the second task while displaying the third affordance corresponding to the second task of the shortcut; and
in accordance with a determination that the second task of the shortcut cannot be completed without displaying the application interface corresponding to the second task:
display the application interface corresponding to the second task; and
complete the second task using the application interface corresponding to the second task.

### Claim 23 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
detect an input to change the user interface; and
in response to detecting the input to change the user interface replace the user interface with a second user interface, wherein the first affordance corresponding to the first task of the shortcut continues to be displayed.

### Claim 24 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
in accordance with the determination that the shortcut criteria is met:
display a notification corresponding to the shortcut;
detect selection of the notification corresponding to the shortcut; and
in response to detecting the selection of the notification corresponding to the shortcut, display the first affordance corresponding to the first task of the shortcut over the user interface.

### Claim 25 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
display a picture in the first affordance corresponding to the first task of the shortcut.

### Claim 26 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
detect a selection of the picture; and
in response to detecting the selection of the picture, replace a predetermined portion of the user interface with the picture.

### Claim 27 (depends on 26)

The non-transitory computer-readable storage medium of claim 26, wherein the programs further comprise instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
detect a selection outside of the picture; and
in response to detecting the selection outside of the picture, replace the picture with the user interface.

### Claim 28

An electronic device comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying a first affordance corresponding to a first task of a shortcut over a user interface;
in accordance with a determination that the first task of the shortcut can be completed without displaying an application interface corresponding to the first task, performing the first task while displaying the first affordance corresponding to the first task of the shortcut; and
in accordance with a determination that the first task of the shortcut cannot be completed without displaying application interface corresponding to the first task, completing the first task while displaying the application interface.

### Claim 29 (depends on 28)

The electronic device of claim 28, wherein the programs further include instructions for:
displaying a widget affordance including an affordance corresponding to the shortcut in the user interface.

### Claim 30 (depends on 28)

The electronic device of claim 28, wherein the first affordance corresponding to the first task of the shortcut descends from the top of the displayed user interface.

### Claim 31 (depends on 28)

The electronic device of claim 28, wherein determining whether the first task of the shortcut can be completed without displaying an application interface corresponding to the first task further comprises:
determining whether information to be displayed during performance of the task is capable of being displayed in the first affordance.

### Claim 32 (depends on 28)

The electronic device of claim 28, wherein displaying the application interface corresponding to the first task further comprises:
replacing the user interface with the application interface corresponding to the first task.

### Claim 33 (depends on 28)

The electronic device of claim 28, wherein the programs further include instructions for:
determining whether additional information is required to complete the first task of the shortcut; and
in accordance with the determination that additional information is required to complete the first task of the shortcut, providing a prompt for the additional information.

### Claim 34 (depends on 33)

The electronic device of claim 33, wherein providing the prompt for the additional information further comprises:
displaying a second affordance corresponding to the prompt for additional information.

### Claim 35 (depends on 34)

The electronic device of claim 34, wherein the second affordance is displayed in a second predetermined portion of the user interface.

### Claim 36 (depends on 28)

The electronic device of claim 28, wherein a portion of the displayed user interface that is not displaying the first affordance is partially opaque.

### Claim 37 (depends on 36)

The electronic device of claim 36, wherein the programs further include instructions for:
determining whether performing the first task of the shortcut includes displaying a progress bar in the first affordance; and
in accordance with a determination that performing the first task of the shortcut includes displaying a progress bar in the first affordance:
displaying the progress bar in the first affordance; and
displaying a partially opaque version of the portion of the user interface that is not displaying the first affordance.

### Claim 38 (depends on 37)

The electronic device of claim 37, wherein determining whether performing the first task of the shortcut includes displaying a progress bar in the first affordance further comprises:
determining whether the first task is of a predetermined task type;
determining whether the first task is being performed with a predetermined application; and
in accordance with the determination that the first task is of the predetermined task type or the first task is being performed with the predetermined application, determining that performing the first task of the shortcut includes displaying the progress bar in the first affordance.

### Claim 39 (depends on 37)

The electronic device of claim 37, wherein the programs further include instructions for:
in accordance with a determination that performing the first task of the shortcut includes displaying a progress bar in the first affordance:
displaying a stop affordance in the first affordance.

### Claim 40 (depends on 39)

The electronic device of claim 39, wherein the programs further include instructions for:
detecting a selection of the stop affordance; and
in response to detecting the selection of the stop affordance:
ceasing performance of the first task; and
ceasing display of the first affordance.

### Claim 41 (depends on 28)

The electronic device of claim 28, wherein the programs further include instructions for:
detecting an input to change the user interface; and
in response to detecting the input to change the user interface, replacing the user interface with a second user interface, wherein the first affordance corresponding to the first task of the shortcut continues to be displayed.

### Claim 42 (depends on 28)

The electronic device of claim 28, wherein the programs further include instructions for:
in accordance with the determination that the shortcut criteria is met:
displaying a notification corresponding to the shortcut;
detecting selection of the notification corresponding to the shortcut; and
in response to detecting the selection of the notification corresponding to the shortcut, displaying the first affordance corresponding to the first task of the shortcut over the user interface.

### Claim 43 (depends on 28)

The electronic device of claim 28, wherein the programs further include instructions for:
detecting a selection of the picture; and
in response to detecting the selection of the picture, replacing a predetermined portion of the user interface with the picture.

### Claim 44

A method, comprising:
at an electronic device with one or more processors and memory:
displaying a first affordance corresponding to a first task of a shortcut over a user interface;
in accordance with a determination that the first task of the shortcut can be completed without displaying an application interface corresponding to the first task, performing the first task while displaying the first affordance corresponding to the first task of the shortcut; and
in accordance with a determination that the first task of the shortcut cannot be completed without displaying application interface corresponding to the first task, completing the first task while displaying the application interface.

### Claim 45 (depends on 44)

The method of claim 44, further comprising:
displaying a widget affordance including an affordance corresponding to the shortcut in the user interface.

### Claim 46 (depends on 44)

The method of claim 44, wherein the first affordance corresponding to the first task of the shortcut descends from the top of the displayed user interface.

### Claim 47 (depends on 44)

The method of claim 44, wherein determining whether the first task of the shortcut can be completed without displaying an application interface corresponding to the first task further comprises:
determining whether information to be displayed during performance of the task is capable of being displayed in the first affordance.

### Claim 48 (depends on 44)

The method of claim 44, wherein displaying the application interface corresponding to the first task further comprises:
replacing the user interface with the application interface corresponding to the first task.

### Claim 49 (depends on 44)

The method of claim 44, further comprising:
determining whether additional information is required to complete the first task of the shortcut; and
in accordance with the determination that additional information is required to complete the first task of the shortcut, providing a prompt for the additional information.

### Claim 50 (depends on 49)

The method of claim 49, wherein providing the prompt for the additional information further comprises:
displaying a second affordance corresponding to the prompt for additional information.

### Claim 51 (depends on 50)

The method of claim 50, wherein the second affordance is displayed in a second predetermined portion of the user interface.

### Claim 52 (depends on 44)

The method of claim 44, wherein a portion of the displayed user interface that is not displaying the first affordance is partially opaque.

### Claim 53 (depends on 52)

The method of claim 52, further comprising:
determining whether performing the first task of the shortcut includes displaying a progress bar in the first affordance; and
in accordance with a determination that performing the first task of the shortcut includes displaying a progress bar in the first affordance:
displaying the progress bar in the first affordance; and
displaying a partially opaque version of the portion of the user interface that is not displaying the first affordance.

### Claim 54 (depends on 53)

The method of claim 53, wherein determining whether performing the first task of the shortcut includes displaying a progress bar in the first affordance further comprises:
determining whether the first task is of a predetermined task type;
determining whether the first task is being performed with a predetermined application; and
in accordance with the determination that the first task is of the predetermined task type or the first task is being performed with the predetermined application, determining that performing the first task of the shortcut includes displaying the progress bar in the first affordance.

### Claim 55 (depends on 53)

The method of claim 53, further comprising:
in accordance with a determination that performing the first task of the shortcut includes displaying a progress bar in the first affordance:
displaying a stop affordance in the first affordance.

### Claim 56 (depends on 55)

The method of claim 55, further comprising:
detecting a selection of the stop affordance; and
in response to detecting the selection of the stop affordance:
ceasing performance of the first task; and
ceasing display of the first affordance.

### Claim 57 (depends on 44)

The method of claim 44, further comprising:
detecting an input to change the user interface; and
in response to detecting the input to change the user interface, replacing the user interface with a second user interface, wherein the first affordance corresponding to the first task of the shortcut continues to be displayed.

### Claim 58 (depends on 44)

The method of claim 44, further comprising:
in accordance with the determination that the shortcut criteria is met:
displaying a notification corresponding to the shortcut;
detecting selection of the notification corresponding to the shortcut; and
in response to detecting the selection of the notification corresponding to the shortcut, displaying the first affordance corresponding to the first task of the shortcut over the user interface.

### Claim 59 (depends on 44)

The method of claim 44, further comprising:
detecting a selection of the picture; and
in response to detecting the selection of the picture, replacing a predetermined portion of the user interface with the picture.