# US 2020/0286472 A1 · Maintaining privacy of personal information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0286472 A1
- Document ID: US20200286472A1
- Status: Published application
- Kind: A1
- Application number: 16/883,099
- Filed: 2020-05-26
- Published: 2020-09-10
- Earliest claimed: 2017-05-11
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Brandon J. NEWENDORP; Joanna S. PETERSON
- Web page: https://patentgrep.com/patent/US20200286472A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30)
- G06F 40/56: Natural language generation
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/183: using context dependencies, e.g. language models
- G10L 2015/223: {Execution procedure of a spoken command}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and processes for operating an intelligent automated assistant to perform intelligent list reading are provided. In accordance with one example, a method includes, at an electronic device having one or more processors, receiving a natural-language input corresponding to a domain; providing the natural-language input to an external device; receiving, from the external device, a process flow corresponding to the domain; determining, with the process flow corresponding to the domain, a task associated with the natural-language input; performing the task; and providing an output indicating whether the task has been performed.

## Claims

### Claim 1

A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
receive a natural-language input requesting to retrieve private data;
provide the natural-language input to an external device, wherein the external device does not store the private data;
receive, from the external device, a process flow in accordance with a determination that the natural-language input corresponds to a privacy domain;
determine, based on executing the process flow at the electronic device, a task associated with the natural-language input;
perform the task based on the private data from a memory of the electronic device; and
provide an output indicating whether the task has been performed.

### Claim 2 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein performing the task includes retrieving the private data from the memory of the electronic device.

### Claim 3 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
determining the task based on context of the electronic device.

### Claim 4 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the privacy domain is a domain associated with the private data.

### Claim 5 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the process flow includes ASR flow, NL processing flow, or a combination thereof.

### Claim 6 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the output is based on a type of the electronic device.

### Claim 7 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
determining the task; and
determining a parameter associated with the task,
wherein performing the task includes performing the task using the parameter.

### Claim 8 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
receiving a plurality of candidate tasks; and
selecting the task from the plurality of candidate tasks.

### Claim 9 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein performing the task comprises:
generating a natural-language output, and
wherein providing the output indicating whether the task has been performed comprises:
providing the natural-language output.

### Claim 10 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the electronic device includes a touch-sensitive display, and wherein providing the output indicating whether the task has been performed comprises:
providing, on the touch-sensitive display, the output.

### Claim 11 (depends on 10)

The non-transitory computer-readable storage medium of claim 10, wherein the process flow includes user interface flow and wherein providing, on the touch-sensitive display, the output comprises:
providing, on the touch-sensitive display, the output according to the user interface flow.

### Claim 12 (depends on 10)

The non-transitory computer-readable storage medium of claim 10, wherein providing, on the touch-sensitive display, the output comprises:
providing, on the touch-sensitive display, the private data.

### Claim 13 (depends on 10)

The non-transitory computer-readable storage medium of claim 10, wherein providing, on the touch-sensitive display, the output comprises:
providing the output based on context of the electronic device.

### Claim 14 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the process flow comprises a set of executable instructions corresponding to the privacy domain.

### Claim 15 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the external device receives the natural-language input, identifies a domain of the natural-language input, and provides the process flow to the electronic device, and wherein the process flow corresponds to the identified domain.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the external device generates a first text string based on the natural-language input, and wherein providing the process flow to the electronic device includes providing the first text string to the electronic device.

### Claim 17 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the task is a first candidate task, wherein identifying the domain of the natural-language input comprises:
determining whether the domain is a domain of a predetermined type, the domain of the predetermined type including the privacy domain, and wherein providing the process flow to the electronic device comprises:
in accordance with a determination that the domain is not a domain of the predetermined type:
determining a second candidate task associated with the natural-language input; and
providing the second candidate task to the electronic device; and
in accordance with a determination that the domain is a domain of the predetermined type, forgoing determining the second candidate task associated with the natural-language input.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein determining the second candidate task associated with the natural-language input comprises:
determining the second candidate task based on context of the external device.

### Claim 19

A method, comprising:
at an electronic device having one or more processors, a memory, and a touch-sensitive display:
receiving a natural-language input requesting to retrieve private data;
providing the natural-language input to an external device, wherein the external device does not store the private data;
receiving, from the external device, a process flow in accordance with a determination that the natural-language input corresponds to a privacy domain;
determining, based on executing the process flow at the electronic device, a task associated with the natural-language input;
performing the task based on the private data from the memory of the electronic device; and
providing an output indicating whether the task has been performed.

### Claim 20

An electronic device, comprising:
a touch-sensitive display;
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving a natural-language input requesting to retrieve private data;
providing the natural-language input to an external device, wherein the external device does not store the private data;
receiving, from the external device, a process flow in accordance with a determination that the natural-language input corresponds to a privacy domain;
determining, based on executing the process flow at the electronic device, a task associated with the natural-language input;
performing the task based on the private data from the memory of the electronic device; and
providing an output indicating whether the task has been performed.

### Claim 21 (depends on 19)

The method of claim 19, wherein performing the task includes retrieving the private data from the memory of the electronic device.

### Claim 22 (depends on 19)

The method of claim 19, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
determining the task based on context of the electronic device.

### Claim 23 (depends on 19)

The method of claim 19, wherein the privacy domain is a domain associated with the private data.

### Claim 24 (depends on 19)

The method of claim 19, wherein the process flow includes ASR flow, NL processing flow, or a combination thereof.

### Claim 25 (depends on 19)

The method of claim 19, wherein the output is based on a type of the electronic device.

### Claim 26 (depends on 19)

The method of claim 19, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
determining the task; and
determining a parameter associated with the task,
wherein performing the task includes performing the task using the parameter.

### Claim 27 (depends on 19)

The method of claim 19, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
receiving a plurality of candidate tasks; and
selecting the task from the plurality of candidate tasks.

### Claim 28 (depends on 19)

The method of claim 19, wherein performing the task comprises:
generating a natural-language output, and
wherein providing the output indicating whether the task has been performed comprises:
providing the natural-language output.

### Claim 29 (depends on 19)

The method of claim 19, wherein the electronic device includes a touch-sensitive display, and wherein providing the output indicating whether the task has been performed comprises:
providing, on the touch-sensitive display, the output.

### Claim 30 (depends on 29)

The method of claim 29, wherein the process flow includes user interface flow and wherein providing, on the touch-sensitive display, the output comprises:
providing, on the touch-sensitive display, the output according to the user interface flow.

### Claim 31 (depends on 29)

The method of claim 29, wherein providing, on the touch-sensitive display, the output comprises:
providing, on the touch-sensitive display, the private data.

### Claim 32 (depends on 29)

The method of claim 29, wherein providing, on the touch-sensitive display, the output comprises:
providing the output based on context of the electronic device.

### Claim 33 (depends on 19)

The method of claim 19, wherein the process flow comprises a set of executable instructions corresponding to the privacy domain.

### Claim 34 (depends on 19)

The method of claim 19, wherein the external device receives the natural-language input, identifies a domain of the natural-language input, and provides the process flow to the electronic device, and wherein the process flow corresponds to the identified domain.

### Claim 35 (depends on 34)

The method of claim 34, wherein the external device generates a first text string based on the natural-language input, and wherein providing the process flow to the electronic device includes providing the first text string to the electronic device.

### Claim 36 (depends on 34)

The method of claim 34, wherein the task is a first candidate task, wherein identifying the domain of the natural-language input comprises:
determining whether the domain is a domain of a predetermined type, the domain of the predetermined type including the privacy domain, and wherein providing the process flow to the electronic device comprises:
in accordance with a determination that the domain is not a domain of the predetermined type:
determining a second candidate task associated with the natural-language input; and
providing the second candidate task to the electronic device; and
in accordance with a determination that the domain is a domain of the predetermined type, forgoing determining the second candidate task associated with the natural-language input.

### Claim 37 (depends on 36)

The method of claim 36, wherein determining the second candidate task associated with the natural-language input comprises:
determining the second candidate task based on context of the external device.

### Claim 38 (depends on 20)

The electronic device of claim 20, wherein performing the task includes retrieving the private data from the memory of the electronic device.

### Claim 39 (depends on 20)

The electronic device of claim 20, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
determining the task based on context of the electronic device.

### Claim 40 (depends on 20)

The electronic device of claim 20, wherein the privacy domain is a domain associated with the private data.

### Claim 41 (depends on 20)

The electronic device of claim 20, wherein the process flow includes ASR flow, NL processing flow, or a combination thereof.

### Claim 42 (depends on 20)

The electronic device of claim 20, wherein the output is based on a type of the electronic device.

### Claim 43 (depends on 20)

The electronic device of claim 20, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
determining the task; and
determining a parameter associated with the task,
wherein performing the task includes performing the task using the parameter.

### Claim 44 (depends on 20)

The electronic device of claim 20, wherein determining, based on executing the process flow, the task associated with the natural-language input comprises:
receiving a plurality of candidate tasks; and
selecting the task from the plurality of candidate tasks.

### Claim 45 (depends on 20)

electronic device of claim 20, wherein performing the task comprises:
generating a natural-language output, and
wherein providing the output indicating whether the task has been performed comprises:
providing the natural-language output.

### Claim 46 (depends on 20)

The electronic device of claim 20, wherein the electronic device includes a touch-sensitive display, and wherein providing the output indicating whether the task has been performed comprises:
providing, on the touch-sensitive display, the output.

### Claim 47 (depends on 46)

The electronic device of claim 46, wherein the process flow includes user interface flow and wherein providing, on the touch-sensitive display, the output comprises:
providing, on the touch-sensitive display, the output according to the user interface flow.

### Claim 48 (depends on 46)

The electronic device of claim 46, wherein providing, on the touch-sensitive display, the output comprises:
providing, on the touch-sensitive display, the private data.

### Claim 49 (depends on 46)

The electronic device of claim 46, wherein providing, on the touch-sensitive display, the output comprises:
providing the output based on context of the electronic device.

### Claim 50 (depends on 20)

The electronic device of claim 20, wherein the process flow comprises a set of executable instructions corresponding to the privacy domain.

### Claim 51 (depends on 20)

The electronic device of claim 20, wherein the external device receives the natural-language input, identifies a domain of the natural-language input, and provides the process flow to the electronic device, and wherein the process flow corresponds to the identified domain.

### Claim 52 (depends on 51)

The electronic device of claim 51, wherein the external device generates a first text string based on the natural-language input, and wherein providing the process flow to the electronic device includes providing the first text string to the electronic device.

### Claim 53 (depends on 51)

The electronic device of claim 51, wherein the task is a first candidate task, wherein identifying the domain of the natural-language input comprises:
determining whether the domain is a domain of a predetermined type, the domain of the predetermined type including the privacy domain, and wherein providing the process flow to the electronic device comprises:
in accordance with a determination that the domain is not a domain of the predetermined type:
determining a second candidate task associated with the natural-language input; and
providing the second candidate task to the electronic device; and
in accordance with a determination that the domain is a domain of the predetermined type, forgoing determining the second candidate task associated with the natural-language input.

### Claim 54 (depends on 53)

The electronic device of claim 53, wherein determining the second candidate task associated with the natural-language input comprises:
determining the second candidate task based on context of the external device.
