# US 2025/0157467 A1 · Digital assistant interaction in a communication session

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157467 A1
- Document ID: US20250157467A1
- Status: Published application
- Kind: A1
- Application number: 19/022,810
- Filed: 2025-01-15
- Published: 2025-05-15
- Earliest claimed: 2021-08-13
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Rae L. LASKO; German W. BAUER; Felicia W. EDWARDS; Niranjan MANJUNATH; Kurt W. PIERSOL; Jonathan H. RUSSELL; Lynn I. STREJA; Keith C. STRICKLING; Garrett L. WEINBERG
- Web page: https://patentgrep.com/patent/US20250157467A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 40/35: Discourse or dialogue representation
- H04M 1/7243: with interactive means for internal management of messages
- G10L 2015/223: {Execution procedure of a spoken command}
- H04M 2250/74: with voice recognition means
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

An example process includes while an electronic device is engaged in a communication session with external device(s): receiving, from a first user of the electronic device, input to invoke a first digital assistant; receiving, from the first user, a natural language input corresponding to a task; in accordance with invoking the first digital assistant, generating, by the first digital assistant, a prompt for further user input about the task; transmitting, to the external device(s), the prompt for further user input about the task; after transmitting the prompt for further user input, receiving, from an external device of the external device(s), a response to the prompt for further user input; initiating, by the first digital assistant, based on the response and information corresponding to the first user stored on the electronic device, the task; and transmitting, to the external device(s), an output indicative of the initiated task.

## Claims

### Claim 1

A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
while the electronic device is engaged in a communication session with one or more external devices:
receive, from a first user of the electronic device, input to invoke a first digital assistant operating on the electronic device, wherein the first digital assistant is configured to operate in a first language;
receive, from the first user, a first natural language input in the first language;
in accordance with invoking the first digital assistant, generate, by the first digital assistant, a first response, in the first language, to the first natural language input;
transmit the first response to the one or more external devices;
after transmitting the first response, receive, from an external device of the one or more external devices, a second natural language input in a second language, wherein:
the second natural language input is received without the external device receiving, after receiving the transmitted first response, second input to invoke a second digital assistant operating on the external device; and
the second digital assistant is configured to operate in the second language; and
receive, from the external device, a second response, in the second language, to the second natural language input, wherein the second response is generated by the second digital assistant.

### Claim 2 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, the one or more programs comprising instructions, which when executed by one or more processors of the electronic device, further cause the electronic device to:
transmit, to the external device, context information associated with the first natural language input, wherein the second digital assistant generates the second response based on the context information.

### Claim 3 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, the one or more programs comprising instructions, which when executed by one or more processors of the electronic device, further cause the electronic device to:
after transmitting the first response, receive, from the external device, a third natural language input in the first language, wherein the third natural language input is received without the external device receiving, after receiving the transmitted first response, third input to invoke the second digital assistant; and
receive, from the external device, a third response, in the second language, to the third natural language input, wherein the third response is generated by the second digital assistant and indicates that the second digital assistant is unable to interpret the third natural language input.

### Claim 4 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, the one or more programs comprising instructions, which when executed by one or more processors of the electronic device, further cause the electronic device to:
after transmitting the first response, receive, from the external device, a fourth natural language input in the second language;
receive, from the external device, a fourth response, in the second language, to the fourth natural language input, wherein:
the fourth response is generated by the second digital assistant;
the fourth response is received in accordance with the external device receiving fourth input to invoke the second digital assistant; and
the fourth response indicates that the second digital assistant initiates a task corresponding to the fourth natural language input.

### Claim 5 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the second digital assistant generates the second response based on information corresponding to a second user of the external device, wherein the information is stored on the external device.

### Claim 6 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, the one or more programs comprising instructions, which when executed by one or more processors of the electronic device, further cause the electronic device to:
after transmitting the first response, receive, from the first user, a fifth natural language input in the first language, wherein the fifth natural language input is received without the electronic device receiving, after transmitting first response, fifth input to invoke the first digital assistant;
in accordance with receiving the fifth natural language input, generate, by the first digital assistant, a fifth response, in the first language, to the fifth natural language input, wherein the fifth response indicates an initiated task corresponding to the fifth natural language input; and
transmit, to the one or more external devices, the fifth response.

### Claim 7 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, the one or more programs comprising instructions, which when executed by one or more processors of the electronic device, further cause the electronic device to:
after transmitting the first response, receive, from the first user, a sixth natural language input in a third language different from the first language, wherein the sixth natural language input is received without the electronic device receiving, after transmitting first response, sixth input to invoke the first digital assistant;
in accordance with receiving the sixth natural language input, generate, by the first digital assistant, a sixth response, in the first language, to the sixth natural language input, wherein the sixth response indicates that the first digital assistant is unable to interpret the sixth natural language input; and
transmit, to the one or more external devices, the sixth response.

### Claim 8 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein:
the external device determines that the second natural language input is intended for the second digital assistant based on a gaze direction of a third user of the external device; and
the second digital assistant generates the second response in accordance with a determination that the second natural language input is intended for the second digital assistant.

### Claim 9 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the second natural language input does not include a response to a prompt for user input generated by the first digital assistant or the second digital assistant.

### Claim 10 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein:
the input to invoke the first digital assistant includes a spoken trigger input or a selection of a button of the electronic device; and
the second input to invoke the second digital assistant includes the spoken trigger input or a selection of a button of the external device.

### Claim 11

An electronic device, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
while the electronic device is engaged in a communication session with one or more external devices:
receiving, from a first user of the electronic device, input to invoke a first digital assistant operating on the electronic device, wherein the first digital assistant is configured to operate in a first language;
receiving, from the first user, a first natural language input in the first language;
in accordance with invoking the first digital assistant, generating, by the first digital assistant, a first response, in the first language, to the first natural language input;
transmitting the first response to the one or more external devices;
after transmitting the first response, receiving, from an external device of the one or more external devices, a second natural language input in a second language, wherein:
the second natural language input is received without the external device receiving, after receiving the transmitted first response, second input to invoke a second digital assistant operating on the external device; and
the second digital assistant is configured to operate in the second language; and
receiving, from the external device, a second response, in the second language, to the second natural language input, wherein the second response is generated by the second digital assistant.

### Claim 12

A method, comprising:
at an electronic device with one or more processors and memory:
while the electronic device is engaged in a communication session with one or more external devices:
receiving, from a first user of the electronic device, input to invoke a first digital assistant operating on the electronic device, wherein the first digital assistant is configured to operate in a first language;
receiving, from the first user, a first natural language input in the first language;
in accordance with invoking the first digital assistant, generating, by the first digital assistant, a first response, in the first language, to the first natural language input;
transmitting the first response to the one or more external devices;
after transmitting the first response, receiving, from an external device of the one or more external devices, a second natural language input in a second language, wherein:
the second natural language input is received without the external device receiving, after receiving the transmitted first response, second input to invoke a second digital assistant operating on the external device; and
the second digital assistant is configured to operate in the second language; and
receiving, from the external device, a second response, in the second language, to the second natural language input, wherein the second response is generated by the second digital assistant.
