# US 2026/0089457 A1 · Providing digital assistant responses using three-dimensional audio effects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0089457 A1
- Document ID: US20260089457A1
- Status: Published application
- Kind: A1
- Application number: 19/325,339
- Filed: 2025-09-10
- Published: 2026-03-26
- Earliest claimed: 2024-09-26
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Elena J. NATTINGER; Anna L. BREWER; Devin W. CHALMERS; Luis R. DELIZ CENTENO; Joshua J. FROST; Alexandria G. HESTON; Lee SPARKS
- Web page: https://patentgrep.com/patent/US20260089457A1

## CPC

- H04S 7/303: {Tracking of listener position or orientation}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06V 20/50: Context or environment of the image
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06T 2219/2004: Aligning objects, relative positioning of parts
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Disclosed herein are example processes for providing digital assistant responses using three-dimensional audio effects.

## Claims

### Claim 1

A computer system configured to communicate with one or more sensor devices, the computer system comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
detecting, via the one or more sensor devices, first data; and
in response to detecting, via the one or more sensor devices, the first data and after a user intent is determined based on the first data:
in accordance with a determination that the user intent is a first type of user intent and a determination that a set of criteria is satisfied:
audibly outputting a first spoken response that is generated based on the user intent, wherein audibly outputting the first spoken response includes:
audibly outputting a first portion of the first spoken response, wherein the first portion of the first spoken response virtually emanates from a first position within a three-dimensional (3D) scene associated with the computer system, and wherein the first position is based on a first object; and
after audibly outputting the first portion of the first spoken response, audibly outputting a second portion of the first spoken response, wherein the second portion of the first spoken response virtually emanates from a second position within the 3D scene that is different from the first position, and wherein the second position is based on a second object different from the first object; and
in accordance with a determination that the user intent is a second type of user intent different from the first type of user intent:
audibly outputting a second spoken response that is generated based on the user intent, wherein the second spoken response emanates from a default position different from the first position and the second position.

### Claim 2 (depends on 1)

The computer system of claim 1, wherein the one or more programs further include instructions for:
in response to detecting, via the one or more sensor devices, the first data and after the user intent is determined based on the first data:
in accordance with a determination that the user intent is a third type of user intent different from the first type of user intent and the second type of user intent:
audibly outputting a third spoken response that is generated based on the user intent, wherein the third spoken response virtually emanates from a third position within the 3D scene, wherein the third position is based on a third object.

### Claim 3 (depends on 2)

The computer system of claim 2, wherein the user intent is the third type of user intent when a single position of a single object is identified based on the user intent.

### Claim 4 (depends on 2)

The computer system of claim 2, wherein:
the computer system is in communication with one or more front-facing image sensors; and
when the first data is detected, the third object is not in a field of view of the one or more front-facing image sensors.

### Claim 5 (depends on 2)

The computer system of claim 2, wherein audibly outputting the third spoken response includes audibly outputting information about the third object.

### Claim 6 (depends on 1)

The computer system of claim 1, wherein:
the one or more sensor devices include one or more audio sensors; and
the first data includes a natural language input detected via the one or more audio sensors.

### Claim 7 (depends on 1)

The computer system of claim 1, wherein:
the one or more sensor devices include one or more audio sensors and one or more image sensors;
the first data includes a natural language input detected via the one or more audio sensors and image data detected via the one or more image sensors; and
the user intent is determined based on the natural language input and the image data.

### Claim 8 (depends on 1)

The computer system of claim 1, wherein:
the one or more sensor devices include one or more image sensors;
the first data includes image data detected via the one or more image sensors; and
the user intent is determined based on the image data and without receiving a natural language input.

### Claim 9 (depends on 1)

The computer system of claim 1, wherein the user intent is the first type of user intent when multiple respective positions of multiple objects are identified based on the user intent.

### Claim 10 (depends on 1)

The computer system of claim 1, wherein the user intent is the second type of user intent when no position of an object is identified based on the user intent.

### Claim 11 (depends on 1)

The computer system of claim 1, wherein the default position is a predetermined distance away from the computer system and wherein the default position has a predetermined direction relative to the computer system.

### Claim 12 (depends on 1)

The computer system of claim 1, wherein the computer system is in communication with a display generation component, and wherein the one or more programs further include instructions for:
while audibly outputting the first portion of the first spoken response, displaying, via the display generation component, a digital assistant virtual object at the first position; and
while audibly outputting the second portion of the first spoken response, displaying, via the display generation component, the digital assistant virtual object at the second position.

### Claim 13 (depends on 1)

The computer system of claim 1, wherein:
the computer system is in communication with a display generation component;
the first position is a respective position of the first object;
the second position is a respective position of the second object; and
the one or more programs further include instructions for:
while audibly outputting the first portion of the first spoken response, displaying, via the display generation component, a digital assistant virtual object at a fourth position within the 3D scene, wherein the fourth position is based on the first object, and wherein the fourth position is different from the first position; and
while audibly outputting the second portion of the first spoken response, displaying, via the display generation component, the digital assistant virtual object at a fifth position within the 3D scene, wherein the fifth position is based on the second object, and wherein the fifth position is different from the second position.

### Claim 14 (depends on 1)

The computer system of claim 1, wherein:
the first spoken response is audibly output without displaying any virtual object; and
the second spoken response is audibly output without displaying any virtual object.

### Claim 15 (depends on 1)

The computer system of claim 1, wherein:
the computer system is in communication with one or more front-facing image sensors; and
when the first data is detected, at least one of the first object and the second object are not in a field of view of the one or more front-facing image sensors.

### Claim 16 (depends on 1)

The computer system of claim 1, wherein the one or more programs further include instructions for:
while audibly outputting the first spoken response, detecting a change in a pose of a user of the computer system; and
in response to detecting the change in the pose of the user:
in accordance with a determination that the change in the pose of the user is detected while audibly outputting the first portion of the first spoken response, continuing to audibly output the first portion of the first spoken response, wherein the continued audible output of the first portion of the first spoken response continues to virtually emanate from the first position; and
in accordance with a determination that the change in the pose of the user is detected while audibly outputting the second portion of the first spoken response, continuing to audibly output the second portion of the first spoken response, wherein the continued audible output of the second portion of the first spoken response continues to virtually emanate from the second position.

### Claim 17 (depends on 1)

The computer system of claim 1, wherein:
the first portion of the first spoken response has a first direction relative to the computer system, wherein the first direction relative to the computer system corresponds to the respective direction of the first object relative to the computer system; and
the second portion of the first spoken response has a second direction relative to the computer system, wherein the second direction relative to the computer system corresponds to the respective direction of the second object relative to the computer system, wherein the first direction relative to the computer system is different from the second direction relative to the computer system.

### Claim 18 (depends on 1)

The computer system of claim 1, wherein:
the first position is within a predetermined distance from a respective position of the first object; and
the second position is within the predetermined distance from a respective position of the second object.

### Claim 19 (depends on 1)

The computer system of claim 1, wherein:
the first portion of the first spoken response provides information about the first object; and
the second portion of the first spoken response provides information about the second object.

### Claim 20 (depends on 1)

The computer system of claim 1, wherein the first spoken response corresponds to a request for user disambiguation between the first object and the second object.

### Claim 21 (depends on 1)

The computer system of claim 1, wherein the set of criteria is satisfied when the respective position of the first object and the respective position of the second object are each within a threshold distance from the computer system.

### Claim 22 (depends on 1)

The computer system of claim 1, wherein the one or more programs further include instructions for:
detecting, via the one or more sensor devices, an air gesture, wherein the air gesture corresponds to a selection of a respective object within the 3D scene; and
in response to detecting the air gesture, providing an audible output that virtually originates from a position of the air gesture and that virtually moves in a direction of the respective object relative to the computer system.

### Claim 23 (depends on 22)

The computer system of claim 22, wherein:
in accordance with a determination that the respective object has a first object characteristic, the audible output has a first sound characteristic that is based on the first object characteristic; and
in accordance with a determination that the respective object has a second object characteristic different from the first object characteristic, the audible output has a second sound characteristic that is based on the second object characteristic, wherein the second sound characteristic is different from the first sound characteristic.

### Claim 24

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more sensor devices, the one or more programs including instructions for:
detecting, via the one or more sensor devices, first data; and
in response to detecting, via the one or more sensor devices, the first data and after a user intent is determined based on the first data:
in accordance with a determination that the user intent is a first type of user intent and a determination that a set of criteria is satisfied:
audibly outputting a first spoken response that is generated based on the user intent, wherein audibly outputting the first spoken response includes:
audibly outputting a first portion of the first spoken response, wherein the first portion of the first spoken response virtually emanates from a first position within a three-dimensional (3D) scene associated with the computer system, and wherein the first position is based on a first object; and
after audibly outputting the first portion of the first spoken response, audibly outputting a second portion of the first spoken response, wherein the second portion of the first spoken response virtually emanates from a second position within the 3D scene that is different from the first position, and wherein the second position is based on a second object different from the first object; and
in accordance with a determination that the user intent is a second type of user intent different from the first type of user intent:
audibly outputting a second spoken response that is generated based on the user intent, wherein the second spoken response emanates from a default position different from the first position and the second position.

### Claim 25

A method, comprising:
at a computer system that is in communication with one or more sensor devices:
detecting, via the one or more sensor devices, first data; and
in response to detecting, via the one or more sensor devices, the first data and after a user intent is determined based on the first data:
in accordance with a determination that the user intent is a first type of user intent and a determination that a set of criteria is satisfied:
audibly outputting a first spoken response that is generated based on the user intent, wherein audibly outputting the first spoken response includes:
audibly outputting a first portion of the first spoken response, wherein the first portion of the first spoken response virtually emanates from a first position within a three-dimensional (3D) scene associated with the computer system, and wherein the first position is based on a first object; and
after audibly outputting the first portion of the first spoken response, audibly outputting a second portion of the first spoken response, wherein the second portion of the first spoken response virtually emanates from a second position within the 3D scene that is different from the first position, and wherein the second position is based on a second object different from the first object; and
in accordance with a determination that the user intent is a second type of user intent different from the first type of user intent:
audibly outputting a second spoken response that is generated based on the user intent, wherein the second spoken response emanates from a default position different from the first position and the second position.
