# US 2025/0384884 A1 · Electronic devices with voice command and contextual data processing capabilities

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0384884 A1
- Document ID: US20250384884A1
- Status: Published application
- Kind: A1
- Application number: 19/250,919
- Filed: 2025-06-26
- Published: 2025-12-18
- Earliest claimed: 2008-10-02
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Aram M. LINDAHL
- Web page: https://patentgrep.com/patent/US20250384884A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/43: Querying
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 21/06: Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids (G10L15/26 takes precedence)
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/228: {of application context}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An electronic device may capture a voice command from a user. The electronic device may store contextual information about the state of the electronic device when the voice command is received. The electronic device may transmit the voice command and the contextual information to computing equipment such as a desktop computer or a remote server. The computing equipment may perform a speech recognition operation on the voice command and may process the contextual information. The computing equipment May respond to the voice command. The computing equipment may also transmit information to the electronic device that allows the electronic device to respond to the voice command.

## Claims

### Claim 1

(canceled)

### Claim 2

An electronic device, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs including instructions for:
receiving a user utterance representing a user request;
determining, based on one or more words in the user utterance, a media file of the electronic device associated with the user request;
based on the user utterance and the media file, causing determination of one or more actions responsive to the user request, wherein causing determination of the one or more actions responsive to the user request includes:
in accordance with a determination that the electronic device is able to process the user utterance, determining the one or more actions responsive to the user request; and
in accordance with a determination that the electronic device is unable to process the user utterance:
transmitting data associated with the user utterance and the media file to a second electronic device; and
causing determination of the one or more actions responsive to the user request at the second electronic device; and
causing performance of the one or more actions, wherein performing the one or more actions generate a result based on the media file.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the media file includes a photo.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein the media file includes a video.

### Claim 5 (depends on 2)

The electronic device of claim 2, wherein:
the electronic device includes an integrated camera; and
the media file is captured using the integrated camera.

### Claim 6 (depends on 2)

The electronic device of claim 2, the one or more programs further including instructions for:
determining whether the user utterance contains one or more words of a first predefined set of words, wherein the electronic device is associated with the first predefined set of words.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the first predefined set of words associated with the electronic device includes fewer words than a second predefined set of words associated with the second electronic device.

### Claim 8 (depends on 2)

The electronic device of claim 2, the one or more programs further including instructions for:
in accordance with a determination that the electronic device is unable to process the user utterance:
receiving, from the second electronic device, the one or more actions responsive to the user request.

### Claim 9 (depends on 2)

The electronic device of claim 2, wherein causing performance of the one or more actions to generate a result includes performing one or more actions at the electronic device.

### Claim 10 (depends on 2)

The electronic device of claim 2, wherein causing performance of the one or more actions to generate a result includes performing one or more actions at the second electronic device.

### Claim 11 (depends on 7)

The electronic device of claim 7, wherein performing one or more actions at the second electronic device includes:
transmitting data associated with the one or more actions to the second electronic device; and
transmitting data associated with the one or more actions to a remote device.

### Claim 12 (depends on 2)

The electronic device of claim 2, the one or more programs further including instructions for:
determining, based on the user utterance, contextual information of the electronic device that is associated with the user utterance; and
wherein the result is further based on the media file and the contextual information.

### Claim 13 (depends on 2)

The electronic device of claim 2, the one or more programs further including instructions for:
in accordance with a determination that the electronic device is connected to a communication network, causing performance of the one or more actions to generate the result at the second electronic device; and
in accordance with a determination that the electronic device is not connected to a communication network, causing performance of the one or more actions to generate the result at the electronic device.

### Claim 14

A method, comprising:
at an electronic device with one or more processors and memory:
receiving a user utterance representing a user request;
determining, based on one or more words in the user utterance, a media file of the electronic device associated with the user request;
based on the user utterance and the media file, causing determination of one or more actions responsive to the user request, wherein causing determination of the one or more actions responsive to the user request includes:
in accordance with a determination that the electronic device is able to process the user utterance, determining the one or more actions responsive to the user request; and
in accordance with a determination that the electronic device is unable to process the user utterance:
transmitting data associated with the user utterance and the media file to a second electronic device; and
causing determination of the one or more actions responsive to the user request at the second electronic device; and
causing performance of the one or more actions, wherein performing the one or more actions generate a result based on the media file.

### Claim 15

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:
receiving a user utterance representing a user request;
determining, based on one or more words in the user utterance, a media file of the electronic device associated with the user request;
based on the user utterance and the media file, causing determination of one or more actions responsive to the user request, wherein causing determination of the one or more actions responsive to the user request includes:
in accordance with a determination that the electronic device is able to process the user utterance, determining the one or more actions responsive to the user request; and
in accordance with a determination that the electronic device is unable to process the user utterance:
transmitting data associated with the user utterance and the media file to a second electronic device; and
causing determination of the one or more actions responsive to the user request at the second electronic device; and
causing performance of the one or more actions, wherein performing the one or more actions generate a result based on the media file.
