# US 2019/0244618 A1 · Competing devices responding to voice triggers

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244618 A1
- Document ID: US20190244618A1
- Status: Published application
- Kind: A1
- Application number: 16/385,997
- Filed: 2019-04-16
- Published: 2019-08-08
- Earliest claimed: 2015-03-08
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Brandon J. NEWENDORP; Evan S. DIBIASE
- Web page: https://patentgrep.com/patent/US20190244618A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/32: Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
- G10L 2015/088: {Word spotting}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

At a first electronic device with a display and a microphone: sampling audio input using the first microphone; in accordance with the sampling of audio input using the first microphone, sending stop instructions to a second electronic device with a second microphone, the second electronic device external to the first electronic device, wherein the second electronic device is configured to respond to audio input received using the second microphone, and wherein the stop instructions instruct the second electronic device to forgo responding to audio input received using the second microphone, wherein responding to audio input received using the second microphone comprises providing perceptible output.

## Claims

### Claim 1

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first electronic device with a first microphone, cause the first electronic device to:
sample an audio input at the first microphone, wherein the audio input is sampled before initiating a virtual assistant session on a second electronic device with a second microphone, and wherein the second electronic device receives the audio input at the second microphone;
determine whether to respond to the audio input using the first electronic device or using the second electronic device based on a usage condition associated with the first electronic device;
in accordance with a determination to respond to the audio input using the first electronic device, send stop instructions to the second electronic device, the second electronic device external to the first electronic device,
wherein the second electronic device is configured to respond to the audio input received using the second microphone, and
wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone, wherein responding to the audio input received using the second microphone comprises providing perceptible output.

### Claim 2 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein;
the usage condition associated with the first electronic device includes whether a backlight of a display of the first electronic device is on; and
determining whether to respond to the audio input using the first electronic device or using the second electronic device includes determining to respond to the audio input using the first electronic device in accordance with a determination that the backlight of the display of the first electronic device is on.

### Claim 3 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein;
the usage condition associated with the first electronic device includes whether an input device of the first electronic device has been activated; and
determining whether to respond to the audio input using the first electronic device or using the second electronic device includes determining to respond to the audio input using the first electronic device in accordance with a determination that the input device of the first electronic device has been activated.

### Claim 4 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein;
the usage condition associated with the first electronic device includes whether the first electronic device detects movement meeting a predetermined condition; and
determining whether to respond to the audio input using the first electronic device or using the second electronic device includes determining to respond to the audio input using the first electronic device in accordance with a determination that the first electronic device detects movement meeting the predetermined condition.

### Claim 5 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein;
the usage condition associated with the first electronic device includes whether a virtual assistant session is actively executing in the foreground of a user interface of the first electronic device; and
determining whether to respond to the audio input using the first electronic device or using the second electronic device includes determining to respond to the audio input using the first electronic device in accordance with a determination that the virtual assistant session is actively executing in the foreground of the user interface of the first electronic device.

### Claim 6 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the first electronic device to:
determine whether the sampled audio input comprises a spoken trigger; and
initiate a virtual assistant session in accordance with a determination that the sampled audio input comprises the spoken trigger.

### Claim 7 (depends on 6)

The non-transitory computer readable storage medium of claim 6, wherein the spoken trigger comprises a predetermined phrase.

### Claim 8 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the first electronic device to:
cease sampling of a second audio input; and
in accordance with the ceasing of the sampling of the second audio input, send resume instructions to the second electronic device, wherein the resume instructions instruct the second electronic device to resume responding to the second audio input received using the second microphone.

### Claim 9 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the first electronic device to:
send the stop instructions or the resume instructions to the second electronic device using a stateless transmission mechanism.

### Claim 10 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein:
determining whether to respond to the audio input using the first electronic device or using the second electronic device includes maintaining a counter based on the usage condition associated with the first electronic device; and
sending the stop instructions includes sending the stop instructions in accordance with a determination that the counter exceeds a threshold value.

### Claim 11 (depends on 10)

The non-transitory computer readable storage medium of claim 10, wherein:
sending the resume instructions includes sending the resume instructions in accordance with a determination that the counter does not exceed the threshold value.

### Claim 12 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the second electronic device is configured to respond to the audio input received using the second microphone by:
sampling the audio input using the second microphone, and
initiating the virtual assistant session in accordance with a determination that the sampled audio input using the second microphone comprises a spoken trigger; and
wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone by forgoing the initiating of the virtual assistant session even if the sampled audio input using the second microphone comprises the spoken trigger.

### Claim 13 (depends on 12)

The non-transitory computer readable storage medium of claim 12, wherein sampling the audio input using the second microphone comprises:
determining whether the second electronic device is charging; and
in accordance with a determination that the second electronic device is charging, sampling the audio input using the first microphone.

### Claim 14 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the stop instructions comprise an indication of a time duration for which the second electronic device is to forgo responding to the audio input received using the second microphone.

### Claim 15 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the second electronic device is configured to:
after forgoing responding to the audio input received using the second microphone in accordance with receiving the stop instructions from the first electronic device:
resume responding to the audio input received using the second microphone.

### Claim 16 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the second electronic device is configured to:
in accordance with receiving the stop instructions while the second electronic device is responding to the audio input from the second microphone, cease responding to the audio input from the second microphone.

### Claim 17 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the second electronic device is configured to:
in accordance with receiving the stop instructions while the second electronic device is responding to the audio input received using the second microphone, provide an output indicating that the second electronic device is ceasing its response to the audio input from the second microphone.

### Claim 18 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein sampling the audio input at the first microphone comprises:
determining whether a predetermined service is actively executing on the first electronic device; and
in accordance with a determination that the predetermined service is actively executing, sampling the audio input at the first microphone.

### Claim 19 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein sampling the audio input at the first microphone comprises:
determining whether a predetermined service has been dismissed for longer than a predetermined duration of time; and
in accordance with a determination that the predetermined service has been dismissed for no longer than the predetermined duration of time, sampling the audio input at the first microphone.

### Claim 20 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the first electronic device to:
determine whether the sampled audio input comprises a spoken trigger;
in accordance with a determination that the sampled audio input comprises the spoken trigger, trigger a predetermined service; and
in accordance with a determination that the sampled audio input does not comprise the spoken trigger, forgo triggering of the predetermined service.

### Claim 21 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein sending the stop instructions includes sending the stop instructions as part of a transmission addressed to the second electronic device on an electronic communication channel.

### Claim 22 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein sending the stop instructions includes broadcasting the stop instructions on an electronic communication channel.

### Claim 23

A method, comprising:
at a first electronic device with a first microphone:
sampling an audio input at the first microphone, wherein the audio input is sampled before initiating a virtual assistant session on a second electronic device with a second microphone;
at the second electronic device: receiving the audio input at the second microphone;
at the first electronic device:
determining whether to respond to the audio input using the first electronic device or using the second electronic device based on a usage condition associated with the first electronic device;
in accordance with a determination to respond to the audio input using the first electronic device, sending stop instructions to the second electronic device, the second electronic device external to the first electronic device,
wherein the second electronic device is configured to respond to the audio input received using the second microphone, and
wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone, wherein responding to the audio input received using the second microphone comprises providing perceptible output.

### Claim 24

A first electronic device comprising:
one or more processors;
a memory;
a first microphone; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
sampling an audio input at the first microphone, wherein the audio input is sampled before initiating a virtual assistant session on a second electronic device with a second microphone, and wherein the second electronic device receives the audio input at the second microphone;
determining whether to respond to the audio input using the first electronic device or using the second electronic device based on a usage condition associated with the first electronic device;
in accordance with a determination to respond to the audio input using the first electronic device, sending stop instructions to the second electronic device, the second electronic device external to the first electronic device,
wherein the second electronic device is configured to respond to the audio input received using the second microphone, and
wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone, wherein responding to the audio input received using the second microphone comprises providing perceptible output.
