# US 2025/0168567 A1 · Method of waking a device using spoken voice commands

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168567 A1
- Document ID: US20250168567A1
- Status: Published application
- Kind: A1
- Application number: 19/026,149
- Filed: 2025-01-16
- Published: 2025-05-22
- Earliest claimed: 2020-03-27
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: David Thomas ROACH; Jean-Marc JOT; Jung-Suk LEE
- Web page: https://patentgrep.com/patent/US20250168567A1

## CPC

- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G10L 15/04: Segmentation; Word boundary detection
- G10L 15/08: Speech classification or search
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- H04R 1/406: {microphones}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 3/04: for correcting frequency response
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G10L 2015/088: {Word spotting}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2025/783: {based on threshold decision}
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed herein are systems and methods for processing speech signals in mixed reality applications. A method may include receiving an audio signal; determining, via first processors, whether the audio signal comprises a voice onset event; in accordance with a determination that the audio signal comprises the voice onset event: waking a second one or more processors; determining, via the second processors, that the audio signal comprises a predetermined trigger signal; in accordance with a determination that the audio signal comprises the predetermined trigger signal: waking third processors; performing, via the third processors, automatic speech recognition based on the audio signal; and in accordance with a determination that the audio signal does not comprise the predetermined trigger signal: forgoing waking the third processors; and in accordance with a determination that the audio signal does not comprise the voice onset event: forgoing waking the second processors.

## Claims

### Claim 1

A system comprising:
a head-wearable device configured to be worn by a user, the head-wearable device comprising:
a first microphone configured to rest at a first height with respect to the user's face when the head-wearable device is worn by the user;
a second microphone configured to rest at a second height with respect to the user's face when the head-wearable device is worn by the user, the second height different than the first height; and
one or more processors configured to perform a method comprising:
receiving, via the first microphone, a first microphone output based on an audio signal, the audio signal provided by the user;
receiving, via the second microphone, a second microphone output based on the audio signal;
determining, via a first processor of the one or more processors, whether the audio signal comprises a voice onset event;
in accordance with a determination that the audio signal comprises the voice onset event:
waking one or more second processors of the one or more processors;
determining, via the one or more second processors of the one or more processors, whether the audio signal comprises a predetermined trigger signal;
in accordance with a determination that the audio signal comprises the predetermined trigger signal:
performing, via the one or more second processors of the one or more processors, automatic speech recognition based on the audio signal; and
in accordance with a determination that the audio signal does not comprise the predetermined trigger signal:
forgoing performing the automatic speech recognition; and
in accordance with a determination that the audio signal does not comprise the voice onset event:
forgoing waking the one or more second processors of the one or more processors,
wherein said determining whether the audio signal comprises the voice onset event comprises determining a probability of voice activity with respect to the audio signal, wherein said determining the probability of voice activity comprises performing beamforming based on the first microphone output and the second microphone output.

### Claim 2 (depends on 1)

The system of claim 1, wherein the method further comprises:
in accordance with the determination that the audio signal comprises the predetermined trigger signal:
providing, via the one or more second processors, an audio stream based on the audio signal;
identifying an endpoint of the audio signal; and
ceasing to provide the audio stream in response to identifying the endpoint.

### Claim 3 (depends on 1)

The system of claim 1, wherein the first processor of the one or more processors comprises one or more of an application-specific integrated circuit or a digital signal processor, configured to determine whether the audio signal comprises the voice onset event.

### Claim 4 (depends on 1)

The system of claim 1, wherein the one or more second processors comprise one or more of a digital signal processor or an application-specific integrated circuit.

### Claim 5 (depends on 1)

The system of claim 1, wherein:
the head-wearable device comprises the first processor of the one or more processors and a second processor of the one or more second processors, and
the system further comprises an auxiliary unit comprising a third processor of the one or more second processors, wherein the auxiliary unit is external to the head-wearable device and configured to communicate with the head-wearable device.

### Claim 6 (depends on 1)

The system of claim 1, wherein the predetermined trigger signal comprises a phrase.

### Claim 7 (depends on 1)

The system of claim 1, wherein the method further comprises storing the audio signal in a buffer.

### Claim 8 (depends on 1)

The system of claim 1, wherein the method further comprises:
in accordance with the determination that the audio signal comprises the voice onset event: performing, via the one or more second processors, acoustic echo cancellation based on the audio signal.

### Claim 9 (depends on 1)

The system of claim 1, wherein the method further comprises:
in accordance with the determination that the audio signal comprises the voice onset event: performing, via the one or more second processors, beamforming based on the audio signal.

### Claim 10 (depends on 1)

The system of claim 1, wherein the method further comprises:
in accordance with the determination that the audio signal comprises the voice onset event: performing, via the one or more second processors, noise reduction based on the audio signal.

### Claim 11 (depends on 1)

The system of claim 1, wherein said determining whether the audio signal comprises the voice onset event further comprises determining an amount of voice activity in the audio signal.

### Claim 12 (depends on 11)

The system of claim 11, wherein said determining whether the audio signal comprises the voice onset event further comprises determining whether the amount of voice activity in the audio signal is greater than a voice activity threshold.

### Claim 13 (depends on 1)

The system of claim 1, wherein said determining whether the audio signal comprises the voice onset event comprises determining whether the audio signal comprises a voice of the user.

### Claim 14 (depends on 1)

The system of claim 1, wherein a difference between the first microphone output and the second microphone output indicates whether the audio signal comprises a voice of the user.

### Claim 15 (depends on 1)

The system of claim 1, wherein said determining whether the audio signal comprises the voice onset event further comprises determining a second probability of voice activity with respect to the audio signal based on the first microphone output.

### Claim 16

A method comprising:
receiving, via a first microphone, a first microphone output based on an audio signal, the audio signal provided by a user;
receiving, via a second microphone, a second microphone output based on the audio signal;
determining, via a first processor of one or more processors, whether the audio signal comprises a voice onset event;
in accordance with a determination that the audio signal comprises the voice onset event:
waking one or more second processors of the one or more processors;
determining, via the one or more second processors of the one or more processors, whether the audio signal comprises a predetermined trigger signal;
in accordance with a determination that the audio signal comprises the predetermined trigger signal:
performing, via the one or more second processors of the one or more processors, automatic speech recognition based on the audio signal; and
in accordance with a determination that the audio signal does not comprise the predetermined trigger signal:
forgoing performing the automatic speech recognition; and
in accordance with a determination that the audio signal does not comprise the voice onset event:
forgoing waking the one or more second processors of the one or more processors, wherein:
a head-wearable device comprises the first microphone and further comprises the second microphone,
the first microphone is configured to rest at a first height with respect to the user's face when the head-wearable device is worn by the user,
the second microphone is configured to rest at a second height with respect to the user's face when the head-wearable device is worn by the user, the second height different than the first height, and
said determining whether the audio signal comprises the voice onset event comprises determining a probability of voice activity with respect to the audio signal, wherein the determining the probability of voice activity comprises performing beamforming based on the first microphone output and the second microphone output.

### Claim 17 (depends on 16)

The method of claim 16, wherein the predetermined trigger signal comprises a phrase.

### Claim 18

The method of method 16, further comprising storing the audio signal in a buffer.

### Claim 19 (depends on 16)

The method of claim 16, further comprising determining, based on a difference between the first microphone output and the second microphone output, whether the audio signal comprises a voice of the user.

### Claim 20

A non-transitory computer-readable medium storing instructions, which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving, via a first microphone, a first microphone output based on an audio signal, the audio signal provided by a user;
receiving, via a second microphone, a second microphone output based on the audio signal;
determining, via a first processor of one or more processors, whether the audio signal comprises a voice onset event;
in accordance with a determination that the audio signal comprises the voice onset event:
waking one or more second processors of the one or more processors;
determining, via the one or more second processors of the one or more processors, whether the audio signal comprises a predetermined trigger signal;
in accordance with a determination that the audio signal comprises the predetermined trigger signal:
performing, via the one or more second processors of the one or more processors, automatic speech recognition based on the audio signal; and
in accordance with a determination that the audio signal does not comprise the predetermined trigger signal:
forgoing performing the automatic speech recognition; and
in accordance with a determination that the audio signal does not comprise the voice onset event:
forgoing waking the one or more second processors of the one or more processors, wherein:
a head-wearable device comprises the first microphone and further comprises the second microphone,
the first microphone is configured to rest at a first height with respect to the user's face when the head-wearable device is worn by the user,
the second microphone is configured to rest at a second height with respect to the user's face when the head-wearable device is worn by the user, the second height different than the first height, and
said determining whether the audio signal comprises the voice onset event comprises determining a probability of voice activity with respect to the audio signal, wherein the determining the probability of voice activity comprises performing beamforming based on the first microphone output and the second microphone output.
