# US 10,373,630 B2 · Systems and methods for energy efficient and low power distributed automatic speech recognition on wearable devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,373,630 B2
- Document ID: US10373630B2
- Status: Granted
- Kind: B2
- Application number: 15/475,329
- Filed: 2017-03-31
- Published: 2018-10-04
- Granted: 2019-08-06
- Earliest claimed: 2017-03-31
- Assignees: Intel Corporation
- Applicants: Binuraj K. Ravindran; Francis M. Tharappel; Prabhakar R. Datta; Tobias Bocklet; Maciej Muchlinski; Tomasz Dorau; Josef G. Bauer; Saurin Shah; Georg Stemmer
- Inventors: Binuraj K. Ravindran; Francis M. Tharappel; Prabhakar R. Datta; Tobias Bocklet; Maciej Muchlinski; Tomasz Dorau; Josef G. Bauer; Saurin Shah; Georg Stemmer
- Web page: https://patentgrep.com/patent/US10373630B2

## CPC

- G10L 25/24: the extracted parameters being the cepstrum
- G10L 15/08: Speech classification or search
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 19/032: Quantisation or dequantisation of spectral components
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L 2015/088: {Word spotting}
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Methods, apparatus, systems and articles of manufacture are disclosed for distributed automatic speech recognition. An example apparatus includes a detector to process an input audio signal and identify a portion of the input audio signal including a sound to be evaluated, the sound to be evaluated organized into a plurality of audio features representing the sound. The example apparatus includes a quantizer to process the audio features using a quantization process to reduce the audio features to generate a reduced set of audio features for transmission. The example apparatus includes a transmitter to transmit the reduced set of audio features over a low-energy communication channel for processing.

## Claims

### Claim 1

An apparatus comprising:
a voice-activated detector;
a key phrase detector;
a quantizer; and
a transmitter,
the voice-activated detector to activate the key phrase detector when an input audio signal is detected,
the key phrase detector to, when activated, identify a portion of the input audio signal including a sound to be evaluated, the sound to be evaluated organized into a plurality of audio features representing the sound, the key phrase detector to activate the quantizer and the transmitter when the sound to be evaluated is identified in the input audio signal,
the quantizer to, when activated, reduce the audio features to generate a reduced set of audio features; and
the transmitter to, when activated, transmit the reduced set of audio features over a low-energy communication channel.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the low-energy communication channel includes a Bluetooth Low Energy communication channel.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the audio features include mel frequency cepstral coefficients (MFCCs).

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the quantizer is to reduce the audio features by reducing a number of the audio features.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the quantizer is to reduce the number of the audio features from 23 audio features to 13 audio features.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the quantizer is to reduce the audio features by reducing a bit size for each of the audio features.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the quantizer is to reduce the bit size by applying an A-law algorithm to encode bits of each audio feature according to a compression parameter.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein the quantizer is to reduce the bit size by discarding one or more bits of each audio feature.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the quantizer is to discard 7 least significant bits and one most significant bit of each audio feature.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the apparatus includes a wearable device.

### Claim 11 (depends on 1)

The apparatus of claim 1, further including a feature extractor to extract the audio features from the sound identified by the key phrase detector.

### Claim 12 (depends on 1)

The apparatus of claim 1, further including a companion device to process the reduced set of audio features received from the transmitter.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the companion device includes a dequantization engine and an automated speech recognition engine to process the reduced set of audio features to extract and evaluate the sound associated with the reduced set of audio features.

### Claim 14 (depends on 12)

The apparatus of claim 12, wherein the companion device includes at least one of a cellular phone or a gateway device.

### Claim 15 (depends on 1)

The apparatus of claim 1, wherein the sound to be evaluated is to include speech.

### Claim 16 (depends on 1)

The apparatus of claim 1, further including a feature extractor to extract the audio features from the portion identified by the key phrase detector.

### Claim 17 (depends on 1)

The apparatus of claim 1, further including a compressor to compress the reduced set of audio features for transmission by the transmitter.

### Claim 18 (depends on 1)

The apparatus of claim 1, further including a microphone to detect the input audio signal.

### Claim 19

A method comprising:
activating a first process to be executed by a voice-activated detector when an input audio signal is detected;
identifying, by executing an instruction of the first process with the voice-activated detector, a portion of the input audio signal including a sound to be evaluated;
activating a second process to be executed by a key phrase detector when the sound to be evaluated is identified;
activating, by executing an instruction of the second process with the key phrase detector, a quantizer and a transmitter when the sound to be evaluated is identified in the input audio signal;
organizing, by executing an instruction of the second process with the key phrase detector, the sound to be evaluated into a plurality of audio features representing the sound;
reducing, by executing an instruction of a third process with the quantizer, the audio features to generate a reduced set of audio features; and
transmitting, using the transmitter, the reduced set of audio features over a low-energy communication channel.

### Claim 20 (depends on 19)

The method of claim 19, wherein the low-energy communication channel includes a Bluetooth Low Energy communication channel.

### Claim 21 (depends on 19)

The method of claim 19, wherein the audio features include mel frequency cepstral coefficients (MFCCs).

### Claim 22 (depends on 19)

The method of claim 19, wherein the reducing of the audio features includes reducing a number of audio features.

### Claim 23 (depends on 22)

The method of claim 22, wherein the reducing of the number of audio features includes reducing 23 audio features to 13 audio features.

### Claim 24 (depends on 19)

The method of claim 19, wherein the reducing of the audio features includes reducing a bit size for each of the audio features.

### Claim 25 (depends on 24)

The method of claim 24, wherein the reducing of the bit size includes applying an A-law algorithm to encode bits of each audio feature according to a compression parameter.

### Claim 26 (depends on 24)

The method of claim 24, wherein the reducing of the bit size includes discarding one or more bits of each audio feature.

### Claim 27 (depends on 19)

The method of claim 19, further including processing the reduced set of audio features using a companion device to extract and evaluate the sound associated with the reduced set of audio features.

### Claim 28

A tangible computer readable storage medium comprising computer readable instructions which, when executed, cause a voice-activated detector implemented by a processor to at least:
in response to detection of an input audio signal:
activate a key phrase detector to:
identify a portion of the input audio signal including a sound to be evaluated; and
in response to identification of the sound to be evaluated:
activate a quantizer and a transmitter;
organize the sound to be evaluated into a plurality of audio features representing the sound;
instruct the quantizer to reduce the audio features based on a quantization process to generate a reduced set of audio features; and
instruct the transmitter to transmit the reduced set of audio features over a low-energy communication channel.

### Claim 29

A wearable apparatus comprising:
a voice-activated detector to activate a key phrase detector, a quantizer, and a transmitter when an input audio signal is detected;
the key phrase detector which, when activated, is to identify a portion of the input audio signal including a sound to be evaluated, the sound to be evaluated organized into a plurality of audio features representing the sound;
the quantizer which, when activated, is to reduce the audio features to generate a reduced set of audio features; and
the transmitter which, when activated, is to transmit the reduced set of audio features over a low-energy communication channel to a companion device for dequantization of the reduced set of audio features to extract speech information from the reduced set of audio features.
