# US 2024/0203420 A1 · Hybrid local and global processing of voice requests from users

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203420 A1
- Document ID: US20240203420A1
- Status: Published application
- Kind: A1
- Application number: 18/065,843
- Filed: 2022-12-14
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: Robert C. Hernandez; Uboho Victor
- Web page: https://patentgrep.com/patent/US20240203420A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 15/18: using natural language modelling
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods described herein may provide a system that enables hybrid local and global processing of voice requests from a user. A computing device may receive audio data containing a voice request from a user and may determine, using a local intent engine, a local intent prediction based on the voice request. The computing device may determine that the local intent prediction has a confidence measure that is less than a predetermined threshold and may, in response, transmit data containing the voice request to a global intent engine. The computing device may receive a global intent prediction from the global intent engine and may determine a corresponding computing process based on the global intent prediction.

## Claims

### Claim 1

A method, comprising:
receiving, at a first computing device, audio data containing a voice request from a user;
determining, using a local intent engine executing on the first computing device, a local intent prediction based on the voice request;
determining that a first confidence measure for the local intent prediction is less than a predetermined threshold;
transmitting data containing the voice request to a global intent engine executing on a second computing device;
receiving, from the global intent engine, a global intent prediction based on the voice request;
determining, based on the global intent prediction, a corresponding computing process; and
executing the corresponding computing process.

### Claim 2 (depends on 1)

The method of claim 1, wherein the local intent prediction includes a first predicted intent of the user indicated by the voice request, and wherein the first confidence measure is for the first predicted intent.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining that the first confidence measure is less than a predetermined threshold, wherein the data containing the voice request is transmitted to the global intent engine in response to determining that the first confidence measure is less than the predetermined threshold.

### Claim 4 (depends on 1)

The method of claim 1, wherein the global intent prediction includes (i) a second predicted intent of the user indicated by the voice request and (ii) a second confidence measure for the second predicted intent.

### Claim 5 (depends on 4)

The method of claim 4, wherein determining the corresponding computing process further comprises:
determining that the second confidence measure is greater than or equal to a predetermined threshold; and
identifying the corresponding computing process as corresponding to the second predicted intent.

### Claim 6 (depends on 4)

The method of claim 4, wherein determining the corresponding computing process further comprises:
determining that the second confidence measure is less than a predetermined threshold; and
requesting additional user input to indicate the corresponding computing process.

### Claim 7 (depends on 6)

The method of claim 6, further comprising updating, based on the additional user input, at least one of the local intent engine and the global intent engine.

### Claim 8 (depends on 1)

The method of claim 1, further comprising, before determining the local intent prediction:
generating, based on the audio data, a text containing the voice request, wherein the text is provided to the local intent engine to determine the local intent prediction.

### Claim 9 (depends on 1)

The method of claim 1, wherein the local intent engine is a machine learning model trained based on previous requests received by the first computing device from the user.

### Claim 10

An information handling system, comprising:
a memory; and
a processor coupled to the memory, wherein the processor is configured to perform steps comprising:
receiving, at a first computing device, audio data containing a voice request from a user;
determining, using a local intent engine executing on the first computing device, a local intent prediction based on the voice request;
determining that a first confidence measure for the local intent prediction is less than a predetermined threshold;
transmitting data containing the voice request to a global intent engine executing on a second computing device;
receiving, from the global intent engine, a global intent prediction based on the voice request;
determining, based on the global intent prediction, a corresponding computing process; and
executing the corresponding computing process.

### Claim 11 (depends on 10)

The information handling system of claim 10, wherein the local intent prediction includes a first predicted intent of the user indicated by the voice request, and wherein the first confidence measure is for the first predicted intent.

### Claim 12 (depends on 10)

The information handling system of claim 10, wherein the steps further comprise:
determining that the first confidence measure is less than a predetermined threshold, wherein the data containing the voice request is transmitted to the global intent engine in response to determining that the first confidence measure is less than the predetermined threshold.

### Claim 13 (depends on 10)

The information handling system of claim 10, wherein the global intent prediction includes (i) a second predicted intent of the user indicated by the voice request and (ii) a second confidence measure for the second predicted intent.

### Claim 14 (depends on 13)

The information handling system of claim 13, wherein determining the corresponding computing process further comprises:
determining that the second confidence measure is greater than or equal to a predetermined threshold; and
identifying the corresponding computing process as corresponding to the second predicted intent.

### Claim 15 (depends on 13)

The information handling system of claim 13, wherein determining the corresponding computing process further comprises:
determining that the second confidence measure is less than a predetermined threshold; and
requesting additional user input to indicate the corresponding computing process.

### Claim 16

A computer program product, comprising:
a non-transitory computer readable medium comprising code which, when executed by a processor, causes the processor to perform steps comprising:
receiving, at a first computing device, audio data containing a voice request from a user;
determining, using a local intent engine executing on the first computing device, a local intent prediction based on the voice request;
determining that a first confidence measure for the local intent prediction is less than a predetermined threshold;
transmitting data containing the voice request to a global intent engine executing on a second computing device;
receiving, from the global intent engine, a global intent prediction based on the voice request;
determining, based on the global intent prediction, a corresponding computing process; and
executing the corresponding computing process.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein the local intent prediction includes a first predicted intent of the user indicated by the voice request, and wherein the first confidence measure is for the first predicted intent.

### Claim 18 (depends on 16)

The computer program product of claim 16, wherein the steps further comprise:
determining that the first confidence measure is less than a predetermined threshold, wherein the data containing the voice request is transmitted to the global intent engine in response to determining that the first confidence measure is less than the predetermined threshold.

### Claim 19 (depends on 16)

The computer program product of claim 16, wherein the global intent prediction includes (i) a second predicted intent of the user indicated by the voice request and (ii) a second confidence measure for the second predicted intent.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein determining the corresponding computing process further comprises:
determining that the second confidence measure is greater than or equal to a predetermined threshold; and
identifying the corresponding computing process as corresponding to the second predicted intent.
