# US 2022/0028398 A1 · Secure enterprise access with voice assistant devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0028398 A1
- Document ID: US20220028398A1
- Status: Published application
- Kind: A1
- Application number: 17/016,367
- Filed: 2020-09-09
- Published: 2022-01-27
- Earliest claimed: 2020-09-09
- Assignees: VMware, Inc.
- Applicants: Vmware, Inc.
- Inventors: SUMAN ALUVALA; Ramani Panchapakesan; Rohit Pradeep Shetty; Arjun Kochhar
- Web page: https://patentgrep.com/patent/US20220028398A1

## CPC

- G10L 17/04: Training, enrolment or model building
- H04L 67/63: Routing a service request depending on the request content or context
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 17/22: Interactive procedures; Man-machine interfaces
- H04L 67/125: involving control of end-device applications over a network
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 2015/221: {Announcement of recognition results}
- G10L 2015/227: {of the speaker; Human-factor methodology}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods are provided for optimizing and securing an enterprise voice service accessed by an external voice assistant device. An enterprise voice assistant installed on a client device acts as an enterprise voice service for an external voice assistant device. The enterprise voice assistant receives a voice query from the external voice assistant device. The voice query is processed using a machine learning model to extract an intent and at least one slot. The extracted intent and at least one slot are used to determine whether a response to the voice query can be generated using local enterprise data that was previously received and stored by the client device from a management server. The response is generated based on the determination by using the local enterprise data or by sending the extracted intent and at least one slot to and receiving the response from the management server.

## Claims

### Claim 1

A system for securely accessing enterprise data using an external voice assistant device comprising:
a memory storage including a non-transitory, computer-readable medium comprising instructions; and
a processor that executes the instructions to carry out stages comprising:
receiving, at a client device, a voice query from the external voice assistant device over a first network, wherein the client device acts voice service for the external voice assistant device in connection with a wake word;
processing the voice query at the client device to extract an intent and at least one slot from the voice query;
determining whether a response to the voice query can be generated using local enterprise data on the client device, wherein the local enterprise data is previously received and managed as part of a unified endpoint management (“UEM”) system; and
generating the response to the voice query based on the determination.

### Claim 2 (depends on 1)

The system of claim 1, wherein the determination includes:
querying a local application based on the intent and slot; and
receiving a result from the local application that includes the local enterprise data, wherein the generated response includes at least a portion of the result.

### Claim 3 (depends on 1)

The system of claim 1, wherein generating the response to the voice query further comprises:
transmitting the extracted intent and at least one slot to a management server over the first network; and
receiving the response to the voice query from the management server over the first network.

### Claim 4 (depends on 1)

The system of claim 1, wherein generating the response to the voice query further comprises:
determining that the first network is unavailable;
transmitting the extracted intent and at least one slot to a management server over a second network; and
receiving the response to the voice query from the management server over the second network.

### Claim 5 (depends on 1)

The system of claim 1, wherein generating the response to the voice query further comprises:
determining that the first network is unavailable;
storing the extracted intent and at least one slot in the memory storage;
transmitting the extracted intent and at least one slot to a management server over the first network when the first network becomes available; and
receiving the response to the voice query from the management server over the first network.

### Claim 6 (depends on 1)

The system of claim 1, the stages further comprising forming a communication path between the client device and the external voice assistant device using a local discovery protocol.

### Claim 7 (depends on 1)

The system of claim 1, the stages further comprising, prior to generating the response, authenticating a speaker of the voice query by comparing the voice query with a voice sample stored in the memory storage.

### Claim 8

A non-transitory, computer-readable medium comprising instructions that, when executed by a processor of a client device, perform stages for securely accessing enterprise data using an external voice assistant device, the stages comprising:
receiving, at a client device, a voice query from the external voice assistant device over a first network, wherein the client device acts voice service for the external voice assistant device in connection with a wake word;
processing the voice query at the client device to extract an intent and at least one slot from the voice query;
determining whether a response to the voice query can be generated using local enterprise data on the client device, wherein the local enterprise data is previously received and managed as part of a unified endpoint management (“UEM”) system; and
generating the response to the voice query based on the determination.

### Claim 9 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein the determination includes:
querying a local application based on the intent and slot; and
receiving a result from the local application that includes the local enterprise data, wherein the generated response includes at least a portion of the result.

### Claim 10 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein generating the response to the voice query further comprises:
transmitting the extracted intent and at least one slot to a management server over the first network; and
receiving the response to the voice query from the management server over the first network.

### Claim 11 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein generating the response to the voice query further comprises:
determining that the first network is unavailable;
transmitting the extracted intent and at least one slot to a management server over a second network; and
receiving the response to the voice query from the management server over the second network.

### Claim 12 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein generating the response to the voice query further comprises:
determining that the first network is unavailable;
storing the extracted intent and at least one slot in the memory storage;
transmitting the extracted intent and at least one slot to a management server over the first network when the first network becomes available; and
receiving the response to the voice query from the management server over the first network.

### Claim 13 (depends on 8)

The non-transitory, computer-readable medium of claim 8, the stages further comprising forming a communication path between the client device and the external voice assistant device using a local discovery protocol.

### Claim 14 (depends on 8)

The non-transitory, computer-readable medium of claim 8, the stages further comprising, prior to generating the response, authenticating a speaker of the voice query by comparing the voice query with a voice sample stored in the memory storage.

### Claim 15

A method for securely accessing enterprise data using an external voice assistant device comprising:
receiving, at a client device, a voice query from the external voice assistant device over a first network, wherein the client device acts voice service for the external voice assistant device in connection with a wake word;
processing the voice query at the client device to extract an intent and at least one slot from the voice query;
determining whether a response to the voice query can be generated using local enterprise data on the client device, wherein the local enterprise data is previously received and managed as part of a unified endpoint management (“UEM”) system; and
generating the response to the voice query based on the determination.

### Claim 16 (depends on 15)

The method of claim 15, wherein the determination includes:
querying a local application based on the intent and slot; and
receiving a result from the local application that includes the local enterprise data, wherein the generated response includes at least a portion of the result.

### Claim 17 (depends on 15)

The method of claim 15, wherein generating the response to the voice query further comprises:
transmitting the extracted intent and at least one slot to a management server over the first network; and
receiving the response to the voice query from the management server over the first network.

### Claim 18 (depends on 15)

The method of claim 15, wherein generating the response to the voice query further comprises:
determining that the first network is unavailable;
transmitting the extracted intent and at least one slot to a management server over a second network; and
receiving the response to the voice query from the management server over the second network.

### Claim 19 (depends on 15)

The method of claim 15, wherein generating the response to the voice query further comprises:
determining that the first network is unavailable;
storing the extracted intent and at least one slot in the memory storage;
transmitting the extracted intent and at least one slot to a management server over the first network when the first network becomes available; and
receiving the response to the voice query from the management server over the first network.

### Claim 20 (depends on 15)

The method of claim 15, stages further comprising, prior to generating the response, authenticating a speaker of the voice query by comparing the voice query with a voice sample stored in the memory storage.
