# US 2021/0241761 A1 · Virtualized Speech in a Distributed Network Environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241761 A1
- Document ID: US20210241761A1
- Status: Published application
- Kind: A1
- Application number: 16/782,470
- Filed: 2020-02-05
- Published: 2021-08-05
- Earliest claimed: 2020-02-05
- Assignees: Citrix Systems, Inc.
- Applicants: Citrix Systems, Inc.
- Inventors: Pawan Kumar Dixit; Dinesh Jidugu
- Web page: https://patentgrep.com/patent/US20210241761A1

## CPC

- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F 9/453: {Help systems}
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 19/0018: {Speech coding using phonetic or linguistical decoding of the source; Reconstruction using text-to-speech synthesis}
- H04L 47/82: {Miscellaneous aspects}
- H04L 67/141: Setup of application sessions (admission control or resource allocation in data switching networks H04L47/70)
- G10L 2015/223: {Execution procedure of a spoken command}
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Aspects of the disclosure relate to various systems and techniques that provide for a method and apparatus for transmitting speech as text to a remote server and converting the text stream back to speech for delivery to a remote application. For example, a person, through workspace virtualization, is accessing a remote application that accepts speech as its input. The user, using a microphone, would speak into the microphone where the speech would be converted into text with a local speech-to-text converter. The text version of speech is sent to a remote server, which converts the text back to speech using a remote server based text-to-speech converter where the reconstructed speech is usable as input to a remote application or device.

## Claims

### Claim 1

A method for reducing transmission bandwidth for speech data, comprising:
providing, by a server to a remote client device, via a connection between the server with an application on the remote client device, access to a speech-enabled application executable on the server;
receiving, by the server, text data from the application on the remote client device, a text data representative of an audio input received by the remote client device and being identified as an input for the speech-enabled application;
converting, by the server, the received text data back to an audio input; and
providing, by the server, the converted audio input to the speech-enabled application, to prevent one or more errors in an audio input of the speech-enabled application caused by use of audio files that have been distorted due to transmission of the audio files from the remote client device to the speech-enabled application.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving, by the server, a machine generated speech from the speech-enabled application;
converting, by the server, the machine generated speech into second text data; and
sending, by the server to the remote client device via the application, the second text data.

### Claim 3 (depends on 2)

The method of claim 2, wherein the machine generated speech received by the server is in response to the converted audio input provided by the server to the speech-enabled application.

### Claim 4 (depends on 1)

The method of claim 1, wherein the speech-enabled application comprises a virtual assistant configured to accept the converted audio input.

### Claim 5 (depends on 1)

The method of claim 1, wherein the speech-enabled application comprises a word processing program configured to accept the converted audio input.

### Claim 6 (depends on 1)

The method of claim 1, wherein the server comprises speech recognition.

### Claim 7 (depends on 1)

The method of claim 1, wherein the server comprises a virtualization server.

### Claim 8 (depends on 1)

The method of claim 1, further comprising receiving user input to modify the text data prior to being converted.

### Claim 9 (depends on 1)

The method of claim 1, wherein the application executing on the remote client device facilitates establishing a connection between the server and the remote client device.

### Claim 10

A method comprising:
receiving, by a client computing device, a speech input associated with a user;
converting, by an application on the client computing device, the speech input into text data; and
sending, by the application executing on the client computing device, the text data to a speech-enabled application executable on a remote server, via a connection between the remote server with the application executing on the client computing device, to prevent errors in an audio input to the speech-enabled application caused by use of audio that have been distorted due to transmission of the audio from the client computing device to the speech-enabled application.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
receiving, by the application executing on the client computing device, second text data from the remote server;
converting, by the application executing on the client computing device, the second text data to second speech; and
outputting, by the application executing on the client computing device, the second speech as a response to the speech input.

### Claim 12 (depends on 11)

The method of claim 11, further comprising receiving, by the user, the second speech.

### Claim 13 (depends on 10)

The method of claim 10, wherein the application executing on the client computing device comprises a speech recognition engine.

### Claim 14 (depends on 10)

The method of claim 10, wherein the remote server comprises a remote virtualization server.

### Claim 15 (depends on 10)

The method of claim 10, further comprising accepting input from the user to modify the text data prior to the sending, by the application executing on the client computing device, the text data.

### Claim 16 (depends on 10)

The method of claim 10, wherein the receiving the speech input comprises receiving the speech input through a lossy speech encoder.

### Claim 17 (depends on 10)

The method of claim 10, wherein the application on the client computing device facilitates establishing a connection between the remote server and the client computing device.

### Claim 18

A server device, comprising:
a processor; and
memory storing computer-readable instructions that, when executed by the processor, cause the server device to;
provide, via a connection between the server with an application on a remote client device, access to a speech-enabled application executable on the server;
receive, text data from the application executing on the remote client device, a text data representative of an audio input received by the remote client device and being identified as an input for the speech-enabled application;
convert the received text data back to an audio input; and
provide the converted audio input to the speech-enabled application, to prevent errors in an audio output of the speech-enabled application caused by use of audio files that have been distorted due to transmission of the audio files from the remote client device to the speech-enabled application.

### Claim 19 (depends on 18)

The server device of claim 18, wherein the speech-enabled application comprises a virtual assistant configured to receive the converted audio and perform an action.

### Claim 20 (depends on 18)

The server device of claim 18, wherein the memory stores additional computer-readable instructions that, when executed by the processor, cause the server device to:
receive a machine generated speech from the speech-enabled application;
convert the machine generated speech into second text data; and
send, to the remote client device via the application, the second text data.
