US 2021/0174787 A1 · INTERACTIVE AUGMENTATION AND INTEGRATION OF REAL-TIME SPEECH-TO-TEXT

Abstract

In non-limiting examples of the present disclosure, systems, methods and devices for integrating speech-to-text transcription in a productivity application are presented. A request to access a real-time speech-to-text transcription of an audio signal that is being received by a second device is sent by a first device. The real-time speech-to-text transcription may be surfaced in a transcription pane of a productivity application on the first device. A request to translate the transcription to a different language may be received. The transcription may be translated in real-time and surfaced in the transcription pane. A selection of a word in the surfaced transcription may be received. A request to drag the word from the transcription pane and drop it in a window in the productivity application outside of the transcription pane may be received. The word may be surfaced in the window in the productivity application outside of the transcription pane.

Claims20

Dependent claims

A computer-implemented method for integrating speech-to-text transcription in a productivity application, the computer-implemented method comprising:

sending, by a first device, a request to access a real-time speech-to-text transcription of an audio signal that is currently being received by a second device;
causing the real-time speech-to-text transcription to be surfaced in a transcription pane of a productivity application user interface on the first device;
receiving a selection of a word in the surfaced transcription;
receiving a request to drag the word from the transcription pane and drop it in a window in the productivity application outside of the transcription pane;
and
causing the word to be surfaced in the window in the productivity application outside of the transcription pane.

3 more elements

A system for integrating speech-to-text transcription in a productivity application, comprising:

a memory for storing executable program code;
and
one or more processors, functionally coupled to the memory, the one or more processors being responsive to computer-executable instructions contained in the program code and operative to:
send, by a first device, a request to access a real-time speech-to-text transcription of an audio signal that is currently being received by a second device;
cause the real-time speech-to-text transcription to be surfaced in a transcription pane of a productivity application user interface on the first device;
receive a selection of a word in the surfaced transcription;
receive a request to drag the word from the transcription pane and drop it in a window in the productivity application outside of the transcription pane;
and
cause the word to be surfaced in the window in the productivity application outside of the transcription pane.

6 more elements

A computer-readable storage device comprising executable instructions that, when executed by one or more processors, assist with integrating speech-to-text transcription in a productivity application, the computer-readable storage device including instructions executable by the one or more processors for:

sending, by a first device, a request to access a real-time speech-to-text transcription of an audio signal that is currently being received by a second device;
causing the real-time speech-to-text transcription to be surfaced in a transcription pane of a productivity application user interface on the first device;
receiving a selection of a word in the surfaced transcription;
receiving a request to transfer the word from the transcription pane and to a window in the productivity application outside of the transcription pane;
and
causing the word to be automatically surfaced in the window in the productivity application outside of the transcription pane.

3 more elements

Dependencies are inferred from the claim text.

Interactive augmentation and integration of real-time speech-to-text

Life of this patent

Interactive augmentation and integration of real-time speech-to-text

Life of this patent

Abstract

Claims20