US 2022/0028394 A1 · SEMIAUTOMATED RELAY METHOD AND APPARATUS

Abstract

A captioning relay for captioning hearing user (HU) voice signals comprising a plurality of separate captioning resources and a captioning administrator module that receives HU voice signal segments corresponding to a plurality of separate ongoing calls between HUs and AUs and provides the voice signal segments in a first in, first out order to the captioning resources, the administrator module providing each voice signal segment from each call to any one of the captioning resources to be captioned without regard to which captioning resource captioned prior voice signal segments generated during the call and, the administrator module further receiving caption segments back from the captioning resources and providing those captioning segments to AU devices associated with the calls that generated corresponding HU voice signal segments, and wherein the number of captioning resources is less than the number of ongoing calls.

Claims21

Dependent claims

A captioning method for providing captioning services to an assisted user (AU) using an AU device to communicate via voice with a hearing user using a HU device, the AU device including a display for presenting captions corresponding to voice signal during an AU-HU communication session, the method for use with a captioning system including at least a first captioning resource type required to facilitate a first captioning process and a second captioning resource type required to facilitate a second captioning process, wherein the first captioning process is a revoicing captioning process, the method comprising the steps of, during a first AU-HU communication session:

receiving a first voice signal;
determining a first availability of the first captioning resource type;
selecting, based at least in part on the first availability of the first captioning resource type, a first resource of the first captioning resource type instead of a resource of the second captioning resource type to generate a transcript of the first voice signal;
obtaining revoiced audio generated by a revoicing of the first voice signal by a captioning assistant (CA);
generating first caption text corresponding to the revoiced first voice signal using a first automatic speech recognition (ASR) system;
and
transmitting the first caption text to the AU device.

4 more elements

A captioning method for providing captioning services to an assisted user (AU) using an AU device to communicate via voice with a hearing user using a HU device, the AU device including a display for presenting captions corresponding to voice signal during an AU-HU communication session, the method for use with a captioning system including at least a first captioning resource type required to facilitate a first captioning process and a second captioning resource type required to facilitate a second captioning process, wherein the second captioning process is a revoicing captioning process, the method comprising the steps of, during a first AU-HU communication session:

receiving a first voice signal;
determining a first availability of the second captioning resource type;
selecting, based at least in part on the first availability of the second captioning resource type, a first resource of the first captioning resource type instead of a resource of the second captioning resource type to generate a transcript of the first voice signal;
generating first caption text corresponding to the first voice signal using a first automatic speech recognition (ASR) system associated with the selected first resource;
and
transmitting the first caption text to the AU device.

3 more elements

receiving a first voice signal;
determining a first availability of the first captioning resource type;
based at least in part on the first availability of the first captioning resource type, selecting one of:
(i) a first resource of the first captioning resource type instead of a resource of the second captioning resource type to generate text captions of the first voice signal;
and
(ii) a second resource of the second captioning resource type to generate text captions of the first voice signal;
in response to selecting the first resource:
(a) obtaining revoiced audio generated by a revoicing of the first voice signal by a captioning assistant (CA);
(b) generating first caption text corresponding to the revoiced first voice signal using a first automatic speech recognition (ASR) engine;
and
transmitting the first caption text to the AU device;
and
in response to selecting the second resource:
(a) generating first caption text corresponding to the first voice signal using a second ASR engine.

11 more elements

Dependencies are inferred from the claim text.

Semiautomated relay method and apparatus

Life of this patent

Semiautomated relay method and apparatus

Life of this patent

Abstract

Claims21