US 12,431,123 B2 · Transcription knowledge graph

Abstract

Some embodiments include a transcription knowledge graph that can resolve automatic speech recognition (ASR) engine output errors. In some embodiments, a transcription knowledge graph can utilize data from past sessions of the ASR engine to form a voice graph that can be analyzed to determine a correlation between a mis-transcription (error text) and the correct transcription (correct text). Thus, ASR engine outputs, even if they include a mis-transcription, can be adjusted to the correct transcription. Further, the correct transcriptions and the voice graph can be used to train machine learning (ML) algorithms to generate numerical representations of an entity. The ML algorithms can be applied to a transcription to correctly identify a corresponding entity label, even if the transcription was not utilized in the voice graph to train the ML algorithm.

Claims20

Dependent claims

A computer-implemented method for correcting automatic speech recognition (ASR) engine output, comprising:

receiving, by at least one computer processor, a transcription comprising media content, wherein the transcription is generated via an ASR engine;
generating a voice graph based at least on previous ASR transcriptions of n-best outputs, where n is an integer,
wherein the voice graph comprises n nodes and at least (n−1) edges, wherein a first node of the n nodes corresponds to a top-1 transcript, and an nth node corresponds to a top-n transcript, where n>=2, and wherein an (n−1) edge of the at least (n−1) edges corresponds to the first node and the nth node;
selecting a candidate mined pair based at least on the voice graph, wherein the candidate mined pair comprises a mis-transcription and a correct transcription;
determining that the transcription corresponds to the mis-transcription;
and
replacing the transcription with the correct transcription.

4 more elements

A non-transitory computer-readable medium storing instructions that, when executed by a processor of a first electronic device, cause the first electronic device to perform operations, the operations comprising:

receiving a transcription comprising media content, wherein the transcription is generated via an automatic speech recognition (ASR) engine;
generating a voice graph based at least on previous ASR transcriptions of n-best outputs, where n is an integer,
wherein the voice graph comprises n nodes and at least (n−1) edges, wherein a first node of the n nodes corresponds to a top-1 transcript, and an nth node corresponds to a top-n transcript, where n>=2, and wherein an (n−1) edge of the at least (n−1) edges corresponds to the first node and the nth node;
selecting a candidate mined pair based at least on the voice graph, wherein the candidate mined pair comprises a mis-transcription and a correct transcription;
determining that the transcription corresponds to the mis-transcription;
and
replacing the transcription with the correct transcription.

4 more elements

A system, comprising:

one or more memories;
and
at least one processor each coupled to at least one of the memories and configured to perform operations comprising:
receiving a transcription comprising media content, wherein the transcription is generated via an automatic speech recognition (ASR) engine;
generating a voice graph based at least on previous ASR transcriptions of n-best outputs, where n is an integer,
wherein the voice graph comprises n nodes and at least (n−1) edges, wherein a first node of the n nodes corresponds to a top-1 transcript, and an nth node corresponds to a top-n transcript, where n>=2, and wherein an (n−1) edge of the at least (n−1) edges corresponds to the first node and the nth node;
selecting a candidate mined pair based at least on the voice graph, wherein the candidate mined pair comprises a mis-transcription and a correct transcription;
determining that the transcription corresponds to the mis-transcription;
and
replacing the transcription with the correct transcription.

7 more elements

Dependencies are inferred from the claim text.

Transcription knowledge graph

Life of this patent

Transcription knowledge graph

Life of this patent

Abstract

Claims20