Method and apparatus for correcting and repairing machine-transcribed input using independent or cross-modal secondary input
AssigneeCarnegie Mellon University
InventorsAlexander Waibel, Bernhard Suhm, Arthur McNair
Life of this patent
Estimating the term…
Abstract
The method of the present invention is comprised of the steps of locating an error within a recognition hypothesis. A repair hypothesis is generated for the located error from a secondary input signal. At least a portion of the recognition hypothesis is correlated with the repair hypothesis to produce a new hypothesis for the located error. The located error is replaced with the new hypothesis. It has been determined that when the primary and secondary input signals are cross-modal, the chances that the error will be repeated are so low that the correlation step becomes optional.
Claims113
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal including an utterance, comprising:
- locating an error within the recognition hypothesis;
- generating a repair hypothesis for said located error from a secondary input signal including a paraphrasing of at least a portion of the utterance;
- correlating at least a portion of the recognition hypothesis with said repair hypothesis to produce a new hypothesis;
- and
- replacing said located error with the new hypothesis.
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal including a writing, comprising:
- locating an error within the recognition hypothesis;
- generating a repair hypothesis for said located error from a secondary input signal including a paraphrasing of at least a portion of the writing;
- correlating at least a portion of the recognition hypothesis with said repair hypothesis to produce a new hypothesis;
- and
- replacing said located error with the new hypothesis.
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal including a verbal spelling, comprising:
- locating an error within the recognition hypothesis;
- generating a repair hypothesis for said located error from a secondary input signal including a paraphrasing of at least a portion of the verbal spelling;
- correlating at least a portion of the recognition hypothesis with said repair hypothesis to produce a new hypothesis;
- and
- replacing said located error with the new hypothesis.
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal, comprising:
- locating an error within the recognition hypothesis, wherein locating an error includes speaking the portion that is in error;
- generating a repair hypothesis for said located error from a secondary input signal;
- correlating at least a portion of the recognition hypothesis with said repair hypothesis to produce a new hypothesis;
- and
- replacing said located error with the new hypothesis.
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal including a utterance comprising:
- locating an error within the recognition hypothesis:
- generating a repair hypothesis for said located error from a secondary input signal of different modality than the primary input signal, said secondary input signal including a paraphrasing of at least a portion of the utterance;
- and
- replacing said located error with the repair hypothesis.
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal including a writing, comprising:
- locating an error within the recognition hypothesis:
- generating a repair hypothesis for said located error from a secondary input signal of a different modality than the primary input signal, said secondary input signal including paraphrasing of at least a portion of the writing;
- and
- replacing said located error with the repair hypothesis.
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal including a verbal spelling, comprising:
- locating an error within the recognition hypothesis:
- generating a repair hypothesis for said located error from a secondary input signal of a different modality than the primary input signal, said secondary input signal including a paraphrasing of at least a portion of the verbal spelling;
- and
- replacing said located error with the repair hypothesis.
A method of repairing the output from a recognition engine generating at least one recognition hypothesis from a primary input signal, comprising:
- locating an error within the recognition hypothesis, wherein locating an error includes speaking the portion that is in error;
- generating a repair hypothesis for said located error from a secondary input signal of a different modality than the primary input signal;
- and
- replacing said located error with the repair hypothesis.
An apparatus, comprising:
- a recognition engine for generating at least one recognition hypothesis in response to a primary input signal including an utterance;
- a location module for locating an error within said recognition hypothesis, said recognition engine generating a repair hypothesis for said located error in response to a secondary input signal including a paraphrasing of at least a portion of the utterance;
- a replacement module for replacing said located error with said new hypothesis.
An apparatus, comprising:
- a recognition engine for generating at least one recognition hypothesis in response to a primary input signal including a writing;
- a location module for locating an error within said recognition hypothesis, said recognition engine generating a repair hypothesis for said located error in response to a secondary input signal including a paraphrasing of at least a portion of the writing;
- a correlation module for correlating at least a portion of said recognition hypothesis with said repair hypothesis to produce a new hypothesis;
- and
- a replacement module for replacing said located error with said new hypothesis.
An apparatus, comprising:
- a recognition engine for generating at least one recognition hypothesis in response to a primary input signal including verbal spelling;
- a location module for locating an error within said recognition hypothesis, said recognition engine generating a repair hypothesis for said located error in response to a secondary input signal including a paraphrasing of at least a portion of the verbal spelling;
- a correlation module for correlating at least a portion of said recognition hypothesis with said repair hypothesis to produce a new hypothesis;
- and
- a replacement module for replacing said located error with said new hypothesis.
An apparatus, comprising:
- a first recognition engine for generating at least one recognition hypothesis from a primary input signal including an utterance;
- a location module for locating an error within said recognition hypothesis;
- a second recognition engine for generating a repair hypothesis for said located error from a secondary input signal of a different modality than said primary input signal, said secondary input signal including a paraphrasing of at least a portion of the utterance;
- and
- a replacement module for replacing said located error with said repair hypothesis.
An apparatus, comprising:
- a first recognition engine for generating at least one recognition hypothesis from a primary input signal including a writing;
- a location module for locating an error within said recognition hypothesis;
- a second recognition engine for generating a repair hypothesis for said located error from a secondary input signal of a different modality than said primary input signal, said secondary input signal including a paraphrasing of at least a portion of the writing;
- and
- a replacement module for replacing said located error with said repair hypothesis.
An apparatus, comprising:
- a first recognition engine for generating at least one recognition hypothesis from a primary input signal including a verbal spelling;
- a location module for locating an error within said recognition hypothesis;
- a second recognition engine for generating a repair hypothesis for said located error from a secondary input signal of a different modality than said primary input signal, said secondary input signal including a paraphrasing of at least a portion of the verbal spelling;
- and
- a replacement module for replacing said located error with said repair hypothesis.
An apparatus, comprising:
- a recognition engine for generating at least one recognition hypothesis in response to a primary input signal;
- a location module for locating an error within said recognition hypothesis in response to a speaking of the portion that is in error, said recognition engine generating a repair hypothesis for said located error in response to a secondary input signal;
- a correlation module for correlating at least a portion of said recognition hypothesis with said repair hypothesis to produce a new hypothesis;
- and
- a replacement module for replacing said located error with said new hypothesis.
An apparatus, comprising:
- a first recognition engine for generating at least one recognition hypothesis from a primary input signal;
- a location module for locating an error within said recognition hypothesis in response to a speaking of the portion that is in error;
- a second recognition engine for generating a repair hypothesis for said located error from a secondary input signal of a different modality than said primary input signal;
- and
- a replacement module for replacing said located error with said repair hypothesis.
Dependencies are inferred from the claim text.