Methods and systems for identifying errors in a speech recognition system

A method for identifying a possible error made by a speech recognition system comprising:

• with an apparatus using at least one hardware-implemented processor, identifying when the system generates first and second hypotheses of two utterances and the system accepts the second hypothesis, wherein the two hypotheses do not match word-for-word, but the hypotheses mostly match word-for-word.

A method for identifying a possible error made by a speech recognition system, comprising:

• with an apparatus using at least one hardware-implemented processor, identifying when a hypothesis generated by the system does not match an expected response word-for-word, but the hypothesis mostly matches the expected response word-for-word.

An apparatus for identifying a possible error made by a speech recognition system comprising:

• a processor that is operable to identify an instance where the system rejects a first hypothesis of a first utterance, followed by the system accepting a second hypothesis of a second utterance, wherein the first and second hypotheses substantially match word-for-word.

An apparatus for identifying a possible error made by a speech recognition system comprising:

• a processor that is operable to identify when the system generates first and second hypotheses of two utterances and the system accepts the second hypothesis, wherein the two hypotheses do not match word-for-word, but the hypotheses mostly match word-for-word.

An apparatus for identifying a possible error rate made by a speech recognition system, comprising:

• a processor that is operable to identify when a hypothesis generated by the system does not match an expected response word-for-word, but the hypothesis mostly matches the expected response word-for-word.