Systems and methods for improved automatic speech recognition systems

A method comprising:

• receiving, at an automatic speech recognition system, a plurality of voice queries;
• determining, by the automatic speech recognition system, at least one transcript-score pair associated with each of the plurality of voice queries, wherein a transcript-score pair comprises a transcription associated with a voice query of the plurality of voice queries and at least one score associated with the transcription;
• receiving, at a computing device, each of the at least one transcript-score pairs associated with each of the plurality of voice queries;
• determining an effect on a word-error rate of the automatic speech recognition system associated with each one of the at least one transcript-score pairs;
• and
• sending a subset of the at least one transcript-score pairs with a threshold effect on increasing the word-error rate of the automatic speech recognition system to be annotated.

A system comprising:

• an automatic speech recognition system configured to:
• receive a voice query;
• and
• send, to a computing device, at least one transcript-score pair associated with the voice query, wherein the at least one transcript-score pair comprises a transcription associated with the voice query and at least one score associated with the transcription;
• and
• the computing device configured to:
• receive each of the at least one transcript-score pairs associated with the voice query;
• determine an effect on a word-error rate of the automatic speech recognition system associated with each one of the at least one transcript-score pairs;
• and
• send one or more of the at least one transcript-score pairs with a threshold effect on increasing the word-error rate of the automatic speech recognition system to be annotated.