US 9,070,360 B2 · Confidence calibration in automatic speech recognition systems

Abstract

Described is a calibration model for use in a speech recognition system. The calibration model adjusts the confidence scores output by a speech recognition engine to thereby provide an improved calibrated confidence score for use by an application. The calibration model is one that has been trained for a specific usage scenario, e.g., for that application, based upon a calibration training set obtained from a previous similar/corresponding usage scenario or scenarios. Different calibration models may be used with different usage scenarios, e.g., during different conditions. The calibration model may comprise a maximum entropy classifier with distribution constraints, trained with continuous raw confidence scores and multi-valued word tokens, and/or other distributions and extracted features.

Claims20

Dependent claims

A system comprising:

one or more processors;
a memory coupled to the one or more processors;
a calibration model, dynamically selected by and implemented on the one or more processors based on a current condition, the calibration model having been trained for a usage scenario that corresponds to the current condition, the calibration model configured to receive a word confidence score and a semantic confidence score from a speech recognition engine, and configured to adjust the word confidence score to provide a calibrated word confidence score for use by an application, and further configured to adjust the semantic confidence score using the calibrated word confidence score to provide a calibrated semantic confidence score for use by the application, the calibration model having been trained for the usage scenario based upon a calibration training set obtained from at least one previous corresponding usage scenario.

Dependencies are inferred from the claim text.

Confidence calibration in automatic speech recognition systems

Life of this patent

Confidence calibration in automatic speech recognition systems

Life of this patent

Abstract

Claims20