Training speech recognizers based on biased transcriptions

A system comprising:

• data processing hardware;
• and
• memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
• receiving a biased transcription for a voice command spoken by a user and captured by a user device, the biased transcription biased to include a biasing phrase from a set of biasing phrases specific to the user;
• instructing an application executing on the user device to perform an action specified by the biased transcription for the voice command;
• receiving, from a monitoring module executing on the user device, one or more user behavior signals captured by the monitoring module responsive to the application performing the action specified by the biased transcription, the one or more behavior signals representing interactions between the user and the application associated with the application performing the action specified by the biased transcription;
• processing, by a confidence model, the received one or more user behavior signals captured by the monitoring module to generate a confidence score of the biased transcription, the confidence score indicating a likelihood that the biased transcription accurately transcribes the voice command;
• determining the confidence score satisfies a confidence threshold;
• and
• based on determining the confidence score satisfies the confidence threshold, training a speech recognizer on the biased transcription.