Speech recognition biasing

A system comprising:

• one or more computers;
• and
• one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
• receiving audio data corresponding to a spoken instruction to a robot;
• receiving context data that indicates (i) a location of the robot, and (ii) one or more objects within a threshold level of proximity to the location of the robot;
• obtaining candidate transcriptions of the audio data;
• determining a respective action of the robot corresponding to each of the candidate transcriptions of the audio data;
• determining, for each of the candidate transcriptions of the audio data, one or more scores indicating characteristics of a potential outcome of performing the respective action corresponding to the candidate transcription of the audio data, wherein the one or more scores are determined based at least on the received context data;
• selecting a particular candidate transcription from among the candidate transcriptions based at least on the one or more scores;
• and
• performing the action determined for the particular candidate transcription.

A non-transitory computer-readable storage device encoded with computer program instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

• receiving audio data corresponding to a spoken instruction to a robot;
• receiving context data that indicates (i) a location of the robot, and (ii) one or more objects within a threshold level of proximity to the location of the robot;
• obtaining candidate transcriptions of the audio data;
• determining a respective action of the robot corresponding to each of the candidate transcriptions of the audio data;
• determining, for each of the candidate transcriptions of the audio data, one or more scores indicating characteristics of a potential outcome of performing the respective action corresponding to the candidate transcription of the audio data, wherein the one or more scores are determined based at least on the received context data;
• selecting a particular candidate transcription from among the candidate transcriptions based at least on the one or more scores;
• and
• performing the action determined for the particular candidate transcription.