Voice controlled keyboard typing using computer vision

A computer-implemented method, comprising:

• receiving, by a computer system, an image of a device from a camera;
• detecting, by the computer system, a keyboard region of the device based at least in part on a keyboard detection algorithm that uses the image;
• detecting, by the computer system, one or more characters in a portion of the image that correspond to the keyboard region of the device based at least in part on a character detection algorithm;
• generating, by the computer system, one or more groups for the one or more characters based at least in part on the portion of the image that corresponds to the keyboard region and the one or more characters, a group of the one or more groups including a portion of characters of the one or more characters;
• and
• editing, by the computer system, a character of the portion of characters based at least in part on an error detection algorithm.

A non-transitory computer readable medium storing specific computer-executable instructions that, when executed by a processor, cause a computer system to at least:

• detect a keyboard region of a device in an image of the device based at least in part on a keyboard detection algorithm that uses the image;
• detect one or more characters in a portion of the image that corresponds to the keyboard region of the device based at least in part on a character detection algorithm;
• and
• editing a character of the one or more characters in the portion of the image based at least in part on an error detection algorithm and in response to generating one or more groups for the one or more characters based at least in part on the portion of the image that corresponds to the keyboard region and the one or more characters, a group of the one or more groups including a portion of characters of the one or more characters.