Virtual keypads for hands-free operation of computing devices

A computing device, comprising:

• a processor;
• and
• an interface coupling the processor to an image sensor;
• wherein the processor is configured to:
• detect an input request;
• in response to detecting the input request, capture a reference image via the image sensor, the reference image containing a virtual keypad having a set of virtual keys;
• detect, in the reference image, the set of virtual keys;
• capture, via the image sensor, a key-press image of the virtual keypad;
• detect, in the key-press image, a subset of the virtual keys;
• compare the set of virtual keys and the subset of virtual keys to identify a key-press obscuring one of the virtual keys;
• and
• return input data corresponding to the obscured virtual key,
• wherein the processor is configured to capture the reference image by:
• capturing a sequence of initial images prior to the reference image,
• detecting respective subsets of the virtual keys in each of the initial images, and
• determining that the set of virtual keys from reference image matches the subset of virtual keys detected from at least one of the initial images.

A system, comprising:

• a head-mounted display including an image sensor;
• a controller coupled to the head-mounted display, the controller configured to:
• detect an input request;
• in response to detecting the input request, capture a reference image via the image sensor, the reference image containing a virtual keypad having a set of virtual keys;
• detect, in the reference image, the set of virtual keys;
• capture, via the image sensor, a key-press image of the virtual keypad;
• detect, in the key-press image, a subset of the virtual keys;
• compare the set of virtual keys and the subset of virtual keys to identify a key-press obscuring one of the virtual keys;
• and
• return input data corresponding to the obscured virtual key,
• wherein the controller is configured to capture the reference image by:
• capturing a sequence of initial images prior to the reference image,
• detecting respective subsets of the virtual keys in each of the initial images, and
• determining that the set of virtual keys from reference image matches the subset of virtual keys detected from at least one of the initial images.