Back to results
US 2014/0368434 A1Published application
Generation of text by way of a touchless interface
AssigneeMicrosoft Corporation
InventorsTimothy S. Paek, Johnson Apacible
Life of this patent
Estimating the term…
Abstract
Described herein are technologies that facilitate decoding a continuous sequence of gestures set forth in the air by a user. A sensor captures movement of a portion of a body of the user relative to a keyboard displayed on a display screen, and a continuous trace is identified based upon the captured movement. The continuous trace is decoded to ascertain a word desirably set forth by the user.
Claims20
A method, comprising:
- receiving data that is indicative of movement of a portion of a body of a user relative to a display screen, the user being displaced from the display screen, the movement of the portion of the body forming a continuous trace;
- responsive to receiving the data, identifying the continuous trace;
- identifying a word based at least in part upon the continuous trace;
- and
- executing at least one processing operation based at least in part upon the identifying of the word.
2 more elements
A system, comprising:
- a processor;
- and
- a memory that comprises a plurality of components that are executed by the processor, the plurality of components comprising:
- a receiver component that receives images output by a camera, the images capturing movement of an arm of a user over time relative to a display screen;
- a trace identifier component that identifies a continuous trace set forth by the user based upon the movement of the arm captured in the images output by the camera, the continuous trace corresponding to a continuous movement of the arm of the user;
- a decoder component that identifies a word based upon the continuous trace identified by the trace identifier component;
- and
- a display component that displays the word decoded by the decoder component.
5 more elements
A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to perform acts comprising:
- receiving a first plurality of images of a user from a camera;
- receiving, from a depth sensor, first data that is indicative of a distance between the user and a display screen;
- detecting an invocation gesture based upon the first plurality of images received from the camera and the first data received from the depth sensor;
- responsive to detecting the invocation gesture, displaying a keyboard on the display screen, the keyboard comprising a plurality of character keys, each character key being representative of at least one respective character;
- receiving a second plurality of images from the camera;
- receiving second data from the depth sensor, the second plurality of images and the second data capturing movement of an arm of the user relative to the keyboard;
- identifying a continuous trace based upon the second plurality of images and the second data;
- and
- identifying a word based upon the continuous trace, the word comprising a first character represented by a first character key over which the continuous trace passed and second character represented by a second character key over which the continuous trace passed.
6 more elements
Dependencies are inferred from the claim text.