Back to results
US 10,372,328 B2Granted
Intelligent touchscreen keyboard with finger differentiation
AssigneeGoogle Inc.
InventorShumin Zhai
Life of this patent
Estimating the term…
Abstract
Implementations of the present disclosure include actions of displaying a plurality of keys on a touchscreen of a computing device, receiving user input to the touchscreen, the user input including a contact with the touchscreen, in response to receiving the user input, determining spatial information associated with the contact and generating an image of the contact, determining an output based on the image and the spatial information, and executing the output.
Claims18
A computer-implemented method, comprising:
- displaying, on a touchscreen of a computing device, a plurality of virtual keys;
- receiving, by the computing device, a contact with the touchscreen while the plurality of virtual keys were displayed on the touchscreen, wherein the contact was with a contacted area of the touchscreen, the contacted area of the touchscreen being a portion of the touchscreen at which the computing device displayed multiple candidate virtual keys of the plurality of virtual keys;
- determining, by the computing device and based on an electrical or optical change to the touchscreen that results from the contact, a contact image that depicts the contacted area of the touchscreen;
- determining, by the computing device, a particular finger that provided the contact with the contacted area of the touchscreen from among multiple fingers of a same user hand, based on analysis of the contact image with multiple pre-defined contact images that model touchscreen contacts by different, respective user fingers of the same user hand;
- selecting, by the computing device, a particular virtual key, of the multiple candidate virtual keys displayed at the contacted area of the touchscreen, to assign to the contact with the touchscreen, the particular virtual key being selected from among the multiple candidate virtual keys, based on:
- (i) a location of the contacted area of the touchscreen, and
- (ii) the computing device having determined that the particular finger provided the contact with the touchscreen in distinction to another one of the multiple fingers of the same user hand, based on the analysis of the contact image;
- and
- performing, by the computing device in response to the computing device selecting the particular virtual key of the multiple candidate virtual keys to assign to the contact with the touchscreen, an action that corresponds to user selection of the particular virtual key.
6 more elements
A computer-implemented method, comprising:
- displaying, on a touchscreen of a computing device, a plurality of virtual keys, wherein each of the plurality of virtual keys (i) corresponds to a different character of a plurality of characters and (ii) is displayed at a particular location on the touchscreen that is different from the locations at which any other virtual key of the plurality of virtual keys is displayed on the touchscreen;
- receiving, by the computing device, a contact with the touchscreen while the plurality of virtual keys are displayed on the touchscreen, wherein the contact is with a contacted area of the touchscreen, the contacted area of the touchscreen being a portion of the touchscreen at which the computing device displayed multiple candidate virtual keys of the plurality of virtual keys;
- determining, by the computing device, a characteristic of the contacted area of the touchscreen that resulted from the contact with the touchscreen;
- determining, by the computing device, a particular finger that provided the contact with the contacted area of the touchscreen from among multiple fingers of a same user hand, based on analysis of the contact image with multiple pre-defined contact images that model the touchscreen contacts by different, respective fingers of the same user hand;
- selecting, by the computing device, a particular virtual key of the multiple candidate virtual keys associated with the contacted area of the touchscreen, to assign to the contact with the touchscreen, the particular virtual key being selected from among the multiple candidate virtual keys, based on:
- (i) a location of the contacted area of the touchscreen
- (ii) the computing device having determined the characteristic of the contacted area of the touchscreen that resulted from the contact with the touchscreen;
- and
- (iii) the computing device having determined that the particular finger provided the contact with the touchscreen in distinction to another one of the multiple fingers from the same user hand, based on the analysis of the contact image;
- and
- performing, by the computing device, in response to the computing device selecting the particular virtual key of the multiple candidate virtual keys to assign to the contact with the touchscreen, an action that corresponds to user selection of the particular virtual key.
8 more elements
A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more processors of a computing device, cause the one or more processors to perform operations comprising:
- displaying, on a touchscreen of a computing device, a plurality of virtual keys;
- receiving, by the computing device, a contact with the touchscreen while the plurality of virtual keys were displayed on the touchscreen, wherein the contact was with a contacted area of the touchscreen, the contacted area of the touchscreen being a portion of the touchscreen at which the computing device displayed candidate virtual keys of the plurality of virtual keys;
- determining, by the computing device and based on an electrical or optical change to the touchscreen that results from the contact, a contact image that depicts the contacted area of the touchscreen;
- determining, by the computing device, a particular finger that provided the contact with the touchscreen from among multiple fingers of a same user hand, based on analysis of the contact image to multiple pre-defined contact images that model touchscreen contacts by different, respective user fingers from the same user hand;
- selecting, by the computing device, a particular virtual key of the multiple candidate virtual keys associated with the contact area of the touchscreen, to assign to the contact with the touchscreen, the particular virtual key being selected from among the multiple candidate virtual keys, based on:
- (i) a location of the contacted area of the touchscreen, and
- (ii) the computing device having determined that the particular finger provided the contact with the touchscreen in distinction to another one of the multiple fingers of the same user hand providing the contact with the touchscreen, based on the analysis of the contact image;
- and
- performing, by the computing device in response to the computing device selecting the particular virtual key of the multiple candidate virtual keys to assign to the contact with the touchscreen, an action that corresponds to user selection of the particular virtual key.
6 more elements
Dependencies are inferred from the claim text.