Systems and methods for finger pose estimation on touchscreen devices
AssigneeFuji Xerox Co., Ltd.
InventorsSven Kratz, Patrick Chiu
Life of this patent
Estimating the term…
Abstract
Described are systems and methods for estimating finger pose of a user during a tactile input event. In one implementation, the system incorporates: a touch-sensitive display device configured to detect a tactile event and to determine a contact point of an object and the touch-sensitive display device, the contact point associated with the tactile event; a camera configured to capture an image of an area proximal to the surface of the touch-sensitive display device; and a central processing unit configured, in response to the detection of the tactile event, to determine information on a pose of the object based on the captured image and the determined contact point.
Claims20
A computer-implemented method performed in a computerized system comprising a central processing unit, a touch-sensitive display device, a memory and a camera, the computer-implemented method comprising:
- a. using the touch-sensitive display device to detect a tactile event;
- b. using the camera to capture an image of an area proximal to the surface of the touch-sensitive display device, wherein the camera is a depth-imaging camera and wherein a signal from the camera comprises image information and depth information;
- c. using the touch-sensitive display device to determine a contact point of an object and the touch-sensitive display device, the contact point associated with the tactile event, wherein the touch-sensitive display device is separate and distinct from the camera;
- and
- d. responsive to the detection of the tactile event, using the central processing unit to determine information on a pose of the object based on the captured image and the determined contact point.
A non-transitory computer-readable medium embodying a set of computer-executable instructions, which, when executed in a computerized system comprising a central processing unit, a touch-sensitive display device, a memory and a camera, cause the computerized system to perform a method comprising:
- a. using the touch-sensitive display device to detect a tactile event;
- b. using the camera for capturing an image of an area proximal to the surface of the touch-sensitive display device, wherein the camera is a depth-imaging camera and wherein a signal from the camera comprises image information and depth information;
- c. using the touch-sensitive display device to determine a contact point of an object and the touch-sensitive display device, the contact point associated with the tactile event;
- and
- d. responsive to the detection of the tactile event, using the central processing unit to determine information on a pose of the object based on the captured image and the determined contact point.
A computerized system comprising:
- a. a touch-sensitive display device configured to detect a tactile event and to determine a contact point of an object and the touch-sensitive display device, the contact point associated with the tactile event;
- b. a depth-imaging camera, separate and distinct from the touch-sensitive display device, configured to capture an image of an area proximal to the surface of the touch-sensitive display device, wherein a signal from the camera comprises image information and depth information;
- and
- c. a central processing unit configured, in response to the detection of the tactile event, to determine information on a pose of the object based on the captured image and the determined contact point.
Dependencies are inferred from the claim text.