# US 2016/0259407 A1 · Arbitrary surface and finger position keyboard

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259407 A1
- Document ID: US20160259407A1
- Status: Published application
- Kind: A1
- Application number: 15/055,853
- Filed: 2016-02-29
- Published: 2016-09-08
- Earliest claimed: 2015-03-02
- Assignees: Tap Systems Inc.
- Applicants: Tap Systems Inc.
- Inventors: David B. Schick
- Web page: https://patentgrep.com/patent/US20160259407A1

## CPC

- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0202: {Constructional details or processes of manufacture of the input device}
- G06F 3/0219: {Special purpose keyboards}
- G06F 3/0235: {using chord techniques (G06F3/0234 takes precedence)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0426: {tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886)}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04N 23/00: Cameras or camera modules comprising electronic image sensors; Control thereof
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A one-handed, chorded data entry system enables an operator to tap a combination of fingers on any surface, thereby causing a character or command to be entered on an electronic device. The fingers can be arranged in any position and neither the fingers nor the fingertips of the user need be aimed at any particular target.

## Claims

### Claim 1

A data entry system, comprising:
a sensor apparatus arranged to generate a signal representative of a contact of one or more fingers singly or in combination against an arbitrary surface, and
wherein the arbitrary surface does not generate the signal.

### Claim 2 (depends on 1)

The data entry system according to claim 1, wherein the contact of one or more fingers represents a finger combination that maps to any one of a character and a command, or a combination of both the character and the command.

### Claim 3 (depends on 1)

The data entry system according to claim 1, further comprising:
a wearable structure constructed to support the sensor apparatus on any one of i) a dorsal surface of a hand ii) a palmar surface of a hand, iii) a wrist, and iv) phalanges of a hand, or any combination of i), ii), iii) and iv).

### Claim 4 (depends on 1)

The data entry system according to claim 1, further comprising:
a memory, and
wherein the sensor apparatus further includes an image sensor arranged to acquire the signal, the signal being an image of the one or more fingers, and
wherein the memory is operable to store the image.

### Claim 5 (depends on 4)

The data entry system according to claim 4, further comprising:
a processor, communicatively coupled to the sensor apparatus, operable to filter the image to ascertain a location of each finger at the moment of contact against the arbitrary surface.

### Claim 6 (depends on 1)

The data entry system according to claim 1, wherein the sensor apparatus further includes at least one mechanical sensor arranged to acquire the signal, the signal corresponding to a mechanical quantity caused by the one or more fingers contacting the arbitrary surface.

### Claim 7 (depends on 6)

The data entry system according to claim 6, further comprising:
a processor operable to collect the signal received from the sensor apparatus at the moment of the contact against the surface.

### Claim 8

A data entry method, comprising the steps of:
generating a signal representative of a contact of one or more fingers singly or in combination against an arbitrary surface, and
wherein the arbitrary surface does not generate the signal.

### Claim 9 (depends on 8)

The data entry method according to claim 8, further comprising:
mapping a finger combination that is represented by the contact of the one or more fingers represents to any one of a character and a command, or a combination of both the character and the command.

### Claim 10 (depends on 8)

The data entry method according to claim 8, further comprising the steps of:
acquiring the image signal by an image sensor, the signal being an image of the one or more fingers, and
storing the image in a memory.

### Claim 11 (depends on 10)

The data entry method according to claim 10, further comprising the step of:
filtering the image to ascertain a location of each finger at the moment of contact against the arbitrary surface.

### Claim 12 (depends on 8)

The data entry method according to claim 8, further comprising the steps of:
acquiring the signal, by at least one mechanical sensor, the signal corresponding to a mechanical quantity caused by the one or more fingers contacting the arbitrary surface.

### Claim 13 (depends on 12)

The data entry method according to claim 12, further comprising the step of:
collecting the signal received from the sensor apparatus at the moment of the contact against the surface.

### Claim 14

A non-transitory computer readable storage medium storing a computer program which when executed by a computer, causes the computer to execute a method of data entry, the method comprising:
generating a signal representative of a contact of one or more fingers singly or in combination against an arbitrary surface, and
wherein the arbitrary surface does not generate the signal.

### Claim 15 (depends on 14)

The non-transitory computer readable storage medium according to claim 14, wherein the method further comprises:
mapping a finger combination that is represented by the contact of the one or more fingers represents to any one of a character and a command, or a combination of both the character and the command.

### Claim 16 (depends on 14)

The non-transitory computer readable storage medium according to claim 14, wherein the method further comprises:
acquiring the image signal by an image sensor, the signal being an image of the one or more fingers, and
storing the image in a memory.

### Claim 17 (depends on 16)

The non-transitory computer readable storage medium according to claim 16, wherein the method further comprises:
filtering the image to ascertain a location of each finger at the moment of contact against the arbitrary surface.

### Claim 18 (depends on 14)

The non-transitory computer readable storage medium according to claim 14, wherein the method further comprises:
acquiring the signal, by at least one mechanical sensor, the signal corresponding to a mechanical quantity caused by the one or more fingers contacting the arbitrary surface.

### Claim 19 (depends on 18)

The non-transitory computer readable storage medium according to claim 18, wherein the method further comprises:
collecting the signal received from the sensor apparatus at the moment of the contact against the surface.

### Claim 20 (depends on 14)

The non-transitory computer readable storage medium according to claim 14, wherein the method further comprises:
generating a reference signal based on the tapping of all of the fingers of a hand on the arbitrary surface;
comparing the reference signal and the signal representative of the contact of the one or more fingers; and
determining based on the comparing whether a corresponding fingertip is in a down position.
