# US 2018/0321841 A1 · Calibrated finger-mapped gesture systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321841 A1
- Document ID: US20180321841A1
- Status: Published application
- Kind: A1
- Application number: 16/037,077
- Filed: 2018-07-17
- Published: 2018-11-08
- Earliest claimed: 2013-05-08
- Inventors: Joseph T. LAPP
- Web page: https://patentgrep.com/patent/US20180321841A1

## CPC

- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A finger-mapped gesture system is a user interface method and apparatus for rapid data input on a touch-sensitive surface. The user gestures by holding the hand stationary relative to the surface and moving the fingers primarily by extension and flexion on the surface. Each finger gestures on a gesturing area instead of selecting among keys. Individual gestures are constructed from finger actions that each independently parameterize the gesture. In combination, the particular fingers gesturing and the parameters that the fingers gesture indicate the input that the user intends. On devices that do not directly identify fingers, fingers are identified via a finger map that, after calibration to a person's hand, associates each finger with a gesturing area. Gestures are otherwise independent of where they are performed, freeing users from having to look at their fingers to target visual elements. The system is optimized for rapid character data entry.

## Claims

### Claim 1

A method of user input on a touch device associated with a host that interprets user requests in response to user input, said method comprising the steps of:
detecting a first calibrating finger at a first calibrating location on a surface allocation, with said surface allocation containing a calibrating geometric element;
providing an input area on said surface allocation, with said input area implementing a non-subsumptive gesture basis set of independent gesture bases that is multi-selectable within said input area on a set of linear associations, with said gesture basis set having a series of available finger identities, and with each gesture basis of said gesture basis set including a path-dependent gesture parameter;
subsequent to said steps of detecting a first calibrating finger and providing an input area, concluding processing of a first gesture;
subsequent to said step of concluding processing of a first gesture, detecting a first selecting finger set of gesturing fingers, with each finger of said first selecting finger set having a gestured path with an initial touch location on said input area;
determining a first selected identity set dependent on a relative position of said first calibrating location and said calibrating geometric element, with said first selected identity set comprising a distinct finger identity of said series of available finger identities for each finger of said first selecting finger set;
determining a first user request as a function of each value of a first selectable parameterization of a first gesture basis of said gesture basis set, with said first selectable parameterization including a value for each gesture parameter of said first gesture basis, said value for said each gesture parameter being a function of the gestured path of at least one finger of said first selecting finger set, with said first selected identity set being identical to the characteristic identity set of said first gesture basis, with four selectable parameterizations of said first gesture basis (a) indicating distinct user requests and (b) each being selectable by a gesture having a set of simple linear associations that is a subset of said set of linear associations, and with said first selectable parameterization being one of said four selectable parameterizations; and
reporting said first user request to said host.

### Claim 2

A method of user input on a touch device associated with a host that interprets user requests in response to user input, said method comprising the steps of:
detecting a first calibrating finger at a first calibrating location on a surface allocation, with said surface allocation containing a calibrating geometric element;
providing an input area on said surface allocation, with said input area implementing a non-subsumptive gesture basis set of independent gesture bases, with said gesture basis set having a series of available finger identities, and with each gesture basis of said gesture basis set including a path-dependent gesture parameter;
subsequent to said steps of detecting a first calibrating finger and providing an input area, concluding processing of a first gesture;
subsequent to said step of concluding processing of a first gesture, detecting a first selecting finger set of at least two gesturing fingers, with each finger of said first selecting finger set having a gestured path with an initial touch location on said input area;
determining a first selected identity set dependent on a relative position of said first calibrating location and said calibrating geometric element, with said first selected identity set comprising a distinct finger identity of said series of available finger identities for each finger of said first selecting finger set;
determining a first user request as a function of said first selected identity set and as a function of a value for each gesture parameter of a first gesture basis of said gesture basis set, said value for said each gesture parameter being a function of the gestured path of at least one finger of said first selecting finger set, with said first selected identity set being identical to the characteristic identity set of said first gesture basis; and
reporting said first user request to said host.

### Claim 3 (depends on 1)

A method according to claim 1, wherein each gesture basis of said gesture basis set includes a gesture level parameter.

### Claim 4 (depends on 3)

A method according to claim 3,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each finger of said first selecting finger set, said step of determining a first selected identity set (a) determines the nearest geometric element of said series of geometric elements to the gestured path of said each finger and (b) includes in said first selected identity set the finger identity with which said nearest geometric element is associated; and
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element, said first geometric element being the nearest geometric element to the gestured path of a finger of said first selecting finger set.

### Claim 5 (depends on 4)

A method according to claim 4,
wherein prior to said step of concluding processing of a first gesture, said method further comprises the step of establishing at least one direction; and
wherein the region form of said first geometric element differs from the region form of a second geometric element of said series of geometric elements, with at least one difference between a property of the region form of said first geometric element and a property of the region form of said second geometric element being dependent on said at least one direction.

### Claim 6 (depends on 4)

A method according to claim 4, wherein prior to said step of concluding processing of a first gesture, said method further comprises the step of detecting a second calibrating finger at a second calibrating location, with said calibrating geometric element being said second calibrating location.

### Claim 7 (depends on 6)

A method according to claim 6,
wherein said first gesture basis includes a gesture direction parameter; and
wherein said first selectable parameterization includes a discrete direction for a range of directions that is dependent on a relative position of said first calibrating location and said second calibrating location.

### Claim 8 (depends on 2)

A method according to claim 2, wherein each gesture basis of said gesture basis set includes a gesture level parameter.

### Claim 9 (depends on 8)

A method according to claim 8,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each finger of said first selecting finger set, said step of determining a first selected identity set (a) determines the nearest geometric element of said series of geometric elements to the gestured path of said each finger and (b) includes in said first selected identity set the finger identity with which said nearest geometric element is associated; and
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element, said first geometric element being the nearest geometric element to the gestured path of a finger of said first selecting finger set.

### Claim 10 (depends on 8)

A method according to claim 8,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element; and
wherein said step of determining a first selected identity set comprises the substeps of:
determining that said first geometric element is the nearest geometric element of said series of geometric elements to the gestured path of a first finger of said first selecting finger set;
determining that the gestured path of a second finger of said first selecting finger set is nearest to a second geometric element of said series of geometric elements, with said second finger being distinct from said first finger;
determining that said first geometric element is said second geometric element;
including in said first selected identity set the finger identity with which said first geometric element is associated; and
including in said first selected identity set the finger identity with which an adjacent geometric element is associated, said adjacent geometric element being adjacent to said first geometric element in said series of geometric elements.

### Claim 11 (depends on 9)

A method according to claim 9, wherein prior to said step of concluding processing of a first gesture, said method further comprises the step of detecting a second calibrating finger at a second calibrating location, with said calibrating geometric element being said second calibrating location.

### Claim 12 (depends on 10)

A method according to claim 10, wherein
if said first geometric element is an end-of-series geometric element of said series of geometric elements, said adjacent geometric element is the geometric element adjacent in said series of geometric elements to said first geometric element; and
if said first geometric element is not an end-of-series geometric element of said series of geometric elements, said adjacent geometric element is the geometric element that is adjacent in said series of geometric elements to said first geometric element nearest to a midpoint between a location in the gestured path of said first finger and a location in the gestured path of said second finger.

### Claim 13

A system for user input on a touch device associated with a host that interprets user requests in response to user input, said system comprising:
a calibrating system that detects a first calibrating finger at a first calibrating location on a surface allocation, with said surface allocation containing a calibrating geometric element;
an input area on said surface allocation, with said input area implementing a non-subsumptive gesture basis set of independent gesture bases that is multi-selectable within said input area on a set of linear associations, with said gesture basis set having a series of available finger identities, and with each gesture basis of said gesture basis set including a path-dependent gesture parameter; and
a gesture system that:
(i) subsequent to said step that detects a first calibrating finger, concludes processing of a first gesture;
(ii) subsequent to said step that concludes processing of a first gesture, detects a first selecting finger set of gesturing fingers, with each finger of said first selecting finger set having a gestured path with an initial touch location on said input area;
(iii) determines a first selected identity set dependent on a relative position of said first calibrating location and said calibrating geometric element, with said first selected identity set comprising a distinct finger identity of said series of available finger identities for each finger of said first selecting finger set;
(iv) determines a first user request as a function of each value of a first selectable parameterization of a first gesture basis of said gesture basis set, with said first selectable parameterization including a value for each gesture parameter of said first gesture basis, said value for said each gesture parameter being a function of the gestured path of at least one finger of said first selecting finger set, with said first selected identity set being identical to the characteristic identity set of said first gesture basis, with four selectable parameterizations of said first gesture basis (a) indicating distinct user requests and (b) each being selectable by a gesture having a set of simple linear associations that is a subset of said set of linear associations, and with said first selectable parameterization being one of said four selectable parameterizations; and
(v) reports said first user request to said host.

### Claim 14

A system for user input on a touch device associated with a host that interprets user requests in response to user input, said system comprising:
a calibrating system that detects a first calibrating finger at a first calibrating location on a surface allocation, with said surface allocation containing a calibrating geometric element;
an input area on said surface allocation, with said input area implementing a non-subsumptive gesture basis set of independent gesture bases, with said gesture basis set having a series of available finger identities, and with each gesture basis of said gesture basis set including a path-dependent gesture parameter; and
a gesture system that:
(i) subsequent to said step that detects a first calibrating finger, concludes processing of a first gesture;
(ii) subsequent to said step that concludes processing of a first gesture, detects a first selecting finger set of at least two gesturing fingers, with each finger of said first selecting finger set having a gestured path with an initial touch location on said input area;
(iii) determines a first selected identity set dependent on a relative position of said first calibrating location and said calibrating geometric element, with said first selected identity set comprising a distinct finger identity of said series of available finger identities for each finger of said first selecting finger set;
(iv) determines a first user request as a function of said first selected identity set and as a function of a value for each gesture parameter of a first gesture basis of said gesture basis set, said value for said each gesture parameter being a function of the gestured path of at least one finger of said first selecting finger set, with said first selected identity set being identical to the characteristic identity set of said first gesture basis; and
(v) reports said first user request to said host.

### Claim 15 (depends on 13)

A system according to claim 13, wherein each gesture basis of said gesture basis set includes a gesture level parameter.

### Claim 16 (depends on 15)

A system according to claim 15,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each finger of said first selecting finger set, said gesture system (a) determines the nearest geometric element of said series of geometric elements to the gestured path of said each finger and (b) includes in said first selected identity set the finger identity with which said nearest geometric element is associated; and
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element, said first geometric element being the nearest geometric element to the gestured path of a finger of said first selecting finger set.

### Claim 17 (depends on 16)

A system according to claim 16,
wherein prior to said step that concludes processing of a first gesture, said calibrating system further establishes at least one direction; and
wherein the region form of said first geometric element differs from the region form of a second geometric element of said series of geometric elements, with at least one difference between a property of the region form of said first geometric element and a property of the region form of said second geometric element being dependent on said at least one direction.

### Claim 18 (depends on 16)

A system according to claim 16, wherein prior to said step that concludes processing of a first gesture, said calibrating system further detects a second calibrating finger at a second calibrating location, with said calibrating geometric element being said second calibrating location.

### Claim 19 (depends on 18)

A system according to claim 18,
wherein said first gesture basis includes a gesture direction parameter; and
wherein said first selectable parameterization includes a discrete direction for a range of directions that is dependent on a relative position of said first calibrating location and said second calibrating location.

### Claim 20 (depends on 14)

A system according to claim 14, wherein each gesture basis of said gesture basis set includes a gesture level parameter.

### Claim 21 (depends on 20)

A system according to claim 20,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each finger of said first selecting finger set, said gesture system (a) determines the nearest geometric element of said series of geometric elements to the gestured path of said each finger and (b) includes in said first selected identity set the finger identity with which said nearest geometric element is associated; and
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element, said first geometric element being the nearest geometric element to the gestured path of a finger of said first selecting finger set.

### Claim 22 (depends on 20)

A system according to claim 20,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element; and
wherein said gesture system:
determines that said first geometric element is the nearest geometric element of said series of geometric elements to the gestured path of a first finger of said first selecting finger set;
determines that the gestured path of a second finger of said first selecting finger set is nearest to a second geometric element of said series of geometric elements, with said second finger being distinct from said first finger;
determines that said first geometric element is said second geometric element;
includes in said first selected identity set the finger identity with which said first geometric element is associated; and
includes in said first selected identity set the finger identity with which an adjacent geometric element is associated, said adjacent geometric element being adjacent to said first geometric element in said series of geometric elements.

### Claim 23 (depends on 21)

A system according to claim 21, wherein prior to said step that concludes processing of a first gesture, said calibrating system further detects a second calibrating finger at a second calibrating location, with said calibrating geometric element being said second calibrating location.

### Claim 24 (depends on 22)

A system according to claim 22, wherein
if said first geometric element is an end-of-series geometric element of said series of geometric elements, said adjacent geometric element is the geometric element adjacent in said series of geometric elements to said first geometric element; and
if said first geometric element is not an end-of-series geometric element of said series of geometric elements, said adjacent geometric element is the geometric element that is adjacent in said series of geometric elements to said first geometric element nearest to a midpoint between a location in the gestured path of said first finger and a location in the gestured path of said second finger.

### Claim 25 (depends on 13)

A system according to claim 13, wherein said calibrating system is said gesture system.

### Claim 26 (depends on 14)

A system according to claim 14, wherein said calibrating system is said gesture system.

### Claim 27

A non-transitory computer-readable medium carrying thereon instructions which when executed by a processor perform a method of user input on a touch device associated with a host that interprets user requests in response to user input, said method comprising the steps of:
detecting a first calibrating finger at a first calibrating location on a surface allocation, with said surface allocation containing a calibrating geometric element;
providing an input area on said surface allocation, with said input area implementing a non-subsumptive gesture basis set of independent gesture bases that is multi-selectable within said input area on a set of linear associations, with said gesture basis set having a series of available finger identities, and with each gesture basis of said gesture basis set including a path-dependent gesture parameter;
subsequent to said steps of detecting a first calibrating finger and providing an input area, concluding processing of a first gesture;
subsequent to said step of concluding processing of a first gesture, detecting a first selecting finger set of gesturing fingers, with each finger of said first selecting finger set having a gestured path with an initial touch location on said input area;
determining a first selected identity set dependent on a relative position of said first calibrating location and said calibrating geometric element, with said first selected identity set comprising a distinct finger identity of said series of available finger identities for each finger of said first selecting finger set;
determining a first user request as a function of each value of a first selectable parameterization of a first gesture basis of said gesture basis set, with said first selectable parameterization including a value for each gesture parameter of said first gesture basis, said value for said each gesture parameter being a function of the gestured path of at least one finger of said first selecting finger set, with said first selected identity set being identical to the characteristic identity set of said first gesture basis, with four selectable parameterizations of said first gesture basis (a) indicating distinct user requests and (b) each being selectable by a gesture having a set of simple linear associations that is a subset of said set of linear associations, and with said first selectable parameterization being one of said four selectable parameterizations; and
reporting said first user request to said host.

### Claim 28

A non-transitory computer-readable medium carrying thereon instructions which when executed by a processor perform a method of user input on a touch device associated with a host that interprets user requests in response to user input, said method comprising the steps of:
detecting a first calibrating finger at a first calibrating location on a surface allocation, with said surface allocation containing a calibrating geometric element;
providing an input area on said surface allocation, with said input area implementing a non-subsumptive gesture basis set of independent gesture bases, with said gesture basis set having a series of available finger identities, and with each gesture basis of said gesture basis set including a path-dependent gesture parameter;
subsequent to said steps of detecting a first calibrating finger and providing an input area, concluding processing of a first gesture;
subsequent to said step of concluding processing of a first gesture, detecting a first selecting finger set of at least two gesturing fingers, with each finger of said first selecting finger set having a gestured path with an initial touch location on said input area;
determining a first selected identity set dependent on a relative position of said first calibrating location and said calibrating geometric element, with said first selected identity set comprising a distinct finger identity of said series of available finger identities for each finger of said first selecting finger set;
determining a first user request as a function of said first selected identity set and as a function of a value for each gesture parameter of a first gesture basis of said gesture basis set, said value for said each gesture parameter being a function of the gestured path of at least one finger of said first selecting finger set, with said first selected identity set being identical to the characteristic identity set of said first gesture basis; and
reporting said first user request to said host.

### Claim 29 (depends on 27)

A non-transitory computer-readable medium according to claim 27, wherein each gesture basis of said gesture basis set includes a gesture level parameter.

### Claim 30 (depends on 29)

A non-transitory computer-readable medium according to claim 29,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each finger of said first selecting finger set, said step of determining a first selected identity set (a) determines the nearest geometric element of said series of geometric elements to the gestured path of said each finger and (b) includes in said first selected identity set the finger identity with which said nearest geometric element is associated; and
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element, said first geometric element being the nearest geometric element to the gestured path of a finger of said first selecting finger set.

### Claim 31 (depends on 30)

A non-transitory computer-readable medium according to claim 30,
wherein prior to said step of concluding processing of a first gesture, said method further comprises the step of establishing at least one direction; and
wherein the region form of said first geometric element differs from the region form of a second geometric element of said series of geometric elements, with at least one difference between a property of the region form of said first geometric element and a property of the region form of said second geometric element being dependent on said at least one direction.

### Claim 32 (depends on 30)

A non-transitory computer-readable medium according to claim 30, wherein prior to said step of concluding processing of a first gesture, said method further comprises the step of detecting a second calibrating finger at a second calibrating location, with said calibrating geometric element being said second calibrating location.

### Claim 33 (depends on 32)

A non-transitory computer-readable medium according to claim 32,
wherein said first gesture basis includes a gesture direction parameter; and
wherein said first selectable parameterization includes a discrete direction for a range of directions that is dependent on a relative position of said first calibrating location and said second calibrating location.

### Claim 34 (depends on 28)

A non-transitory computer-readable medium according to claim 28, wherein each gesture basis of said gesture basis set includes a gesture level parameter.

### Claim 35 (depends on 34)

A non-transitory computer-readable medium according to claim 34,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each finger of said first selecting finger set, said step of determining a first selected identity set (a) determines the nearest geometric element of said series of geometric elements to the gestured path of said each finger and (b) includes in said first selected identity set the finger identity with which said nearest geometric element is associated; and
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element, said first geometric element being the nearest geometric element to the gestured path of a finger of said first selecting finger set.

### Claim 36 (depends on 34)

A non-transitory computer-readable medium according to claim 34,
wherein said input area comprises all regions of all geometric elements of a series of geometric elements, with each geometric element of said series of geometric elements being associated with a distinct finger identity of said series of available finger identities, and with said series of available finger identities comprising all finger identities with which a geometric element of said series of geometric elements is associated;
wherein for each of multiple geometric elements of said series of geometric elements other than a first geometric element of said series of geometric elements, a relative position of said each of multiple geometric elements and said first geometric element is dependent on said relative position of said first calibrating location and said calibrating geometric element; and
wherein said step of determining a first selected identity set comprises the substeps of:
determining that said first geometric element is the nearest geometric element of said series of geometric elements to the gestured path of a first finger of said first selecting finger set;
determining that the gestured path of a second finger of said first selecting finger set is nearest to a second geometric element of said series of geometric elements, with said second finger being distinct from said first finger;
determining that said first geometric element is said second geometric element;
including in said first selected identity set the finger identity with which said first geometric element is associated; and
including in said first selected identity set the finger identity with which an adjacent geometric element is associated, said adjacent geometric element being adjacent to said first geometric element in said series of geometric elements.

### Claim 37 (depends on 35)

A non-transitory computer-readable medium according to claim 35, wherein prior to said step of concluding processing of a first gesture, said method further comprises the step of detecting a second calibrating finger at a second calibrating location, with said calibrating geometric element being said second calibrating location.

### Claim 38 (depends on 36)

A non-transitory computer-readable medium according to claim 36, wherein
if said first geometric element is an end-of-series geometric element of said series of geometric elements, said adjacent geometric element is the geometric element adjacent in said series of geometric elements to said first geometric element; and
if said first geometric element is not an end-of-series geometric element of said series of geometric elements, said adjacent geometric element is the geometric element that is adjacent in said series of geometric elements to said first geometric element nearest to a midpoint between a location in the gestured path of said first finger and a location in the gestured path of said second finger.
