# US 10,503,275 B2 · Computing interface system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,503,275 B2
- Document ID: US10503275B2
- Status: Granted
- Kind: B2
- Application number: 14/190,044
- Filed: 2014-02-25
- Published: 2014-06-26
- Granted: 2019-12-10
- Earliest claimed: 2012-11-24
- Assignees: Opdig, Inc.
- Applicants: Opdig, Inc.
- Inventors: Eric Jeffrey Keller; Vinh Vi Lam; Frank Peter Lambrecht
- Web page: https://patentgrep.com/patent/US10503275B2

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0233: {Character input methods}
- G06F 2203/0331: Finger worn pointing device
- G06F 2203/0383: Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Computing interface systems and methods are disclosed. Some implementations include a first accelerometer attached to a first fastening article that is capable of holding the first accelerometer in place on a portion of a thumb of a user. Some implementations may also include a second accelerometer attached to a second fastening article that is capable of holding the second accelerometer in place on a portion of a wrist of a user. Some implementations may additionally or alternatively include magnetometers and/or gyroscopes attached to the first and second fastening articles. Some implementations may also include a processing device configured to receive measurements from the accelerometers, magnetometers, and/or gyroscopes and identify, based on the measurements, symbols associated with motions of a user's hand and/or the orientation of the hand. Some implementations may allow a user to control a cursor in a three dimensional virtual space and interact with objects in that space.

## Claims

### Claim 1

A method comprising:
receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user;
receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;
receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user;
receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user;
detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;
when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer, wherein the orientation is determined based at least in part on the first set of magnetic flux measurements and the second set of magnetic flux measurements, in which determining the orientation comprises:
filtering the first set acceleration measurements to determine a first estimate of acceleration experienced by the first accelerometer while the thumb was at rest with respect to a hand of the user on the tap target, and
filtering the second set of acceleration measurements to determine a second estimate of acceleration experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target;
identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;
assigning a symbol associated with the tap target to the tap; and
transmitting, storing, or displaying the symbol.

### Claim 2 (depends on 1)

The method of claim 1, in which determining the orientation comprises:
filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target; and
filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

### Claim 3 (depends on 1)

The method of claim 1, comprising:
receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and
receiving a second set of angular rate measurements from a second gyroscope that is attached to the wrist of the user; and
wherein the orientation is determined based at least in part on first set of angular rate measurements and the second set of angular rate measurements.

### Claim 4 (depends on 1)

The method of claim 1, comprising:
determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and
wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

### Claim 5 (depends on 4)

The method of claim 4, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

### Claim 6 (depends on 4)

The method of claim 4, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

### Claim 7 (depends on 4)

The method of claim 4, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

### Claim 8

A method comprising:
receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user:
receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user:
receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user:
receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user:
detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface:
when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer, wherein the orientation is determined based at least in part on the first set of magnetic flux measurements and the second set of magnetic flux measurements, in which determining the orientation comprises:
filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap targets;
identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap:
assigning a symbol associated with the tap target to the tap: and
transmitting, storing, or displaying the symbol.

### Claim 9 (depends on 8)

The method of claim 8, in which determining the orientation comprises:
filtering the first set acceleration measurements to determine a first estimate of acceleration experienced by the first accelerometer while the thumb was at rest with respect to a hand of the user on the tap target; and
filtering the second set of acceleration measurements to determine a second estimate of acceleration experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

### Claim 10 (depends on 8)

The method of claim 8, in which determining the orientation comprises:
filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target; and
filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

### Claim 11 (depends on 8)

The method of claim 8, comprising:
receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and
receiving a second set of angular rate measurements from a second gyroscope that is attached to the wrist of the user; and
wherein the orientation is determined based at least in part on first set of angular rate measurements and the second set of angular rate measurements.

### Claim 12 (depends on 8)

The method of claim 8, comprising:
determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and
wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

### Claim 13 (depends on 12)

The method of claim 12, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

### Claim 14 (depends on 12)

The method of claim 12, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

### Claim 15 (depends on 12)

The method of claim 12, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

### Claim 16

A system comprising:
a data processing apparatus;
a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising:
receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user;
receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;
receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user;
receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user;
detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;
when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer, wherein the orientation is determined based at least in part on first set of magnetic flux measurements and the second set of magnetic flux measurements, in which determining the orientation comprises:
filtering the first set acceleration measurements to determine a first estimate of acceleration experienced by the first accelerometer while the thumb was at rest with respect to a hand of the user on the tap target, and
filtering the second set of acceleration measurements to determine a second estimate of acceleration experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target;
identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;
assigning a symbol associated with the tap target to the tap; and
transmitting, storing, or displaying the symbol.

### Claim 17 (depends on 16)

The system of claim 16, in which determining the orientation comprises:
filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target; and
filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

### Claim 18 (depends on 16)

The system of claim 16, in which the operations comprise:
receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and
receiving a second set of angular rate measurements from a second gyroscope that is attached to the wrist of the user; and
wherein the orientation is determined based at least in part on first set of angular rate measurements and the second set of angular rate measurements.

### Claim 19 (depends on 16)

The system of claim 16, in which the operations comprise:
determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap; and
wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer.

### Claim 20 (depends on 19)

The system of claim 19, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

### Claim 21 (depends on 19)

The system of claim 19, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

### Claim 22 (depends on 19)

The system of claim 19, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

### Claim 23 (depends on 16)

The system of claim 16, in which determining the orientation comprises:
filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap target.

### Claim 24

A system comprising:
a data processing apparatus;
a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising:
receiving a first set of acceleration measurements from a first accelerometer that is attached to a thumb of a user;
receiving a second set of acceleration measurements from a second accelerometer that is attached to a wrist of the user;
receiving a first set of magnetic flux measurements from a first magnetometer that is attached to the thumb of the user;
receiving a second set of magnetic flux measurements from a second magnetometer that is attached to the wrist of the user;
detecting, based at least in part on the first set of acceleration measurements, when the thumb is tapped on a surface;
when a tap of the thumb is detected, determining, based at least in part on the first set of acceleration measurements and the second set of acceleration measurements, an orientation of the first accelerometer relative to the second accelerometer, wherein the orientation is determined based at least in part on first set of magnetic flux measurements and the second set of magnetic flux measurements;
identifying, based on the orientation, a tap target, from among a plurality of tap targets located on fingers of the user, that was touched during the tap;
determining, based on the second set of acceleration measurements, an estimate of an orientation of an acceleration experienced by the second accelerometer with respect to the axes of the second accelerometer during the tap;
assigning a symbol associated with the tap target to the tap, wherein assigning the symbol to the tap comprises selecting the symbol from among a plurality of symbols associated with the tap target based on the orientation of the acceleration experienced by the second accelerometer: and
transmitting, storing, or displaying the symbol.

### Claim 25 (depends on 24)

The system of claim 24, in which the acceleration experienced by the second accelerometer is dominated by acceleration caused by the gravitational force of the Earth and the selection is made based at least in part on an estimate of an angle between the gravitational acceleration and an axis running approximately parallel to a forearm of the user.

### Claim 26 (depends on 24)

The system of claim 24, in which the user is enabled to indicate a choice from among the plurality of the symbols associated with the tap target, by adjusting the angle of wrist or the angle of a forearm of the user with respect to the gravitational force of the Earth during the tap.

### Claim 27 (depends on 24)

The system of claim 24, in which the user is enabled to turn a palm side of the wrist down to face towards the Earth to enter a cursor manipulation mode, in which acceleration measurements from the second accelerometer are used to move a cursor in a virtual space.

### Claim 28 (depends on 24)

The system of claim 24, in which determining the orientation comprises:
filtering the first set of acceleration measurements to determine an estimate of a deceleration vector caused by the impact of the thumb with the tap target.

### Claim 29 (depends on 24)

The system of claim 24 in which determining the orientation comprises:
filtering the first set magnetic flux measurements to determine a first estimate of magnetic flux experienced by the first magnetometer while the thumb was at rest with respect to the hand of the user on the tap target; and
filtering the second set of magnetic flux measurements to determine a second estimate of magnetic flux experienced by the second accelerometer while the thumb was at rest with respect to the hand of the user on the tap target.

### Claim 30 (depends on 24)

The system of claim 24, in which the operations comprise:
receiving a first set of angular rate measurements from a first gyroscope that is attached to the thumb of the user; and
receiving a second set of angular rate measurements from a second gyroscope that is attached to the wrist of the user; and
wherein the orientation is determined based at least in part on first set of angular rate measurements and the second set of angular rate measurements.