# US 2016/0252977 A1 · Determining forward pointing direction of a handheld device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0252977 A1
- Document ID: US20160252977A1
- Status: Published application
- Kind: A1
- Application number: 14/951,858
- Filed: 2015-11-25
- Published: 2016-09-01
- Earliest claimed: 2010-06-03
- Assignees: Hillcrest Laboratories, Inc.
- Applicants: Hillcrest Laboratories, Inc.
- Inventors: Matthew G. LIBERTY; Bryan A. COOK
- Web page: https://patentgrep.com/patent/US20160252977A1

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0383: {Signal control means within the pointing device}
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G08C 17/02: using a radio link
- G08C 23/04: using light waves, e.g. infrared
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
- G08C 2201/32: Remote control based on movements, attitude of remote control device
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A forward pointing direction associated with a handheld device is estimated or determined by, for example, calculating a center of rotation of the device. A resultant combined or selected bias estimate may then be used to compensate the biased output of the sensor in, e.g., a 3D pointing device.

## Claims

### Claim 1

A device comprising:
an accelerometer for sensing an acceleration of said device and outputting at least one acceleration output associated therewith;
at least one sensor for sensing rotation of said device and outputting at least one angular velocity output associated therewith; and
a processing unit for processing said acceleration output and said at least one angular velocity output to determine a forward pointing direction of said device based on a calculation of a center of rotation of said device.

### Claim 2 (depends on 1)

The device of claim 1, wherein the calculation of a center of rotation of said device uses the processed outputs and a gravitational constant.

### Claim 3 (depends on 2)

The device of claim 2, wherein said calculation uses:
an angular velocity matrix based upon said angular velocity output;
an angular acceleration matrix based upon said angular velocity output;
a direction cosine matrix based upon said angular velocity matrix and said angular acceleration matrix for defining said device frame of reference relative to an earth frame of reference; and
a linear acceleration based on said acceleration output.

### Claim 4 (depends on 1)

The device of claim 1, wherein said processing comprises converting raw sensor data into International System (SI) unit data.

### Claim 5 (depends on 4)

The device of claim 4, wherein said SI unit data is filtered to remove undesirable sensor characteristics comprising at least one of variable bias offset, cross-axis effects, scale variations, non-linearities, temperature effects and aging effects.

### Claim 6 (depends on 5)

The device of claim 5, further comprising a radio frequency (RF) transmitter communicatively connected to said processing unit.

### Claim 7 (depends on 6)

The device of claim 6, wherein said RF transmitter is configured to transmit said forward direction calculation result to a host machine.

### Claim 8 (depends on 6)

The device of claim 6, wherein said RF transmitter is configured to transmit filtered data to a host machine for use by said host machine to determine a forward direction of said device based on a calculation of a center of rotation of said device using said filtered data and a gravitational constant.

### Claim 9

A method for determining a forward pointing direction of a device, said method comprising:
collecting data associated with said device's acceleration and rotation while said device is in motion; and
determining said forward pointing direction of said device based on the collected data.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
filtering said data to remove undesirable sensor characteristics.

### Claim 11 (depends on 10)

The method of claim 10, wherein said undesirable sensor characteristics comprises at least one of variable bias offset, cross-axis effects, scale variations, non-linearities, temperature effects and aging effects.

### Claim 12 (depends on 9)

The method of claim 9, wherein the center of rotation of the device and wherein said calculating can be expressed as:
b

c
=
(
b

Ω
.
+
Ω
2
b
)

(
b

a
-
Q
B
←
U

u

g
)
,
where:
b{dot over (Ω)} an angular acceleration matrix associated with said device in a body frame of reference, bΩ2 is a square of an angular velocity matrix associated with said device in said body frame of reference, a pre-superscript b is a linear acceleration associated with said device in said body frame of reference,
Q
B
->
U
_
is a direction cosine matrix defining said body frame of reference relative to a user frame of reference and ug is earth's gravitational constant associated with said user frame of reference.

### Claim 13 (depends on 12)

The method of claim 12, wherein said b{dot over (Ω)} is:
b

Ω
.
=
(
0
-
ω
.
z
b
ω
.
y
b
ω
.
z
b
0
-
ω
.
z
b
-
ω
.
y
b
ω
.
x
b
0
)
,
where:
b{dot over (Ω)}x is the x component of the angular acceleration of said device in said body frame of reference, b{dot over (ω)}y is the y component of the angular acceleration of said device in said body frame of reference and b{dot over (ω)}z is the z component of the angular acceleration of said device in said body frame of reference.

### Claim 14 (depends on 12)

The method of claim 12 wherein said bΩ2 is:
Ω
2
b
=
(
-
ω
y
2
b
-
ω
z
2
b
ω
x
b

ω
y
b
ω
x
b

ω
z
b
ω
x
b

ω
y
b
-
ω
x
2
b
-
ω
z
2
b
ω
y
b

ω
z
b
ω
x
b

ω
z
b
ω
y
b

ω
z
b
-
ω
x
2
b
-
ω
y
2
b
)
,
where:
bΩx is the x component of the angular velocity of said device in said body frame of reference, bωy is the y component of the angular velocity of said device in said body frame of reference and bωz is the z component of the angular velocity of said device in said body frame of reference.

### Claim 15 (depends on 12)

The method of claim 12 wherein multiple calculations of said device's center of rotation vector are combined to optimize the center of rotation vector calculation.

### Claim 16 (depends on 15)

The method of claim 15 wherein said combining comprises at least one of low-pass filtering, Kalman filtering and Bayesian filtering.

### Claim 17 (depends on 12)

The method of claim 12, wherein said center of rotation vector calculation result is offset based on an offset value of an accelerometer, associated with said device, from a center of said device.

### Claim 18 (depends on 12)

The method of claim 12, wherein said body frame of reference is adjusted based on calculating said forward direction.

### Claim 19 (depends on 9)

The method of claim 9, wherein the step of determining further comprises calculating a center of rotation of the device as:
bc=((b{dot over (Ω)}2+bΩ22)−(I+bΩTΔt)(b{dot over (Ω)}1+bΩ12))−1(ba2−(I+bΩTΔt)ba1),
where:
b{dot over (Ω)}1 is an angular acceleration matrix of a first sample associated with said device in a body frame of reference, b{dot over (Ω)}2 is an angular acceleration matrix of a second sample associated with said device in a body frame of reference, bΩ12 is the square of the angular velocity matrix of said first sample associated with said device in said body frame of reference, bΩ22 is the square of the angular velocity matrix of said second sample associated with said device in said body frame of reference, a pre-superscript b subscript 1 is a linear acceleration of said first sample associated with said device in said body frame of reference, a pre-superscript b subscript 2 is a linear acceleration of said second sample associated with said device in said body frame of reference, bΩTΔt is the average angular velocity between said first sample and said second sample and I is an identity matrix.
