# US 2015/0177855 A1 · Air pointer with improved user experience

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0177855 A1
- Document ID: US20150177855A1
- Status: Published application
- Kind: A1
- Application number: 14/580,643
- Filed: 2014-12-23
- Published: 2015-06-25
- Earliest claimed: 2013-12-23
- Assignees: Movea
- Applicants: Movea
- Inventors: Pierre Grenet; Guillaume Aujay
- Web page: https://patentgrep.com/patent/US20150177855A1

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/0383: {Signal control means within the pointing device}
- G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
- G06F 2203/04801: Cursor retrieval aid, i.e. visual aspect modification, blinking, colour changes, enlargement or other visual cues, for helping user do find the cursor in graphical user interfaces
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The invention discloses a 3D pointing device and a method to control an object on a surface and improve the user experience when the user moves the object beyond the limits of the surface where the object can no longer be visualized. The user experience is enhanced by defining the behaviour of a cursor in a margin around the screen.

## Claims

### Claim 1

A system for controlling a virtual object on a surface comprising:
At least one of sensing and imaging capabilities configured for producing measurements in relation to one of a position, an attitude, and a motion of a pointing device;
Processing capabilities configured for calculating a first position (210, 221, 231, 241) of the virtual object from the measurements;
said processing capabilities being further configured to display the virtual object at the first position when the first position is located within a first subset (200) of the surface, and at a second position (210, 222, 232, 242) within the first subset when the first position of the virtual object is outside said first subset and inside a second subset (260), enclosing the first subset, said second subset having a finite size which depends on the speed of the virtual object.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processing capabilities are further configured to display the second position substantially on a border of the first subset of the surface.

### Claim 3 (depends on 1)

The system of claim 1 wherein an offset is added to at least one of coordinates x2 and y2 of the position of the virtual object in a frame of reference of the surface.

### Claim 4 (depends on 1)

The system of claim 1, wherein the processing capabilities are further configured to change the appearance of the virtual object based on the first position, when the first position is outside the first subset.

### Claim 5 (depends on 4)

The system of claim 4, wherein the appearance is based on the distance between the first position and one of the second position and the first subset.

### Claim 6 (depends on 1)

The system of claim 1, wherein processing capabilities are further configured to convert the angles of the device into variations of the horizontal position of the virtual object, said conversion being calculated in one of an absolute mode, a relative mode and a combination thereof based on a pitch angle of the device.

### Claim 7

A system for controlling a virtual object on a surface comprising:
At least one of sensing and imaging capabilities configured for producing measurements in relation to one of a position, an attitude, and a motion of a pointing device;
Processing capabilities configured for calculating a first position (210, 221, 231, 241) of the virtual object from the measurements;
said processing capabilities being further configured to display the virtual object at a second position within a first subset of the surface, said second position being calculated according to one of the first position and variations of the first position using a first gain g1 when the first position is located within the first subset and a second gain g2 when the first position is located inside a second subset, enclosing the first subset.

### Claim 8 (depends on 7)

The system of claim 7, wherein the first subset is a rectangle of coordinates (W, H) in a frame of reference of the surface, and the position (x2, y2) of the virtual object in the frame of reference of the surface is saturated at the edges of the first subset, with 0≦x2≦W and 0≦x2≦H.

### Claim 9

A system for controlling a virtual object on a surface comprising:
At least one of sensing and imaging capabilities configured for producing measurements in relation to one of a position, an attitude, and a motion of a pointing device;
Processing capabilities configured for calculating a first position (210, 221, 231, 241) of the virtual object from the measurements;
said processing capabilities being further configured to display the virtual object at a second position within a first subset of the surface, said second position being calculated using a mode of calculation chosen in a group comprising at least one of at least an absolute mode and a relative mode, the mode of calculation of said second position being switched according to the first position.

### Claim 10 (depends on 9)

The system of claim 9, wherein the first subset is a rectangle of coordinates (W, H) in a frame of reference of the surface, the first position having first coordinates (x1, y1) and the second position second coordinates (x2, y2) in said frame of reference.

### Claim 11 (depends on 10)

The system of claim 10, wherein the second coordinates are calculated:
in the absolute mode, by a saturation of the first coordinates to the edges of the first subset, by a formula of the type (x2, y2)=(min(max(0, x1); W); min(max(0; y1); H)).
in the relative mode, by:
the application of the variation (dx1, dy1) of the first coordinates (x1, y1) by a formula of the type: (x2, y2)=(x2+dx1, y2+dy1)
the saturation of the second coordinates (x2, y2) to the edges of the first subset, by a formula of the type (x2, y2)=(min(max(0, x2); W); min(max(0; y2); H)).

### Claim 12 (depends on 9)

The system of claim 9, wherein the first subset of the surface is enclosed by a second subset of finite size.

### Claim 13 (depends on 12)

The system of claim 12, wherein processing capabilities are further configured to:
switch from relative to absolute mode, if the first position is outside the first and the second subset
switch from absolute to relative mode, if the first position is inside the first subset.

### Claim 14 (depends on 10)

The system of claim 10, wherein the first subset of the surface is enclosed by a second subset of finite size, and the second position is calculated according to one the first position and the variations of the first position using a first gain g1 when the first position is located within the first subset and a second gain g2 when the first position is located inside the second subset.

### Claim 15

A system for controlling a virtual object on a surface comprising:
At least one of sensing and imaging capabilities configured for producing measurements in relation to one of a position, an attitude, and a motion of a pointing device;
Processing capabilities configured for calculating a first position (210, 221, 231, 241) of the virtual object from the measurements;
said processing capabilities being further configured to convert at least an orientation of the device into variations of the horizontal position of the virtual object, said conversion being calculated in one of an absolute mode, a relative mode and a combination thereof based on a pitch angle of the device.

### Claim 16 (depends on 15)

The system of claim 15 wherein:
in relative mode, a variation ΔX of the coordinate of the virtual pointer on an horizontal axis is obtained by a formula where ΔX=k*Δψ, wherein Δψ is a variation of the yaw angle, and k is a sensitivity factor;
in absolute modem at high pitch angles, the horizontal coordinate Xh of the virtual object in the horizontal axis is calculated by a formula where
[
X
h
⋮
⋮
]
=
k
*
gain
*
R
*
[
1
0
0
]
,
wherein k is the sensitivity factor used in relative mode, gain is a gain factor, R is a rotation matrix of the device.

### Claim 17 (depends on 16)

The system of claim 16, wherein the gain is calculated by the formula
gain
=
Ψ
ma


x
sin

(
Ψ
ma


x
)
,
wherein ψmax is the yaw angle which covers half of the screen, between the centre of said screen and one of the left and right edge, for the sensitivity factor k.

### Claim 18 (depends on 15)

The system of claim 15, wherein the coordinates of the virtual object are saturated into the edges of a first subset of the surface, which is a rectangle of coordinates (W, H) in a frame of reference of the surface.

### Claim 19 (depends on 15)

The system of claim 15, wherein a position P of the virtual object is calculated in a margin around the first subset as a combination between the position calculated in absolute mode and the position calculated in relative mode.

### Claim 20 (depends on 19)

The system of claim 19, wherein the position P of the virtual object is calculated by a formula of the type: P=α*PLP+(1×α)*PHP, wherein PLP is the position calculated according to the relative mode, PHP the position calculated according to the absolute mode, and α is a number between 0 and 1 that represents the relative contribution of each mode.

### Claim 21 (depends on 20)

The system of claim 20, wherein the number a progressively decreases between the edge of the first subset and the end of the margin.

### Claim 22 (depends on 19)

The system of claim 19, wherein the size of the margin depends on the size of the virtual object.
