# US 2021/0342013 A1 · Velocity field interaction for free space gesture interface and control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342013 A1
- Document ID: US20210342013A1
- Status: Published application
- Kind: A1
- Application number: 17/379,915
- Filed: 2021-07-19
- Published: 2021-11-04
- Earliest claimed: 2013-10-16
- Assignees: Ultrahaptics IP Two Limited
- Applicants: Ultrahaptics IP Two Limited
- Inventors: Isaac COHEN; David S. HOLZ; Maxwell SILLS
- Web page: https://patentgrep.com/patent/US20210342013A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0485: Scrolling or panning
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The technology disclosed relates to automatically interpreting a gesture of a control object in a three dimensional sensor space by sensing a movement of the control object in the three dimensional sensor space, sensing orientation of the control object, defining a control plane tangential to a surface of the control object and interpreting the gesture based on whether the movement of the control object is more normal to the control plane or more parallel to the control plane.

## Claims

### Claim 1

A method of navigating a multi-layer presentation tree using gestures of a control object in a three-dimensional (3D) sensor space, using a 3D sensor, the method including:
processing an output of a camera of the 3D sensor thereby sensing a movement of the control object in any direction in the 3D sensor space using a control plane that remains tangent to a surface of the control object throughout the movement of the control object, the control plane being defined by a sensed orientation of the control object; and
interpreting by a computing device a direction of the movement of the control object as scrolling through a particular level of the multi-layer presentation tree when a direction of the movement of the control object is more normal with respect to the surface of the tangent control plane than parallel with respect to the surface of the control plane.

### Claim 2 (depends on 1)

The method of claim 1, wherein the control object includes a detected sub-object that is a portion of the control object and wherein the method further includes processing a sensed movement of the sub-object and interpreting the sensed movement of the sensed sub-object as a gesture interacting with the multi-layer presentation tree.

### Claim 3 (depends on 2)

The method of claim 2, wherein the control object is a hand and the sub-object is a finger of the hand.

### Claim 4 (depends on 1)

The method of claim 1, further including: (i) traversing menus responsive to movement of a first sub-object of a first hand and (ii) traversing menu paths responsive to movement of a second sub-object of a second hand.

### Claim 5 (depends on 1)

A non-transitory computer-readable recording medium having computer instructions recorded thereon, the computer instructions, when executed by one or more processors, cause the one or more processors to perform the method of claim 1.

### Claim 6 (depends on 1)

A system comprising a memory storing computer instructions and one or more processors, the computer instructions, when executed by the one or more processors, cause the one or more processors to perform the method of claim 1.

### Claim 7

A method of interpreting a gesture of a control object in a three-dimensional (3D) sensor space relative to one or more objects depicted in a display, the method including:
interpreting, by a computing device, a sensed movement of the control object moving in any direction through the 3D sensor space using a 3D sensor as a path on the display; and
duplicating an object, of the one or more of the objects depicted in the display, that intersect the path as interpreted.

### Claim 8 (depends on 7)

The method of claim 7, wherein the duplicated object is pre-selected before the sensed movement that is interpreted as the path.

### Claim 9 (depends on 7)

The method of claim 7, wherein the sensed movement is interpreted as the path on the display when a speed of the movement exceeds a pre-determined threshold.

### Claim 10 (depends on 9)

The method of claim 9, wherein the pre-determined threshold is 20 cm per second.

### Claim 11 (depends on 9)

The method of claim 9, wherein the pre-determined threshold is 30 cm per second.

### Claim 12 (depends on 9)

The method of claim 9, wherein the pre-determined threshold is 40 cm per second.

### Claim 13 (depends on 7)

The method of claim 7, wherein the duplicating of the object only duplicates objects, of the one or more objects depicted in the display, that interest the path as interpreted.

### Claim 14 (depends on 7)

The method of claim 7, wherein the path, as interpreted, intersects only two objects, of the one or more objects depicted in the display and wherein the duplicating duplicates the only two objects that are intersected by the path as interpreted.

### Claim 15 (depends on 7)

A non-transitory computer-readable recording medium having computer instructions recorded thereon, the computer instructions, when executed by one or more processors, cause the one or more processors to perform the method of claim 7.

### Claim 16 (depends on 7)

A system comprising a memory storing computer instructions and one or more processors, the computer instructions, when executed by the one or more processors, cause the one or more processors to perform the method of claim 7.
