# US 2021/0173490 A1 · Cursor Mode Switching

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0173490 A1
- Document ID: US20210173490A1
- Status: Published application
- Kind: A1
- Application number: 17/155,019
- Filed: 2021-01-21
- Published: 2021-06-10
- Earliest claimed: 2013-05-17
- Assignees: Ultrahaptics IP Two Limited
- Applicants: Ultrahaptics IP Two Limited
- Inventors: David S. HOLZ
- Web page: https://patentgrep.com/patent/US20210173490A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- B65D 75/5877: {connected to a planar surface of the package wall}
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B65D: CONTAINERS FOR STORAGE OR TRANSPORT OF ARTICLES OR MATERIALS, e.g. BAGS, BARRELS, BOTTLES, BOXES, CANS, CARTONS, CRATES, DRUMS, JARS, TANKS, HOPPERS, FORWARDING CONTAINERS; ACCESSORIES, CLOSURES, OR FITTINGS THEREFOR; PACKAGING ELEMENTS; PACKAGES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Methods and systems for processing input from an image-capture device for gesture-recognition. The method further includes computationally interpreting user gestures in accordance with a first mode of operation; analyzing the path of movement of an object to determine an intent of a user to change modes of operation; and, upon determining an intent of the user to change modes of operation, subsequently interpreting user gestures in accordance with the second mode of operation.

## Claims

### Claim 1

A system for gesture-recognition, comprising:
a computer memory for storing a digital representation of a determined path of movement of an object of interest in a three-dimensional (3D) space; and
a processor coupled to the computer memory; and
a processor-executable mode-control module configured to:
analyze the path of movement to determine an intent of a user to be in a first mode of operation comprising a drawing mode in which a line is displayed following movement of the object of interest; and
fill in a displayed line at a rate that is faster than a detected rate of the object of interest until the displayed line catches up with the object of interest, and thereafter displaying movement of the object of interest at the detected rate of the object of interest.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processor-executable mode-control module is further configured to:
determine a pointing direction of the object of interest;
based upon the determined pointing direction of the object of interest, determine that the intent of the user is to change from another mode of operation to the first mode of operation comprising the drawing mode; and
perform the filling in of the displayed line when in the drawing mode.

### Claim 3 (depends on 1)

The system of claim 1, wherein the filling in of the displayed line includes passing position data relating to the object of interest to a drawing application.

### Claim 4 (depends on 1)

The system of claim 1, wherein no position data is passed until a mode of the gesture is determined, after which faster-rate motion is passed until the displayed line catches up to a current position of the object of interest .

### Claim 5 (depends on 4)

The system of claim 4, further including passing normal-rate position information after the displayed line catches up to the current position of the object of interest.

### Claim 6 (depends on 1)

The system of claim 1, wherein a discontinuity or jolt is displayed as distance traveled by the object of interest is filled in once a mode of operation is determined to be the drawing mode.

### Claim 7 (depends on 1)

The system of claim 1, further including re-tracing a path already traveled by the object of interest by drawing in the path at a higher velocity than that traveled by the object of interest.

### Claim 8 (depends on 1)

The system of claim 1, wherein a mode of operation for a gesture is not determined until after the object of interest making the gesture has traveled some distance in 3D space.

### Claim 9 (depends on 1)

The system of claim 1, wherein no line is displayed for movement along a path when a mode of operation is a movement mode.

### Claim 10

A method of computationally interpreting gestures, the method comprising:
obtaining a digital representation of a determined path of movement of an object of interest in a three-dimensional (3D) space;
analyzing the path of movement to determine an intent of a user to be in a first mode of operation comprising a drawing mode in which a line is displayed following movement of the object of interest; and
filling in a displayed line at a rate that is faster than a detected rate of the object of interest until the displayed line catches up with the object of interest, and thereafter displaying movement of the object of interest at the detected rate of the object of interest.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
determining a pointing direction of the object of interest;
based upon the determined pointing direction of the object of interest, determining that the intent of the user is to change from another mode of operation to the first mode of operation comprising the drawing mode; and
performing the filling in of the displayed line when in the drawing mode.

### Claim 12 (depends on 10)

The method of claim 10, wherein the filling in of the displayed line includes passing position data relating to the object of interest to a drawing application.

### Claim 13 (depends on 10)

The method of claim 10, wherein no position data is passed until a mode of the gesture is determined, after which faster-rate motion is passed until the displayed line catches up to a current position of the object of interest.

### Claim 14 (depends on 13)

The method of claim 13, further including passing normal-rate position information after the displayed line catches up to the current position of the object of interest.

### Claim 15 (depends on 10)

The method of claim 10, further including displaying a discontinuity or jolt as distance traveled by the object of interest is filled in once a mode of operation is determined to be the drawing mode.

### Claim 16 (depends on 10)

The method of claim 10, further including re-tracing a path already traveled by the object of interest by drawing in the path at a higher velocity than that traveled by the object of interest.

### Claim 17 (depends on 10)

The method of claim 10, wherein a mode of operation for a gesture is not determined until after the object of interest making the gesture has traveled some distance in 3D space.

### Claim 18 (depends on 10)

The method of claim 10, wherein no line is displayed for movement along a path when a mode of operation is a movement mode.

### Claim 19

A non-transitory computer readable storage medium impressed with computer program instructions to computationally interpret gestures, which instructions, when executed on a processor, implement:
obtaining a digital representation of a determined a path of movement of an object of interest in a three-dimensional (3D) space;
analyzing the path of movement to determine an intent of a user to be in a first mode of operation comprising a drawing mode in which a line is displayed following movement of the object of interest; and
filling in a displayed line at a rate that is faster than a detected rate of the object of interest until the displayed line catches up with the object of interest, and thereafter displaying movement of the object of interest at the detected rate of the object of interest.

### Claim 20 (depends on 19)

The non-transitory computer readable storage medium of claim 19, wherein the instructions, when executed on the processor, further implement:
determining a pointing direction of the object of interest;
based upon the determined pointing direction of the object of interest, determining that the intent of the user is to change from another mode of operation to the first mode of operation comprising the drawing mode; and
performing the filling in of the displayed line when in the drawing mode.
