# US 11,762,473 B2 · Gesture control systems with logical states

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,762,473 B2
- Document ID: US11762473B2
- Status: Granted
- Kind: B2
- Application number: 17/933,287
- Filed: 2022-09-19
- Published: 2023-01-12
- Granted: 2023-09-19
- Earliest claimed: 2020-01-28
- Assignees: Pison Technology, Inc.
- Applicants: Pison Technology, Inc.
- Inventors: David O. Cipoletta; Dexter W. Ang
- Web page: https://patentgrep.com/patent/US11762473B2

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- H04W 4/026: {using orientation information, e.g. compass}
- H04W 4/027: {using movement velocity, acceleration information}
- H04W 4/029: Location-based management or tracking services
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Systems and methods for gesture-based control are disclosed. In some embodiments, a system may include a wearable device configured to obtain physiological data and wrist location data. The system may be configured to detect a first gesture and transition to an object control state in which changes in the wrist location data and/or the physiological data are configured to control a movement of the object. In the object control state, the system may be configured to detect a first motion of a body part, generate a first command to move the object in a first command direction, detect a second motion of the body part, and generate a command to move the object in a second command direction. The system may detect a second gesture indicating an intention to cease control of the object, and transition out of the object control state.

## Claims

### Claim 1

A system for gesture-based control, the system comprising:
a wearable device configured to be worn on a wrist of a person and comprising one or more sensors, the wearable device being configured to obtain at least:
physiological data, the physiological data being configured to indicate a state of a person’s hand; and
wrist location data, the wrist location data comprising information relating to a state of the person’s wrist;
wherein the system is configured to:
based on at least the physiological data, detect a first gesture indicating an intention to control an object;
in response to detecting the first gesture, transition to an object control state in which changes in the wrist location data and/or the physiological data are configured to control a movement of the object;
while the system is in the object control state:
detect, based on the physiological data and/or the wrist location data, a first motion of a body part of the person in a first motion direction;
in response to detecting the first motion of the body part of the person in the first motion direction, generate a first command to move the object in a first command direction that is mapped to the first motion direction;
detect, based on the physiological data and/or the wrist location data, a second motion of the body part of the person in a second motion direction that is different from the first motion direction; and
in response to detecting the motion of the body part of the person in the second direction, generate a second command to move the object in a second command direction that is mapped to the second motion direction, the second command direction being different than the first command direction;
after generating the first and second commands to move the object in the first command direction and the second command direction, detect, based on at least the physiological data, a second gesture indicating an intention to cease control of the object; and
in response to detecting the second gesture, transition out of the object control state.

### Claim 2 (depends on 1)

The system of claim 1, wherein the first gesture comprises an index finger lift-and-hold.

### Claim 3 (depends on 2)

The system of claim 2, wherein the second gesture comprises ending the index finger lift-and-hold.

### Claim 4 (depends on 1)

The system of claim 1, wherein while the system is in the object control state, the system is further configured to:
detect, based on the physiological data and/or the wrist location data, that the body part of the person is in a neutral position;
in response to detecting that the body part of the person is in the neutral position, cause the object to remain stationary.

### Claim 5 (depends on 1)

The system of claim 1, wherein the object is a virtual object.

### Claim 6 (depends on 1)

The system of claim 1, wherein the object is an unmanned vehicle.

### Claim 7 (depends on 1)

The system of claim 1, wherein the one or more sensors comprises a plurality of electrodes, and the physiological data is based on electrical signals indicating activities of nerves and muscles in and around the wrist of the person.

### Claim 8 (depends on 1)

The system of claim 1, wherein the system further comprises a responsive device, wherein the responsive device is configured to perform the steps of detecting the first gesture, the second gesture, the first motion, and the second motion based on the physiological data and/or the wrist location data obtained by the wearable device.

### Claim 9 (depends on 1)

The system of claim 1, wherein the detecting the first gesture comprises:
based on at least the wrist location data, determine a directional vector intended by the person;
based on at least the physiological data, detect a selection gesture indicating an intention to make a selection; and
based on the directional vector and the detected selection gesture, select a target, the selected target being indicated by the directional vector as determined when the selection gesture is detected, wherein the target is or includes the object to be controlled in the object control state.

### Claim 10 (depends on 1)

The system of claim 1, wherein the first motion direction and the first command direction are different directions relative to a body of the person.

### Claim 11

A method for gesture-based control, the method being performed using a system comprising a wearable device configured to be worn on a wrist of a person and comprising one or more sensors, the method comprising:
obtaining, using the wearable device, physiological data, the physiological data being configured to indicate a state of a person’s hand;
obtaining, using the wearable device, wrist location data, the wrist location data comprising information relating to a state of the person’s wrist;
based on at least the physiological data, detecting a first gesture indicating an intention to control an object;
in response to detecting the first gesture, transitioning the system to an object control state in which changes in the wrist location data and/or the physiological data are configured to control a movement of the object;
while the system is in the object control state:
detecting, based on the physiological data and/or the wrist location data, a first motion of a body part of the person in a first motion direction;
in response to detecting the first motion of the body part of the person in the first motion direction, generating a first command to move the object in a first command direction that is mapped to the first motion direction;
detecting, based on the physiological data and/or the wrist location data, a second motion of the body part of the person in a second motion direction that is different from the first motion direction; and
in response to detecting the motion of the body part of the person in the second direction, generating a second command to move the object in a second command direction that is mapped to the second motion direction, the second command direction being different than the first command direction; and
after generating the commands to move the object in the first command direction and the second command direction, detecting, based on at least the physiological data, a second gesture indicating an intention to cease control of the object; and
in response to detecting the second gesture, transitioning the system out of the object control state.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first gesture comprises an index finger lift-and-hold.

### Claim 13 (depends on 12)

The method of claim 12, wherein the second gesture comprises ending the index finger lift-and-hold.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
while the system is in the object control state:
detecting, based on the physiological data and/or the wrist location data, that the body part of the person is in a neutral position; and
in response to detecting that the body part of the person is in the neutral position, causing the object to remain stationary.

### Claim 15 (depends on 11)

The method of claim 11, wherein the object is a virtual object.

### Claim 16 (depends on 11)

The method of claim 11, wherein the object is an unmanned vehicle.

### Claim 17 (depends on 11)

The method of claim 11, wherein the one or more sensors comprises a plurality of electrodes, and the physiological data is based on electrical signals indicating activities of nerves and muscles in and around the wrist of the person.

### Claim 18 (depends on 11)

The method of claim 11, wherein the system further comprises a responsive device, wherein the responsive device is configured to perform the steps of detecting the first gesture, the second gesture, the first motion, and the second motion based on the physiological data and/or the wrist location data obtained by the wearable device.

### Claim 19 (depends on 11)

The method of claim 11, wherein the detecting the first gesture comprises:
based on at least the wrist location data, determining a directional vector intended by the person;
based on at least the physiological data, detecting a selection gesture indicating an intention to make a selection; and
based on the directional vector and the detected selection gesture, selecting a target, the selected target being indicated by the directional vector as determined when the selection gesture is detected, wherein the target is or includes the object to be controlled in the object control state.

### Claim 20 (depends on 11)

The method of claim 11, wherein the first motion direction and the first command direction are different directions relative to a body of the person.