# US 2021/0232226 A1 · Determining a geographical location based on human gestures

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0232226 A1
- Document ID: US20210232226A1
- Status: Published application
- Kind: A1
- Application number: 16/890,507
- Filed: 2020-06-02
- Published: 2021-07-29
- Earliest claimed: 2020-01-28
- Assignees: Pison Technology, Inc.
- Applicants: Pison Technology, Inc.
- Inventors: David O. Cipoletta; Dexter W. Ang
- Web page: https://patentgrep.com/patent/US20210232226A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- H04W 4/026: {using orientation information, e.g. compass}
- H04W 4/027: {using movement velocity, acceleration information}
- H04W 4/029: Location-based management or tracking services
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

An apparatus includes a sensor constructed to be worn by a person and configured to sense information indicative of a direction intended by the person. The apparatus includes a processor, and storage for instructions executable by the processor. When executing the instructions, the processor determines the direction based on the information sensed by the sensor, and, based on the direction and a location of the person, determines a geographic location. The sensor can include a biopotential signal from which an intended gesture by the person can be determined.

## Claims

### Claim 1

A system comprising:
a biopotential sensor, the biopotential sensor configured to be worn by a person at a wrist and to sense biopotentials at the wrist;
a wrist location sensor, the wrist location sensor configured to be worn at the wrist and to provide wrist location data indicative of a location of the wrist; and
a processor;
wherein the system is configured to:
based on at least the wrist location data from the wrist location sensor, determine a directional vector intended by the person;
based on at least the biopotentials sensed by the biopotential sensor, detect a gesture indicating an intention to make a selection; and
based on the directional vector and the detected gesture, select a target, the selected target being indicated by the directional vector as determined when the gesture indicating the intention to make a selection is detected.

### Claim at position 2

2-30. (canceled)

### Claim 31 (depends on 1)

The system of claim 1, wherein the target is a geographic location.

### Claim 32 (depends on 1)

The system of claim 1, wherein the target is an object.

### Claim 33 (depends on 32)

The system of claim 32, wherein the system is further configured to:
after selecting the object based on the directional vector and the detected gesture, control the object;
wherein the step of controlling the object comprises:
based on at least the wrist location data from the wrist location sensor and the biopotentials sensed by the biopotential sensor, determining one or more commands;
transmitting the one or more commands to the object.

### Claim 34 (depends on 33)

The system of claim 33, wherein the system is further configured to:
initiate a mode in which the step of controlling the object may be performed;
wherein initiating the mode in which the step of controlling the object may be performed comprises:
based on one or more of (i) the wrist location data from the wrist location sensor and (ii) the biopotentials sensed by the biopotential sensor, detecting a wake word gesture, the wake word gesturing indicating an intention to initiate the mode in which the step of controlling the object may be performed.

### Claim 35 (depends on 1)

The system of claim 1, wherein the step of determining the directional vector intended by the person is performed based on both:
the wrist location data from the wrist location sensor; and
data indicating a location of the person.

### Claim 36 (depends on 35)

The system of claim 35, wherein the data indicating the location of the person is global positioning system (GPS) data.

### Claim 37 (depends on 35)

The system of claim 35, wherein the data indicating the location of the person is based on triangulation using directions from multiple reference points.

### Claim 38 (depends on 35)

The system of claim 35, wherein the step of selecting the target is based on at least:
the directional vector based on (i) the wrist location data from the wrist location sensor and (ii) the data indicating a location of the person;
the detected gesture based on at least the biopotentials sensed by the biopotential sensor; and
context data comprising information related to the target.

### Claim 39 (depends on 38)

The system of claim 38, wherein the context data comprises a location of the target.

### Claim 40 (depends on 38)

The system of claim 38, wherein the context data comprises image data or video data.

### Claim 41

A system comprising:
a biopotential sensor, the biopotential sensor configured to be worn by a person at a wrist and to sense biopotentials at the wrist; and
a wrist location sensor, the wrist location sensor configured to be worn at the wrist and to provide wrist location data indicative of a location of the wrist;
the system being configured to provide output data based on the biopotentials sensed by the biopotential sensor and the wrist location data sensed by the wrist location sensor to one or more processors configured to:
based on at least the wrist location data from the wrist location sensor, determine a directional vector intended by the person;
based on at least the biopotentials sensed by the biopotential sensor, detect a gesture indicating an intention to make a selection; and
based on the directional vector and the detected gesture, select a target, the selected target being indicated by the directional vector as determined when the gesture indicating the intention to make a selection is detected.

### Claim 42 (depends on 41)

The system of claim 41, wherein the target is a geographic location.

### Claim 43 (depends on 41)

The system of claim 41, wherein the target is an object.

### Claim 44 (depends on 43)

The system of claim 43, wherein the one or more processors are further configured to:
after selecting the object based on the directional vector and the detected gesture, control the object;
wherein the step of controlling the object comprises:
based on at least the wrist location data from the wrist location sensor and the biopotentials sensed by the biopotential sensor, determining one or more commands;
transmitting the one or more commands to the object.

### Claim 45 (depends on 44)

The system of claim 44, wherein the one or more processors are further configured to:
initiate a mode in which the step of controlling the object may be performed;
wherein initiating the mode in which the step of controlling the object may be performed comprises:
based on one or more of (i) the wrist location data from the wrist location sensor and (ii) the biopotentials sensed by the biopotential sensor, detecting a wake word gesture, the wake word gesturing indicating an intention to initiate the mode in which the step of controlling the object may be performed.

### Claim 46 (depends on 41)

The system of claim 41, wherein the step of determining the directional vector intended by the person is performed based on both:
the wrist location data from the wrist location sensor; and
data indicating a location of the person.

### Claim 47 (depends on 46)

The system of claim 46, wherein the data indicating the location of the person is global positioning system (GPS) data.

### Claim 48 (depends on 46)

The system of claim 46, wherein the data indicating the location of the person is based on triangulation using directions from multiple reference points.

### Claim 49 (depends on 46)

The system of claim 46, wherein the step of selecting the target is based on at least:
the directional vector based on (i) the wrist location data from the wrist location sensor and (ii) the data indicating a location of the person;
the detected gesture based on at least the biopotentials sensed by the biopotential sensor; and
context data comprising information related to the target.

### Claim 50 (depends on 49)

The system of claim 49, wherein the context data comprises a location of the target.

### Claim 51 (depends on 49)

The system of claim 49, wherein the context data comprises image data or video data.
