# US 2017/0285756 A1 · Gesture control of interactive events using multiple wearable devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0285756 A1
- Document ID: US20170285756A1
- Status: Published application
- Kind: A1
- Application number: 15/084,743
- Filed: 2016-03-30
- Published: 2017-10-05
- Earliest claimed: 2016-03-30
- Assignees: Huami Inc.
- Applicants: Huami Inc.
- Inventors: Fei Wang; Ting Chen; Mu Yu
- Web page: https://patentgrep.com/patent/US20170285756A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- H04B 1/385: {Transceivers carried on the body, e.g. in helmets}
- H04W 4/70: Services for machine-to-machine communication [M2M] or machine type communication [MTC]
- H04B 2001/3861: {carried in a hand or on fingers}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04B: TRANSMISSION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Systems and methods for gesture control of an interactive event using multiple wearable devices are herein disclosed as comprising, in an implementation, receiving signal data indicative of at least one gesture from a first sensor of a first wearable device and a second sensor of a second wearable device, performing pre-processing on the signal data by a computing device in communication with the first wearable device and the second wearable device, performing feature extraction on the pre-processed signal data by the computing device, and determining the at least one gesture based on the feature extracted signal data and offline training data by the computing device. In an implementation, the first sensor and the second sensor comprise one or more of a three-axis accelerometer, a six-axis accelerometer, or an electromyography sensor, and can be configured to calibrate the other.

## Claims

### Claim 1

A method for gesture control of an interactive event using multiple wearable devices, comprising:
receiving, from a first sensor of a first wearable device and a second sensor of a second wearable device, signal data indicative of at least one gesture;
performing, by a computing device in communication with the first wearable device and the second wearable device, pre-processing on the signal data;
performing, by the computing device, feature extraction on the pre-processed signal data; and
determining, by the computing device, the at least one gesture based on the feature extracted signal data and offline training data.

### Claim 2 (depends on 1)

The method of claim 1, wherein performing pre-processing on the signal data comprises:
removing data outliers by applying a first sliding-window-based filter to the signal data;
performing adaptive filtering on the signal data in response to removing the data outliers;
removing data indicative of external force by applying a low-pass filter to the adaptive filtered signal data; and
segmenting the signal data by applying a second sliding-window-based filter to the signal data in response to removing the data indicative of external force.

### Claim 3 (depends on 2)

The method of claim 2, wherein performing adaptive filtering on the signal data comprises:
determining a higher quality portion of the signal data; and
processing the signal data using the higher quality portion to denoise a lower quality portion of the signal data using a least mean squares adaptive filter.

### Claim 4 (depends on 3)

The method of claim 3, wherein determining a higher quality portion of the signal data comprises:
performing a first independent component analysis on portions of the signal data received from the first sensor and a second independent component analysis on portions of the signal data received from the second sensor; and
selecting the portions of the signal data received from the first sensor or the portions of the signal data received from the second sensor as the higher quality portion of the signal data based on the first independent component analysis and the second independent component analysis.

### Claim 5 (depends on 1)

The method of claim 1, wherein performing feature extraction on the pre-processed signal data comprises extracting at least one of a time-domain feature or a frequency-domain feature from the pre-processed signal data.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the at least one gesture comprises:
combining portions of the feature extracted signal data received from the first sensor and portions of the feature extracted signal data received from the second sensor to generate processed signal data;
identifying, based on the offline training data, a library of interactive events, wherein gesture probabilities associated with an interactive event indicate the probability that a corresponding gesture is signalled for the interactive event; and
determining the at least one gesture by comparing the processed signal data to gesture probabilities associated with the interactive event.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first sensor and the second sensor comprise one or more of a three-axis accelerometer, a six-axis accelerometer, or an electromyography sensor.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first sensor is configured to calibrate the second sensor and wherein the second sensor is configured to calibrate the first sensor.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first wearable device and the second wearable device are in direct communication.

### Claim 10 (depends on 1)

The method of claim 1, wherein at least one of the first wearable device or the second wearable device is a wristband.

### Claim 11

A wearable device for gesture control of an interactive event, comprising:
a body configured to be coupled to a portion of a user;
a sensor comprising an accelerometer and an electromyography sensor;
a communication component configured to communicate signal data generated by the sensor to at least one of a computing device or a second wearable device in communication with the computing device; and
a memory and a processor configured to execute instructions stored in the memory to:
generate signal data indicative of a motion of the wearable device and a muscle activity of the portion of the user to which the body is coupled; and
communicate the signal data to the computing device for determining at least one gesture made by the user in connection with the interactive event.

### Claim 12 (depends on 11)

The wearable device of claim 11, wherein the accelerometer comprises at least one of a three-axis accelerometer or a six-axis accelerometer.

### Claim 13 (depends on 11)

The wearable device of claim 11, wherein the sensor of the wearable device is configured to calibrate the sensor of the second wearable device and wherein the sensor of the second wearable device is configured to calibrate the sensor of the wearable device.

### Claim 14 (depends on 11)

The wearable device of claim 11, wherein the wearable device is in direct communication with the second wearable device.

### Claim 15 (depends on 11)

The wearable device of claim 11, wherein the wearable device is a wristband.

### Claim 16

A system for gesture control of an interactive event using multiple wearable devices, comprising:
a first wearable device comprising a first accelerometer, a first electromyography sensor, and a first communication component;
a second wearable device comprising a second accelerometer, a second electromyography sensor, and a second communication component;
a computing device in communication with the first communication component and the second communication component, the computing device comprising a memory and a processor configured to execute instructions stored in the memory to:
receive signal data indicative of at least one gesture from the first wearable device and the second wearable device;
perform pre-processing on the signal data;
perform feature extraction on the pre-processed signal data; and
determine the at least one gesture based on the feature extracted signal data and offline training data.

### Claim 17 (depends on 16)

The system of claim 16, wherein the first accelerometer and the second accelerometer comprise at least one of a three-axis accelerometer or a six-axis accelerometer.

### Claim 18 (depends on 16)

The system of claim 16, wherein the first accelerometer is configured to calibrate the second accelerometer and wherein the second accelerometer is configured to calibrate the first accelerometer.

### Claim 19 (depends on 16)

The system of claim 16, wherein the first wearable device and the second wearable device are in direct communication.

### Claim 20 (depends on 16)

The system of claim 16, wherein at least one of the first wearable device or the second wearable device is a wristband.
