# US 2014/0198034 A1 · Muscle interface device and method for interacting with content displayed on wearable head mounted displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0198034 A1
- Document ID: US20140198034A1
- Status: Published application
- Kind: A1
- Application number: 14/155,087
- Filed: 2014-01-14
- Published: 2014-07-17
- Earliest claimed: 2013-01-14
- Assignees: Thalmic Labs Inc.
- Applicants: Thalmic Labs Inc.
- Inventors: Matthew Bailey; Aaron Grant; Stephen Lake
- Web page: https://patentgrep.com/patent/US20140198034A1

## CPC

- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

There is disclosed a muscle interface device and method for interacting with content displayed on wearable head mounted displays. In an embodiment, the muscle interface device comprises a sensor worn on the forearm of a user, and the sensor is adapted to recognize a plurality of gestures made by a user's hand and or wrist to interact with content displayed on the wearable head mounted display. The muscle interface device utilizes a plurality of sensors, including one or more of capacitive EMG, MMG, and accelerometer sensors, to detect gestures made by a user. The detected user gestures from the sensors are processed into a control signal for allowing the user to interact with content displayed on the wearable head mounted display in a discreet manner.

## Claims

### Claim 1

A muscle interface device for interacting with content displayed on a wearable head mounted display, comprising:
a plurality of sensors that in use are worn on a portion of an arm of a user to detect signals generated by at least one muscle of the arm of the user; and
a transmitter communicatively coupled to the plurality of sensors and which in use transmits communication signals indicative of muscle activity detected by the plurality of sensors to a receiver on the wearable head mounted display;
wherein the communication signals transmitted to the receiver on the wearable head mounted display cause one or more interactions with content displayed on the wearable head mounted display.

### Claim 2 (depends on 1)

The muscle interface device of claim 1, further comprising:
a processor communicatively coupled to the plurality of sensors and the transmitter, and which interprets the signals detected by the plurality of sensors as a gesture and translates the signals detected by the plurality of sensors to a control signal to interact with content displayed on the wearable head mounted display, wherein the control signal is transmitted by the transmitter at least as part of the communications signals.

### Claim 3 (depends on 1)

The muscle interface device of claim 1 wherein the detected signals are transmitted to the receiver on the wearable head mounted display to be interpreted as a gesture by the wearable head mounted display.

### Claim 4 (depends on 1)

The muscle interface device of claim 1, further comprising a haptic feedback module for confirming the interpretation of a gesture.

### Claim 5 (depends on 1)

The muscle interface device of claim 1 wherein the plurality of sensors includes at least one sensor selected from the group consisting of: an electromyographic (EMG) sensor and a mechanomyographic (MMG) sensor.

### Claim 6 (depends on 1)

The muscle interface device of claim 1 wherein the transmitter includes a wireless transmitter to wirelessly transmit wireless communications signals to the receiver on the wearable head mounted display.

### Claim 7 (depends on 1)

The muscle interface device of claim 1, further comprising:
an accelerometer to detect an acceleration of the arm of the user and to provide a signal representing the acceleration.

### Claim 8

A method for interacting with content displayed on a wearable head mounted display, the method comprising:
displaying content on the wearable head mounted display;
detecting a user gesture by a muscle interface device, wherein the muscle interface device includes a plurality of sensors responsive to signals generated by muscles of a user and a transmitter, and wherein detecting the user gesture includes detecting signals generated by muscles of the user by the plurality of sensors of the muscle interface device;
identifying the user gesture by at least one circuit of the muscle interface device;
transmitting the identified gesture to the wearable head mounted display by the transmitter of the muscle interface device;
receiving the identified gesture by the wearable head mounted display; and
translating the identified gesture to a control signal by the wearable head mounted display to interact with content displayed thereon.

### Claim 9 (depends on 8)

The method of claim 8 wherein the transmitter of the muscle interface device is a wireless transmitter, and wherein:
transmitting the identified gesture to the wearable head mounted display by the transmitter of the muscle interface device includes wirelessly transmitting the identified gesture to the wearable head mounted display by the wireless transmitter of the muscle interface device;
and receiving the identified gesture by the wearable head mounted display includes wirelessly receiving the identified gesture by the wearable head mounted display.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
pairing the muscle interface device with the wearable head mounted display.

### Claim 11 (depends on 8)

The method of claim 8 wherein the plurality of sensors includes one or more electromyography (EMG) sensors, and wherein detecting a user gesture by a muscle interface device includes detecting an electrical signal produced by a muscle of the user by the one or more EMG sensors of the muscle interface device.

### Claim 12 (depends on 8)

The method of claim 8 wherein the plurality of sensors includes one or more mechanomyography (MMG) sensors, and wherein detecting a user gesture by a muscle interface device includes detecting a vibration produced by a muscle of the user by the one or more MMG sensors of the muscle interface device.

### Claim 13 (depends on 8)

The method of claim 8 wherein the muscle interface device further comprises an accelerometer, and wherein detecting a user gesture by the muscle interface device includes detecting acceleration by the accelerometer.