# US 2021/0081044 A1 · Measurement of Facial Muscle EMG Potentials for Predictive Analysis Using a Smart Wearable System and Method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0081044 A1
- Document ID: US20210081044A1
- Status: Published application
- Kind: A1
- Application number: 17/102,864
- Filed: 2020-11-24
- Published: 2021-03-18
- Earliest claimed: 2016-09-13
- Assignees: BRAGI GmbH
- Applicants: BRAGI GmbH
- Inventors: Julius Friedrich Rüdiger; Peter Vincent Boesen
- Web page: https://patentgrep.com/patent/US20210081044A1

## CPC

- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- H04R 1/1016: {Earpieces of the intra-aural type}
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- H04R 2460/13: Hearing devices using bone conduction transducers
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A system includes at least one wearable device having a housing, at least one sensor disposed within the housing, at least one output device disposed within the housing, and at least one processor operatively connected to the sensors and output devices, wherein one or more sensors are configured to detect electrical activity from a user's facial muscles and to transmit a data signal concerning the electrical activity of the user's facial muscles to one of more of the processors. A method of controlling a wearable device includes determining facial muscular electrical data of a facial gesture made by a user, interpreting the facial muscular electrical data to determine a user response, and performing an action based on the user response.

## Claims

### Claim 1

A system comprising:
a set of earpieces comprising a first earpiece and a second earpiece, wherein each earpiece comprises:
a) an earpiece housing;
b) a processor disposed within the earpiece housing,
c) a gesture control interface operatively connected to the processor,
d) at least one sensor, located at an external surface of the earpiece housing, configured to detect electrical activity from a user's facial muscles, the at least one sensor operatively connected to the processor and wherein the at least one sensor is an electromyogram (EMG) sensor,
e) wherein the processor is configured to interpret the electrical activity from the user's facial muscles as a first command to perform action according to a pre-determined user setting,
f) an inertial sensor operatively connected to the processor and wherein the processor is further configured to interpret the electrical activity from the user's facial muscles in combination with at least one of head orientation or movement as a second command,
g) at least one microphone operatively connected to the processor;
h) at least one speaker operatively connected to the processor.

### Claim 2 (depends on 1)

The system of claim 1 wherein each wearable device further comprises a transceiver operatively connected to the processor.

### Claim 3 (depends on 1)

The system of claim 1 wherein the first earpiece is configured not to interpret the electrical activity from the user's facial muscles as a command if the user is talking as determined using the at least one microphone.

### Claim 4 (depends on 1)

The system of claim 1 further comprising a software application executing on a mobile device configured to provide for modifying the pre-determined user setting.

### Claim 5

A method for using facial muscle electromyogram (EMG) potential as input for a set of earpieces comprising a first earpiece and a second earpiece, the first earpiece comprising:
a) an earpiece housing,
b) a processor disposed within the earpiece housing,
c) a gesture control interface operatively connected to the processor,
d) at least one EMG sensor, placed on an external surface of the earpiece housing, configured to detect electrical activity from a user's facial muscles, the at least one EMG sensor operatively connected to the processor, and
e) at least one inertial sensor configured to detect a user's head movement, the at least one inertial sensor operatively connected to the processor,
f) at least one microphone operatively connected to the processor and at least one speaker operatively connected to the processor, generating voice feedback at the at least one speaker;
receiving the facial muscle EMG potentials at the at least one EMG sensor in response to the voice feedback;
receiving audio input from the at least one microphone at the processor in response to the voice feedback;
receiving inertial data indicative of the user's head movement from the at least one inertial sensor at the processor in response to the voice feedback; and
interpreting at the processor the facial muscle EMG potentials, the audio input, and the inertial data to determine occurrence of a command to perform an action according to a pre-determined user setting.

### Claim 6 (depends on 5)

The method of claim 5 wherein the first earpiece further comprises a transceiver operatively connected to the processor.

### Claim 7 (depends on 5)

The method of claim 5 wherein the interpreting at the processors includes determining if the user is talking and if the user is talking determining the facial muscle EMG potentials are not indicative of the occurrence of the command.

### Claim 8

A method for using facial muscle electromyogram (EMG) potential as input for a an earpiece, the method comprising:
receiving facial muscle EMG potentials by at least one EMG sensor of the earpiece;
receiving audio input from at least one microphone of the earpiece at a processor of the earpiece;
receiving inertial data indicative of the user's head movement from the at least one inertial sensor of the earpiece at the processor of the earpiece; and
interpreting at the processor of the earpiece the facial muscle EMG potentials, the audio input, and the inertial data to determine occurrence of a command to perform an action according to a pre-determined user setting.

### Claim 9 (depends on 8)

The method of claim 8 wherein the first earpiece comprises a transceiver operatively connected to the processor.

### Claim 10 (depends on 8)

The method of claim 8 wherein the interpreting at the processor of the earpiece includes determining if the user is talking and if the user is talking determining the facial muscle EMG potentials are not indicative of the occurrence of the command.

### Claim 11 (depends on 8)

The method of claim 8 wherein the processor is disposed within an earpiece housing of the earpiece.

### Claim 12 (depends on 11)

The method of claim 11 wherein the at least one EMG sensor of the earpiece is placed on an external surface of the earpiece housing.
