# US 10,627,914 B2 · User interface control of responsive devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,627,914 B2
- Document ID: US10627914B2
- Status: Granted
- Kind: B2
- Application number: 16/055,777
- Filed: 2018-08-06
- Published: 2020-02-06
- Granted: 2020-04-21
- Earliest claimed: 2018-08-05
- Assignees: Pison Technology, Inc.
- Applicants: Pison Technology, Inc.
- Inventors: Dexter W. Ang; David O Cipoletta; Samuel J. Karnes; Michael P. Kowalczyk; Salil H. Patel; Steven D. Trambert
- Web page: https://patentgrep.com/patent/US10627914B2

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G01C 25/005: {initial alignment, calibration or starting-up of inertial devices}
- G02B 27/0172: {characterised by optical features}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0485: Scrolling or panning
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 21/316: {by observing the pattern of computer usage, e.g. typical user behaviour}
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Among other things, a user interface device has a sensor configured to detect, at a wrist of a human, nerve or other tissue electrical signals associated with an intended contraction of a muscle to cause a rapid motion of a finger. An output provides information representative of the nerve or other tissue electrical signals associated with the intended contraction of the muscle to an interpreter of the information.

## Claims

### Claim 1

An apparatus comprising
a wrist worn user interface device having
a sensor configured to detect, at a top surface of a wrist of a human, nerve or other tissue electrical signals associated with intended contractions and extensions of a muscle to cause a particular single gesture, the particular single gesture comprising all of: (a) repeated flicks up of only an index finger of the hand attached to the wrist, (b) each of the repeated flicks up of the particular single gesture having an extent less than 5 cm and a duration less than one-half second, and (c) each of the repeated flicks up of the particular single gesture comprising an intended contraction and extension of only the index finger,
an output configured to provide to an interpreter raw data representative of the nerve or other tissue electrical signals associated with the intended contractions and extensions of the muscle, and
an interpreter configured to receive and interpret the raw data representative of the nerve or other tissue electrical signals and provide an indication of the particular single gesture comprising all of (a) through (c), the indication being provided to a responsive device not located on the hand attached to the wrist to cause the responsive device to treat the indication of the particular single gesture as an invocation of a user interface control of a display.

### Claim 2 (depends on 1)

The apparatus of claim 1 comprising a responsive device coupled to the interpreter and configured to respond to the intended contractions and extensions of the muscle by an action.

### Claim 3 (depends on 2)

The apparatus of claim 2 in which the responsive device is configured to respond by an action that includes changing an audio or visual presentation to the human.

### Claim 4 (depends on 3)

The apparatus of claim 3 in which the responsive device is configured to respond by an action that includes changing the audio or visual presentation as if the intended contraction of the muscle corresponded to an invocation of a user interface control.

### Claim 5

An apparatus comprising
a wrist-worn user interface device having
a sensor configured to detect, at a top surface of a wrist of a human hand, nerve or other tissue electrical signals associated (a) with an activation of a muscle intended to cause a first motion of the hand, the first motion of the hand comprising a rotation of a palm relative to an elbow, and (b) with an activation of a muscle intended to cause, at a time during or at the end of the first motion, a stationary hold of the hand,
an output configured to provide to an interpreter information representative of the nerve or other tissue electrical signals associated with the activations intended to cause the first motion and the stationary hold, and
an interpreter configured to receive and interpret the information representative of the nerve or other tissue electrical signals and to provide, based on the information representative of the nerve or other tissue electrical signals, (a) a first indication of the activation intended to cause the first motion comprising the rotation of the palm relative to the elbow, and (b) a second indication of the activation of the motion intended to cause the stationary hold, the first indication configured to cause an action to be performed on a display of a responsive device not mounted on the hand, the action comprising rotating, in three-dimensional space, a displayed graphical element comprising a three-dimensional representation of an object, the second indication being configured to cause the responsive device to continue the rotating to be performed on the display of the responsive device during at least a part of the stationary hold.

### Claim 6 (depends on 5)

The apparatus of claim 5 in which the action includes changing an audio or visual presentation to the human.

### Claim 7 (depends on 5)

The apparatus of claim 5 in which the motion of the hand comprises a motion of a finger of the hand.

### Claim 8 (depends on 6)

The apparatus of claim 6 in which the action includes continuing the change of the audio or visual presentation.

### Claim 9 (depends on 5)

The apparatus of claim 5 in which
the first motion comprises an index finger lift, and
the second motion comprises the finger being held stationary during or at the end of the index finger lift.

### Claim 10 (depends on 5)

The apparatus of claim 5 in which the object comprises a presented assembly.

### Claim 11 (depends on 10)

The apparatus of claim 10 in which the sensor is configured to detect, at the top surface of the wrist of the human hand, nerve or other tissue electrical signals associated (c) with an activation of a muscle intended to cause a finger flick, and in which the interpreter is configured to receive and interpret the information representative of the nerve or other tissue electrical signals into provide, based on the information representative of the nerve or other tissue electrical signals, (c) a third indication of the activation of the motion intended to cause the finger flick.

### Claim 12 (depends on 11)

The apparatus of claim 11 in which the third indication is configured to cause the responsive device to present an exploded view of the presented assembly.