# US 10,671,174 B2 · User interface control of responsive devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,671,174 B2 - Document ID: US10671174B2 - Status: Granted - Kind: B2 - Application number: 16/055,859 - Filed: 2018-08-06 - Published: 2020-02-06 - Granted: 2020-06-02 - Earliest claimed: 2018-08-05 - Assignees: Pison Technology, Inc. - Applicants: Pison Technology, Inc. - Inventors: Dexter W. Ang; David O Cipoletta; Samuel J. Karnes; Michael P. Kowalczyk; Salil H. Patel; Steven D. Trambert; Sidhant Srikumar; Brodey Lajoie - Web page: https://patentgrep.com/patent/US10671174B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G01C 25/005: {initial alignment, calibration or starting-up of inertial devices} - G02B 27/0172: {characterised by optical features} - G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/0485: Scrolling or panning - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 21/316: {by observing the pattern of computer usage, e.g. typical user behaviour} - G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints - H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming - H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Among other things, a user interface device has a sensor configured to detect, at a wrist of a human, nerve or other tissue electrical signals associated with an intended contraction of a muscle to cause a rapid motion of a finger. An output provides information representative of the nerve or other tissue electrical signals associated with the intended contraction of the muscle to an interpreter of the information. ## Claims ### Claim 1 An apparatus comprising two or more user interface devices configured to generate outputs, at least two of the two or more user interface devices having at least two electroneurography sensors configured to detect, at a dorsal side of a wrist of the human, nerve signals associated with intended contractions of two or more muscles and to generate corresponding sensor outputs, a processor configured to derive information corresponding to and representing nerve signals from the sensor outputs of the electroneurography sensors, at least one of the user interface devices comprising an inertial measurement unit (IMU), at least one of the user interface devices comprising a wrist-worn user interface device, two or more responsive devices, and an interpreter configured (i) to generate interpreted outputs based on (a) the information derived by the processor corresponding to and representing nerve signals from the sensor outputs of the electroneurography sensors, (b) a joint consideration of the information derived by the processor corresponding to and representing nerve signals from the sensor outputs of the two electroneurography sensors of each of the user interface devices, and (c) a separate consideration of the information derived by the processor corresponding to and representing nerve signals from the sensor outputs of each of the two electroneurography sensors of each of the user interface devices, and (ii) to provide the interpreted outputs to a controller configured to effect actions by the two or more responsive devices. ### Claim 2 (depends on 1) The apparatus of claim 1 in which the inertial measurement unit is calibrated using a calibration technique. ### Claim 3 (depends on 1) The apparatus of claim 1 in which the inertial measurement unit is configured to access a value corresponding to a reference point. ### Claim 4 (depends on 3) The apparatus of claim 3 in which the reference point is independent of the position of the inertial measurement unit. ### Claim 5 (depends on 3) The apparatus of claim 3 in which a vector provided by the inertial measurement unit is compared to a second vector that is calculated using the value corresponding to the reference point. ### Claim 6 (depends on 2) The apparatus of claim 2 in which the calibration technique is performed after a pre-defined number of spatial calculations of the inertial measurement unit. ### Claim 7 (depends on 2) The apparatus of claim 2 in which the calibration technique is performed in response to a command from the human. ### Claim 8 (depends on 1) The apparatus of claim 1 in which at least two of the user interfaces devices are configured to be worn by different humans and comprise wrist-worn devices. ### Claim 9 (depends on 1) The apparatus of claim 1 in which the interpreter is configured to provide the interpreted outputs to a controller configured to effect the actions by altering presentations by the responsive devices. ### Claim 10 (depends on 1) The apparatus of claim 1 in which the interpreter is configured to provide the interpreted outputs to a controller configured to cause at least one of the responsive devices to perform a zoom. ### Claim 11 (depends on 10) The apparatus of claim 10 in which the zoom alters a presentation comprising a display. ### Claim 12 (depends on 1) The apparatus of claim 1 in which the interpreter is configured to provide the output to a controller configured to cause the responsive device to capture an image, video, or a sound, or a combination of them. ### Claim 13 (depends on 1) The apparatus of claim 1 in which at least one of the responsive devices is configured to operate compatibly with a peripheral device that can generate an output for controlling the action of the responsive device. ### Claim 14 (depends on 1) The apparatus of claim 1 in which the action of the responsive device is controlled without the human touching the responsive device. ### Claim 15 (depends on 1) The apparatus of claim 1 in which the interpreter is configured to provide the interpreted outputs to the responsive devices based on a Bluetooth round robin. ### Claim 16 (depends on 1) The apparatus of claim 1 comprising an intermediary routing device that manages connections with the responsive devices device. ### Claim 17 (depends on 16) The apparatus of claim 16 in which the interpreter is configured to send the interpreted outputs to the responsive devices through the intermediary routing device. ### Claim 18 (depends on 1) The apparatus of claim 1 in which the responsive device is configured to provide a presentation to a user of at least one of the user interface device. ### Claim 19 (depends on 1) The apparatus of claim 1 in which the sensor of at least one of the user interface devices is configured to detect additional nerve or other tissue electrical signals of a human and generate data representative of the additional nerve or other tissue electrical signals, and the interpreter is configured to make interpretations of the data representative of the additional nerve or other tissue electrical signals. ### Claim 20 (depends on 19) The apparatus of claim 19 in which the interpreter is configured to generate the output based on a joint consideration of the interpretations of the data representative of the nerve or other tissue electrical signals and the interpretations of the data representative of the additional nerve or other tissue electrical signals. ### Claim 21 (depends on 19) The apparatus of claim 19 in which the interpreter is configured to generate the output based on a separate consideration of the interpretations of the data representative of the nerve or other tissue electrical signals and the interpretations of the data representative of the additional nerve or other tissue electrical signals.