# US 2025/0155987 A1 · Brain machine interface for performing sustained actions using discrete commands

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0155987 A1
- Document ID: US20250155987A1
- Status: Published application
- Kind: A1
- Application number: 18/946,156
- Filed: 2024-11-13
- Published: 2025-05-15
- Earliest claimed: 2023-11-13
- Assignees: Brown University; The General Hospital Corporation; The United States Government as represented by the Department of Veterans Affairs
- Applicants: Brown University; The General Hospital Corporation; The United States Government as Represented by the Department of Veterans Affairs
- Inventors: Leigh Hochberg; Thomas Hosman; Jacob Gusman; John D. Simeral; Carlos Vargas-Irwin
- Web page: https://patentgrep.com/patent/US20250155987A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Sustained commands, such as drag and drop, scrolling, holding a position, and the like, can be performed by a user mentally controlling a controllable device via a brain-machine interface (BMI). Neural signals can be recorded by at least one neural recording device associated with a user and sent to the BMI, which can extract neural features from the neural signals. The BMI, which can include at least a Latch decoder, which can include a Gesture Type decoder and an Attempt decoder, can determine whether an action should be performed and a period of time the action should be held. If the action should be performed, then the controllable device can be controlled to perform the action for the period of time. If the action should not be performed, then the controllable device can be controlled to remain in a waiting state and/or a previous state.

## Claims

### Claim 1

A system comprising:
at least one neural recording device configured to record at least one neural signal of a user;
a controllable device; and
a controller in communication with the at least one neural recording device and the controllable device, the controller comprising:
a non-transitory memory storing instructions; and
a processor configured to execute the instructions to:
receive the at least one neural signal of the user from the at least one neural recording device;
extract at least one neural feature from the at least one neural signal of the user;
execute a Latch decoder configured to determine whether an action should be performed and a period of time the action should be held, wherein the Latch decoder comprises a Gesture Type decoder and an Attempt decoder, and
if the action should be performed, then control the controllable device to perform the action for the period of time, and
if the action should not be performed, then control the controllable device to remain in a waiting state.

### Claim 2 (depends on 1)

The system of claim 1, wherein the Gesture Type Decoder:
determines whether the user is thinking of attempting to perform a known gesture of a plurality of known gestures;
if the user is thinking of attempting to perform the known gesture, determines which type of known gesture of the plurality of known gestures; and
outputs an action command to control the controllable device based on the type of known gesture or a no action command if no known gesture determined.

### Claim 3 (depends on 2)

The system of claim 2, wherein the Attempt decoder:
determines whether the user is thinking of attempting to perform any known gesture of the plurality of known gestures; and
outputs a Yes attempt state if an attempt is determined or a No attempt state if no attempt is determined.

### Claim 4 (depends on 3)

The system of claim 3, wherein the Gesture Decoder and/or the Attempt Decoder are discrete classifiers.

### Claim 5 (depends on 3)

The system of claim 3, wherein the Latch Decoder outputs:
the action command for a finite time if the type of known gesture is determined for less than a first time;
a latch on the action command if the type of known gesture is determined for the first time and a Yes attempt state is determined for a second time, wherein the latch causes the controllable device to hold the action; or
a no action command if no known gesture type is determined.

### Claim 6 (depends on 5)

The system of claim 5, wherein the Latch Decoder outputs
a stay latched at the action command if the Yes attempt state is determined at a third time after the second time, wherein the controllable device holds the action at the third time, or
an unlatch command if the No attempt state is determined at the third time after the second time, wherein the unlatch command controls the controllable device to stop the action.

### Claim 7 (depends on 1)

The system of claim 1, further comprising instruction to execute a Lock decoder to lock the controllable device to perform the action for an extended period of time, longer than the period of time, until an unlock gesture is decoded by the Latch Decoder.

### Claim 8 (depends on 7)

The system of claim 7, wherein the Lock decoder locks the controllable device to perform the action for the extended period of time if the period of time the action is performed reaches a predetermined lock time.

### Claim 9 (depends on 8)

The system of claim 8, further comprising locks the controllable device to perform the action for the extended period of time, based on physical feedback from the controllable device that the action is being performed.

### Claim 10 (depends on 1)

The system of claim 1, wherein the controllable device is at least one of: a processor connected with a visual display, a robot configured to perform at least one task, an exoskeleton configured to be worn on at least one body part of the user to move the at least one body part, a robotic limb representing at least a portion of a limb of the user, or at least one electrode configured to provide at least one functional electrical stimulation (FES) to the user to cause a muscle contraction.

### Claim 11

A method comprising:
receiving, by a system comprising a processor, at least one neural signal of a user from at least one neural recording device in communication with the processor;
extracting, by the system, at least one neural feature from the at least one neural signal of the user;
executing, by the system, a Latch decoder to determine whether a controllable device should perform an action and a period of time the action should be held for, wherein the Latch decoder comprises a Gesture Type decoder and an Attempt decoder,
if the action should be performed, then controlling, by the system, the controllable device to perform the action for the period of time; and
if the action should not be performed, then controlling, by the system, the controllable device to remain in a waiting state and/or a previous state.

### Claim 12 (depends on 11)

The method of claim 11, further comprising executing the Gesture Type decoder within the Latch decoder, wherein the executing comprises:
determining, by the system, whether the user is thinking of attempting to perform a known gesture of a plurality of known gestures;
if the user is thinking of attempting to perform the known gesture of the plurality of known gestures:
determining, by the Gesture Type decoder, which type of known gesture of the plurality of known gestures the user is thinking of attempting to perform; and
outputting, by the system, an action command to the controllable device to control the controllable device based on the type of known gesture; or
if the user is not thinking of attempting to perform the known gesture of the plurality of known gestures:
outputting, by the system, no action command.

### Claim 13 (depends on 12)

The method of claim 12, further comprising executing the Attempt decoder within the Latch decoder, wherein the executing comprises:
determining, by the system, whether the user is thinking of attempting to perform any known gesture of the plurality of known gestures; and
outputting, by the Attempt decoder, a Yes attempt state if an attempt is determined or a No attempt state if no attempt is determined.

### Claim 14 (depends on 13)

The method of claim 13, wherein the Gesture Decoder and/or the Attempt Decoder are discrete classifiers.

### Claim 15 (depends on 13)

The method of claim 13, wherein the executing the Latch decoder further comprises outputting, by the system:
the action command to the controllable device for a finite time if the type of known gesture is determined for less than a first time;
a latch on the action command to the controllable device if the type of known gesture is determined for the first time and a Yes attempt state is determined for a second time, wherein the latch causes the controllable device to hold the action; or
no action command to the controllable device if no known gesture type is determined.

### Claim 16 (depends on 15)

The method of claim 15, wherein the executing the Latch Decoder further comprises outputting, by the system:
a hold the action command if the Yes attempt state is determined at a third time after the second time, wherein the controllable device holds the action at the third time, or an unlatch command if the No attempt state is determined at the third time after the second time, wherein the unlatch command controls the controllable device to stop the action.

### Claim 17 (depends on 11)

The method of claim 11, further comprising executing, by the system, a Lock decoder to lock the controllable device to perform the action for an extended period of time, longer than the period of time, until an unlock gesture is decoded by the Latch Decoder.

### Claim 18 (depends on 17)

The method of claim 17, wherein the executing the Lock decoder further comprises locking, by the system, the controllable device to perform the action for the extended period of time if the period of time the action is performed reaches a predetermined lock time.

### Claim 19 (depends on 18)

The method of claim 18, wherein the locking is further based on physical feedback from the controllable device that the action is being performed.

### Claim 20 (depends on 11)

The method of claim 11, wherein the controllable device is at least one of: a processor connected with a visual display, a robot configured to perform at least one task, an exoskeleton configured to be worn on at least one body part of the user to move the at least one body part, a robotic limb representing at least a portion of a limb of the user, or at least one electrode configured to provide at least one functional electrical stimulation (FES) to the user to cause a muscle contraction.
