# US 2019/0314600 A1 · Enhanced brain-machine interfaces with neuromodulation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0314600 A1
- Document ID: US20190314600A1
- Status: Published application
- Kind: A1
- Application number: 16/426,198
- Filed: 2019-05-30
- Published: 2019-10-17
- Earliest claimed: 2015-10-23
- Assignees: HRL Laboratories, LLC
- Applicants: HRL Laboratories, LLC
- Inventors: Aashish N. Patel; Praveen K. Pilly
- Web page: https://patentgrep.com/patent/US20190314600A1

## CPC

- A61M 21/00: Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61B 5/24: Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B 5/369: Electroencephalography [EEG]
- A61B 5/6803: {Head-worn items, e.g. helmets, masks, headphones or goggles}
- A61F 2/72: Bioelectric control, e.g. myoelectric
- A61N 1/36025: {for treating a mental or cerebral condition}
- A61B 5/0075: {by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence)}
- A61M 2021/0027: {by the hearing sense}
- A61M 2021/0044: {by the sight sense}
- A61M 2021/0055: {with electric or electro-magnetic fields}
- A61M 2205/3313: used specific wavelengths
- A61M 2205/502: User interfaces, e.g. screens or keyboards
- A61M 2205/52: with memories providing a history of measured variating parameters of apparatus or patient
- A61M 2230/10: Electroencephalographic signals
- A61N 1/0456: {Specially adapted for transcutaneous electrical nerve stimulation [TENS]}
- A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61F: FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS (dental prosthetics A61C)
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)

## Abstract

Described is an improved brain-machine interface including a neural interface and a controllable device in communication with the neural interface. The neural interface includes a neural device with one or more sensors for collecting signals of interest and one or more processors for conditioning the signals of interest, extracting salient neural features from and decoding the conditioned signals of interest, and generating a control command for the controllable device. The controllable device performs one or more operations according to the control command, and the neural device administers neuromodulation stimulation to reinforce operation of the controllable device.

## Claims

### Claim 1

An enhanced brain-machine interface with neuromodulation, the enhanced brain-machine interface comprising:
a neural interface and a controllable device in communication with the neural interface,
wherein the neural interface comprises:
a neural device having one or more sensors for collecting signals of interest, wherein the neural device is configured to administer neuromodulation stimulation; and
one or more processors and a non-transitory computer-readable medium having executable instructions encoded thereon such that when executed, the one or more processors perform an operation of:
conditioning the signals of interest, resulting in conditioned signals of interest;
extracting salient neural features from the conditioned signals of interest;
decoding the salient neural features, providing a mapping between an input neural feature space and an output control space for the controllable device;
based on the mapping, generating at least one control command for the controllable device;
causing the controllable device to perform one or more operations according to the at least one control command; and
causing the neural device to administer neuromodulation stimulation to reinforce operation of the controllable device.

### Claim 2 (depends on 1)

The system as set forth in claim 1, wherein the signals of interest comprise at least one of neural signals and environmental signals.

### Claim 3 (depends on 1)

The system as set forth in claim 1, wherein the neuromodulation stimulation is one of auditory, visual, and electrical stimulation.

### Claim 4 (depends on 3)

The system as set forth in claim 3, wherein the neuromodulation stimulation comprises unique spatiotemporal amplitude-modulated patterns (STAMPs) of stimulation.

### Claim 5 (depends on 1)

The system as set forth in claim 1, wherein the controllable device is a prosthetic limb.

### Claim 6 (depends on 1)

The system as set forth in claim 1, wherein the one or more neural sensors comprises one or more electrodes configured to perform at least one of sensing and applying stimulation.

### Claim 7

A method for implementing an enhanced brain-machine interface with neuromodulation, the method comprising an act of:
causing one or more processers to execute instructions encoded on a non-transitory computer-readable medium, such that upon execution, the one or more processors perform operations of:
conditioning signals of interest obtained from a neural device having one or more sensors, wherein the neural device is configured to administer neuromodulation stimulation;
extracting salient neural features from the conditioned signals of interest;
decoding the salient neural features, providing a mapping between an input neural feature space and an output control space for the controllable device;
based on the mapping, generating at least one control command for the controllable device;
causing the controllable device to perform one or more operations according to the at least one control command; and
causing the neural device to administer neuromodulation stimulation to reinforce operation of the controllable device.

### Claim 8 (depends on 7)

The method as set forth in claim 7, wherein the signals of interest comprise at least one of neural signals and environmental signals.

### Claim 9 (depends on 7)

The method as set forth in claim 7, wherein the neuromodulation stimulation is one of auditory, visual, and electrical stimulation.

### Claim 10 (depends on 9)

The method as set forth in claim 9, wherein the neuromodulation stimulation comprises unique spatiotemporal amplitude-modulated patterns (STAMPs) of stimulation.

### Claim 11 (depends on 7)

The method as set forth in claim 7, wherein the controllable device is a prosthetic limb.

### Claim 12 (depends on 7)

The method as set forth in claim 7, wherein the one or more neural sensors comprises one or more electrodes configured to perform at least one of sensing and applying stimulation.

### Claim 13

A computer program product for implementing an enhanced brain-machine interface with neuromodulation, the computer program product comprising:
computer-readable instructions stored on a non-transitory computer-readable medium that are executable by a computer having one or more processors for causing the processor to perform operations of:
conditioning signals of interest obtained from a neural device having one or more sensors, wherein the neural device is configured to administer neuromodulation stimulation;
extracting salient neural features from the conditioned signals of interest;
decoding the salient neural features, providing a mapping between an input neural feature space and an output control space for the controllable device;
based on the mapping, generating at least one control command for the controllable device;
causing the controllable device to perform one or more operations according to the at least one control command; and
causing the neural device to administer neuromodulation stimulation to reinforce operation of the controllable device.

### Claim 14 (depends on 13)

The computer program product as set forth in claim 13, wherein the signals of interest comprise at least one of neural signals and environmental signals.

### Claim 15 (depends on 13)

The computer program product as set forth in claim 13, wherein the neuromodulation stimulation is one of auditory, visual, and electrical stimulation.

### Claim 16 (depends on 15)

The computer program product as set forth in claim 15, wherein the neuromodulation stimulation comprises unique spatiotemporal amplitude-modulated patterns (STAMPs) of stimulation.

### Claim 17 (depends on 13)

The computer program product as set forth in claim 13, wherein the controllable device is a prosthetic limb.

### Claim 18 (depends on 13)

The computer program product as set forth in claim 13, wherein the one or more neural sensors comprises one or more electrodes configured to perform at least one of sensing and applying stimulation.
