Systems and Methods for Simulating Brain-Computer Interfaces
AssigneeThe Regents of the University of California
InventorsJonathan Kao, Ken-Fu Liang
Life of this patent
Estimating the term…
Abstract
Systems and methods for simulating brain-computer interfaces (BCIs) are described. In many embodiments, BCI decoders can be evaluated entirely in silico. Neural encoders are used to generate synthetic neural signals that mimic real neural signals for a given activity. Artificial intelligence agents emulate user control policies which can be used to guide the generation of the synthetic neural signals. Closed-loop testing can be achieved by providing a simulated testing environment.
Claims20
A method for evaluating brain-computer interface (BCI) decoders in silico, comprising:
- obtaining a BCI decoder,
- generating a set of neural signals using a neural encoder;
- providing the set of neural signals to the BCI decoder;
- receiving a command from the BCI decoder based on the set of neural signals;
- simulating the command in a simulated environment using an environmental simulator;
- providing an environmental state of the simulated environment from the environmental simulator to an artificial intelligence (AI) agent;
- generating an intended action using the AI agent based on the environmental state;
- providing the intended action to the neural encoder;
- continuously, until a predefined break point has been reached:
- producing an updated set of neural signals using the neural encoder;
- providing the updated set of neural signals to the BCI decoder;
- receiving an updated command from the BCI decoder based on the updated set of neural signals;
- simulating the updated command in a simulated environment using the environmental simulator;
- providing an updated environmental state of the simulated environment from the environmental simulator to the AI agent;
- generating an updated intended action using the AI agent based on the environmental state;
- and
- providing the updated intended action to the neural encoder for use in producing the updated set of neural signals;
- and
- providing a record of evaluation metrics based on performance of the BCI decoder.
A system for evaluating brain-computer interface (BCI) decoders in silico, comprising:
- a processor;
- and
- a memory, the memory containing a BCI simulation application that configures the processor to:
- obtain a BCI decoder,
- generate a set of neural signals using a neural encoder;
- provide the set of neural signals to the BCI decoder;
- receive a command from the BCI decoder based on the set of neural signals;
- simulate the command in a simulated environment using an environmental simulator;
- provide an environmental state of the simulated environment from the environmental simulator to an artificial intelligence (AI) agent;
- generate an intended action using the AI agent based on the environmental state;
- provide the intended action to the neural encoder;
- continuously, until a predefined break point has been reached:
- produce an updated set of neural signals using the neural encoder;
- provide the updated set of neural signals to the BCI decoder;
- receive an updated command from the BCI decoder based on the updated set of neural signals;
- simulate the updated command in a simulated environment using the environmental simulator;
- provide an updated environmental state of the simulated environment from the environmental simulator to the AI agent;
- generate an updated intended action using the AI agent based on the environmental state;
- and
- provide the updated intended action to the neural encoder for use in producing the updated set of neural signals;
- and
- provide a record of evaluation metrics based on performance of the BCI decoder.
A brain-computer interface (BCI), comprising:
- a plurality of electrodes configured to record neural signals from a brain;
- and
- a BCI decoder configured to translate recorded neural signals into commands, where the BCI decoder is evaluated by:
- generating a set of synthetic neural signals using a neural encoder;
- providing the set of synthetic neural signals to the BCI decoder;
- receiving a command from the BCI decoder based on the set of synthetic neural signals;
- simulating the command in a simulated environment using an environmental simulator;
- providing an environmental state of the simulated environment from the environmental simulator to an artificial intelligence (AI) agent;
- generating an intended action using the AI agent based on the environmental state;
- providing the intended action to the neural encoder;
- continuously, until a predefined break point has been reached:
- producing an updated set of synthetic neural signals using the neural encoder;
- providing the updated set of synthetic neural signals to the BCI decoder;
- receiving an updated command from the BCI decoder based on the updated set of synthetic neural signals;
- simulating the updated command in a simulated environment using the environmental simulator;
- providing an updated environmental state of the simulated environment from the environmental simulator to the AI agent;
- generating an updated intended action using the AI agent based on the environmental state;
- and
- providing the updated intended action to the neural encoder for use in producing the updated set of synthetic neural signals.
Dependencies are inferred from the claim text.