# US 2025/0209296 A1 · Systems and Methods for Simulating Brain-Computer Interfaces

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0209296 A1
- Document ID: US20250209296A1
- Status: Published application
- Kind: A1
- Application number: 18/848,107
- Filed: 2023-03-17
- Published: 2025-06-26
- Earliest claimed: 2022-03-17
- Assignees: The Regents of the University of California
- Applicants: The Regents of the University of California
- Inventors: Jonathan Kao; Ken-Fu Liang
- Web page: https://patentgrep.com/patent/US20250209296A1

## CPC

- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06N 3/063: using electronic means
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems and methods for simulating brain-computer interfaces (BCIs) are described. In many embodiments, BCI decoders can be evaluated entirely in silico. Neural encoders are used to generate synthetic neural signals that mimic real neural signals for a given activity. Artificial intelligence agents emulate user control policies which can be used to guide the generation of the synthetic neural signals. Closed-loop testing can be achieved by providing a simulated testing environment.

## Claims

### Claim 1

A method for evaluating brain-computer interface (BCI) decoders in silico, comprising:
obtaining a BCI decoder,
generating a set of neural signals using a neural encoder;
providing the set of neural signals to the BCI decoder;
receiving a command from the BCI decoder based on the set of neural signals;
simulating the command in a simulated environment using an environmental simulator;
providing an environmental state of the simulated environment from the environmental simulator to an artificial intelligence (AI) agent;
generating an intended action using the AI agent based on the environmental state;
providing the intended action to the neural encoder;
continuously, until a predefined break point has been reached:
producing an updated set of neural signals using the neural encoder;
providing the updated set of neural signals to the BCI decoder;
receiving an updated command from the BCI decoder based on the updated set of neural signals;
simulating the updated command in a simulated environment using the environmental simulator;
providing an updated environmental state of the simulated environment from the environmental simulator to the AI agent;
generating an updated intended action using the AI agent based on the environmental state; and
providing the updated intended action to the neural encoder for use in producing the updated set of neural signals; and
providing a record of evaluation metrics based on performance of the BCI decoder.

### Claim 2 (depends on 1)

The method for evaluating BCI decoders in silico of claim 1, wherein the predefined breakpoint is completion of a task in the simulated environment.

### Claim 3 (depends on 1)

The method for evaluating BCI decoders in silico of claim 1, wherein the predefined breakpoint is a predefined number of iterations.

### Claim 4 (depends on 1)

The method for evaluating BCI decoders in silico of claim 1, wherein the AI agent is a reinforcement learning model.

### Claim 5 (depends on 4)

The method for evaluating BCI decoders in silico of claim 4, wherein the reinforcement learning model comprises proximal policy optimization incorporating a smoothness constraint that penalizes Kullback-Leibler divergence on consecutive actions.

### Claim 6 (depends on 4)

The method for evaluating BCI decoders in silico of claim 4, wherein the reinforcement learning model comprises proximal policy optimization incorporating a zeroness constraint that penalizes Kullback-Leibler divergence of each action close to a Gaussian distribution with zero mean and unit variance.

### Claim 7 (depends on 1)

The method for evaluating BCI decoders in silico of claim 1, wherein the record of evaluation metrics comprises at least one of: a number of iterations; an iteration at which a task was completed in the simulated environment; BCI decoder performance, BCI decoder accuracy, BCI decoder precision, and number of iterations to train the AI agent to perform at a predetermined level.

### Claim 8

A system for evaluating brain-computer interface (BCI) decoders in silico, comprising:
a processor; and
a memory, the memory containing a BCI simulation application that configures the processor to:
obtain a BCI decoder,
generate a set of neural signals using a neural encoder;
provide the set of neural signals to the BCI decoder;
receive a command from the BCI decoder based on the set of neural signals;
simulate the command in a simulated environment using an environmental simulator;
provide an environmental state of the simulated environment from the environmental simulator to an artificial intelligence (AI) agent;
generate an intended action using the AI agent based on the environmental state;
provide the intended action to the neural encoder;
continuously, until a predefined break point has been reached:
produce an updated set of neural signals using the neural encoder;
provide the updated set of neural signals to the BCI decoder;
receive an updated command from the BCI decoder based on the updated set of neural signals;
simulate the updated command in a simulated environment using the environmental simulator;
provide an updated environmental state of the simulated environment from the environmental simulator to the AI agent;
generate an updated intended action using the AI agent based on the environmental state; and
provide the updated intended action to the neural encoder for use in producing the updated set of neural signals; and
provide a record of evaluation metrics based on performance of the BCI decoder.

### Claim 9 (depends on 8)

The system for evaluating BCI decoders in silico of claim 8, wherein the predefined breakpoint is completion of a task in the simulated environment.

### Claim 10 (depends on 8)

The system for evaluating BCI decoders in silico of claim 8, wherein the predefined breakpoint is a predefined number of iterations.

### Claim 11 (depends on 8)

The system for evaluating BCI decoders in silico of claim 8, wherein the AI agent is a reinforcement learning model.

### Claim 12 (depends on 11)

The system for evaluating BCI decoders in silico of claim 11, wherein the reinforcement learning model comprises proximal policy optimization incorporating a smoothness constraint that penalizes Kullback-Leibler divergence on consecutive actions.

### Claim 13 (depends on 11)

The system for evaluating BCI decoders in silico of claim 11, wherein the reinforcement learning model comprises proximal policy optimization incorporating a zeroness constraint that penalizes Kullback-Leibler divergence of each action close to a Gaussian distribution with zero mean and unit variance.

### Claim 14 (depends on 8)

The system for evaluating BCI decoders in silico of claim 8, wherein the record of evaluation metrics comprises at least one of: a number of iterations; an iteration at which a task was completed in the simulated environment; BCI decoder performance, BCI decoder accuracy, BCI decoder precision, and number of iterations to train the AI agent to perform at a predetermined level.

### Claim 15

A brain-computer interface (BCI), comprising:
a plurality of electrodes configured to record neural signals from a brain; and
a BCI decoder configured to translate recorded neural signals into commands, where the BCI decoder is evaluated by:
generating a set of synthetic neural signals using a neural encoder;
providing the set of synthetic neural signals to the BCI decoder;
receiving a command from the BCI decoder based on the set of synthetic neural signals;
simulating the command in a simulated environment using an environmental simulator;
providing an environmental state of the simulated environment from the environmental simulator to an artificial intelligence (AI) agent;
generating an intended action using the AI agent based on the environmental state;
providing the intended action to the neural encoder;
continuously, until a predefined break point has been reached:
producing an updated set of synthetic neural signals using the neural encoder;
providing the updated set of synthetic neural signals to the BCI decoder;
receiving an updated command from the BCI decoder based on the updated set of synthetic neural signals;
simulating the updated command in a simulated environment using the environmental simulator;
providing an updated environmental state of the simulated environment from the environmental simulator to the AI agent;
generating an updated intended action using the AI agent based on the environmental state; and
providing the updated intended action to the neural encoder for use in producing the updated set of synthetic neural signals.

### Claim 16 (depends on 15)

The system for evaluating BCI decoders in silico of claim 15, wherein the predefined breakpoint is completion of a task in the simulated environment.

### Claim 17 (depends on 15)

The system for evaluating BCI decoders in silico of claim 15, wherein the predefined breakpoint is a predefined number of iterations.

### Claim 18 (depends on 15)

The system for evaluating BCI decoders in silico of claim 15, wherein the AI agent is a reinforcement learning model with proximal policy optimization incorporating a smoothness constraint that penalizes Kullback-Leibler divergence on consecutive actions.

### Claim 19 (depends on 15)

The system for evaluating BCI decoders in silico of claim 15, wherein the AI agent is a reinforcement learning model with proximal policy optimization incorporating a zeroness constraint that penalizes Kullback-Leibler divergence of each action close to a Gaussian distribution with zero mean and unit variance.

### Claim 20 (depends on 15)

The system for evaluating BCI decoders in silico of claim 15, wherein the record of evaluation metrics comprises at least one of: a number of iterations; an iteration at which a task was completed in the simulated environment; BCI decoder performance, BCI decoder accuracy, BCI decoder precision, and number of iterations to train the AI agent to perform at a predetermined level.
