# US 2021/0081808 A1 · System and method to integrate a dynamic model for agents in a simulation environment using a deep koopman model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0081808 A1
- Document ID: US20210081808A1
- Status: Published application
- Kind: A1
- Application number: 16/655,219
- Filed: 2019-10-16
- Published: 2021-03-18
- Earliest claimed: 2019-09-18
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Elena Ramona STEFANESCU
- Web page: https://patentgrep.com/patent/US20210081808A1

## CPC

- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- B60W 50/0205: {Diagnosing or detecting failures; Failure detection models}
- B60W 50/045: {Monitoring control system parameters}
- F02D 41/1405: {Neural network control}
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06N 7/00: Computing arrangements based on specific mathematical models
- B60W 60/001: {Planning or execution of driving tasks}
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- F02D 2041/1437: {Simulation}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- F02D: CONTROLLING COMBUSTION ENGINES (vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed B60K31/00; conjoint control of vehicle sub-units of different type or different function, road vehicle drive control systems for purposes other than the control of a single sub-unit B60W)

## Abstract

A system for use in a simulation is disclosed. The system may comprise a receiver to receive states of the simulation. A memory may store sets of hyperparameters for a neural network encoder. The memory may also store A-matrices. The neural network encoder, implemented using a processor, may use hyperparameters to implement an encoding function. The hyperparameters and an A-matrix may be selected from the memory responsive to the states of the simulation. The A-matrix may be used to determine a next predicted state for the simulation.

## Claims

### Claim 1

A system, comprising:
a receiver to receive a plurality of actual states for a simulation, the plurality of actual states for the simulation including a current actual state for the simulation;
a neural network encoder implemented using at least in part a processor; and
a memory storing a plurality of sets of hyperparameters for the neural network encoder and a plurality of A-matrices,
wherein the system is operative to select a set of hyperparameters from the plurality of sets of hyperparameters and an A-matrix from the plurality of A-matrices responsive to the plurality of actual states for the simulation,
wherein the neural network encoder is operative to use the set of hyperparameters to implement an encoding function, and
wherein the selected A-matrix is used to determine a next predicted state for the simulation responsive to the current actual state for the simulation.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the A-matrix is determined by solving a least-squares problem responsive to each state in the plurality of actual states for the simulation and each subsequent state in the plurality of actual states for the simulation.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the set of hyperparameters are selected to minimize the difference between the plurality of actual states for the simulation and a encoding and decoding of the plurality of actual states for the simulation using the encoding function.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the set of hyperparameters are selected to minimize the difference between a plurality of next predicted states using the A-matrix and the plurality of actual states for the simulation.

### Claim 5 (depends on 4)

The system according to claim 4, wherein the set of hyperparameters are selected to further minimize the difference between the next predicted state for the simulation and a next actual state for the simulation.

### Claim 6 (depends on 1)

The system according to claim 1, further comprising a neural network decoder implemented using at least in part the processor, the neural network decoder is operative to use the set of hyperparameters to implement a decoding function.

### Claim 7 (depends on 6)

The system according to claim 6, wherein the decoding function performed using the neural network decoder is used to determine the set of hyperparameters for the neural network during training.

### Claim 8 (depends on 1)

The system according to claim 1, wherein the simulation includes one of an autonomous vehicle simulation and a dynamic agent in a vehicle simulation.

### Claim 9 (depends on 8)

The system according to claim 8, further comprising a maneuver module to determine a maneuver for the autonomous vehicle simulation or the dynamic agent in the vehicle simulation responsive to the next predicted state for the simulation.

### Claim 10

A method, comprising:
receiving a plurality of actual states for a simulation, the plurality of actual states for the simulation including a current actual state for the simulation;
selecting a set of hyperparameters for a neural network encoder responsive to the plurality of actual states for the simulation;
determining an encoding function performed using the neural network encoder responsive to the set of hyperparameters for the neural network encoder;
determining an A-matrix, the A-matrix responsive to the encoding function performed using the neural network encoder; and
using the neural network encoder and the A-matrix to determine a next predicted state for the simulation responsive to the current actual state for the simulation.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the A-matrix is determined by solving a least-squares problem responsive to each state in the plurality of actual states for the simulation and each subsequent state in the plurality of actual states for the simulation.

### Claim 12 (depends on 10)

The method according to claim 10, wherein the set of hyperparameters are selected to minimize the difference between the plurality of actual states for the simulation and a decoding and encoding of the plurality of actual states for the simulation using the encoding function.

### Claim 13 (depends on 10)

The method according to claim 10, wherein the set of hyperparameters are selected to minimize the difference between a plurality of next predicted states using the A-matrix and the plurality of actual states for the simulation.

### Claim 14 (depends on 13)

The method according to claim 13, wherein the set of hyperparameters are selected to further minimize the difference between the next predicted state for the simulation and a next actual state for the simulation.

### Claim 15 (depends on 10)

The method according to claim 10, further comprising determining a decoding function performed using a neural network decoder responsive to the set of hyperparameters for the neural network.

### Claim 16 (depends on 15)

The method according to claim 15, further comprising using the decoding function performed using the neural network decoder to determine the set of hyperparameters for the neural network during training.

### Claim 17 (depends on 10)

The method according to claim 10, wherein the simulation includes one of an autonomous vehicle simulation and a dynamic agent in a vehicle simulation.

### Claim 18 (depends on 17)

The method according to claim 17, further comprising using the next predicted state for the simulation to determine a maneuver for the autonomous vehicle simulation or the dynamic agent in the vehicle simulation.

### Claim 19

An article, comprising a non-transitory storage medium, the non-transitory storage medium having stored thereon instructions that, when executed by a machine, result in:
receiving a plurality of actual states for a simulation, the plurality of actual states for the simulation including a current actual state for the simulation;
selecting a set of hyperparameters for a neural network encoder responsive to the plurality of actual states for the simulation;
determining an encoding function performed using the neural network encoder responsive to the set of hyperparameters for the neural network encoder;
determining an A-matrix, the A-matrix responsive to the encoding function performed using the neural network encoder; and
using the neural network encoder and the A-matrix to determine a next predicted state for the simulation responsive to the current actual state for the simulation.

### Claim 20 (depends on 19)

The article according to claim 19, wherein the A-matrix is determined by solving a least-squares problem responsive to each state in the plurality of actual states for the simulation and each subsequent state in the plurality of actual states for the simulation.
