# US 2016/0259869 A1 · Self-learning simulation environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259869 A1
- Document ID: US20160259869A1
- Status: Published application
- Kind: A1
- Application number: 14/636,133
- Filed: 2015-03-02
- Published: 2016-09-08
- Earliest claimed: 2015-03-02
- Assignees: CA, Inc.
- Inventors: Prashant PARIKH; Steven L. GREENSPAN; Debra J. DANIELSON; Serge MANKOVSKII; Maria C. VELEZ-ROJAS; James D. RENO
- Web page: https://patentgrep.com/patent/US20160259869A1

## CPC

- G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30)
- G05B 17/02: electric
- G05B 23/0245: {based on a qualitative model, e.g. rule based; if-then decisions}
- G05B 23/0243: {model based detection method, e.g. first-principles knowledge model}
- G05B 23/0262: {Confirmation of fault detection, e.g. extra checks to confirm that a failure has indeed occurred}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

Systems and methods may include receiving performance data of a system. The systems and methods may include generating a virtual representation of the system based on the performance data. The systems and methods may include simulating interactions between the virtual representation and an environment based on the performance data. The systems and methods may include generating an alert indicating an occurrence of an anomalous event based on the simulated interactions. The systems and methods may include determining that the alert was a false positive indicator of the occurrence of the anomalous event. The systems and methods may include, in response to determining that the alert was a false positive indicator, determining differences between a behavior of the system and the simulated interactions. The systems and methods may include determining an adjustment to the virtual representation to mitigate the differences between the behavior of the system and the simulated interactions.

## Claims

### Claim 1

A method comprising:
receiving performance data of a physical system;
generating a virtual representation of the physical system based on the performance data of the physical system;
simulating interactions between the virtual representation and an environment of the physical system based on the performance data of the physical system;
generating an alert indicating an occurrence of an anomalous event in the physical system based on the simulated interactions;
determining that the alert was a false positive indicator of the occurrence of the anomalous event in the physical system;
in response to determining that the alert was a false positive indicator of the occurrence of the anomalous event in the physical system, determining differences between a behavior of the physical system and the simulated interactions between the virtual representation and the environment;
determining an adjustment to the virtual representation of the physical system to mitigate the differences between the behavior of the physical system and the simulated interactions; and
modifying the virtual representation of the physical system in accordance with the determined adjustment.

### Claim 2 (depends on 1)

The method of claim 1, wherein generating the alert indicating the occurrence of the anomalous event in the physical system comprises:
determining whether the simulated interactions include a simulation of the anomalous event; and
in response to determining that the simulated interactions include the simulation of the anomalous event, generating the alert.

### Claim 3 (depends on 2)

The method of claim 2, wherein determining the adjustment to the virtual representation of the physical system comprises:
identifying parameters of the performance data of the physical system that were not used to generate the virtual representation;
generating another virtual representation of the physical system based on one or more of the parameters of the performance data of the physical system that were not used to generate the virtual representation;
simulating other interactions between the other virtual representation and the environment;
determining whether the other simulated interactions include the simulation of the anomalous event; and
in response to determining that the other simulated interactions do not include the simulation of the anomalous event, determining that the adjustment to the virtual representation of the physical system includes modifying the virtual representation to be based on the one or more of the parameters.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving performance data of a plurality of physical systems, the plurality of physical systems comprising the physical system; and
recording a behavior history of the plurality of physical systems by storing the performance data of the plurality of physical systems,
wherein generating the virtual representation of the physical system comprises generating the virtual representation of the physical system based on the behavior history of the plurality of physical systems, and
wherein simulating the interactions between the virtual representation and the environment comprises simulating the interactions between the virtual representation and the environment based on the behavior history of the plurality of physical systems.

### Claim 5 (depends on 1)

The method of claim 1, wherein the differences between the behavior of the physical system and the simulated interactions include different responses by the physical system and the virtual representation to the same performance data of the physical system.

### Claim 6 (depends on 1)

The method of claim 1,
wherein the physical system comprises a plurality of physical components,
wherein the performance data of the physical system comprises performance data for each physical component of the plurality of physical components,
wherein the virtual representation of the physical system comprises a plurality of virtual components, each virtual component of the plurality of virtual components corresponding to a respective physical component of the plurality of physical components, and
wherein simulating the interactions between the virtual representation and the environment comprises:
simulating future interactions between each virtual component of the plurality of virtual components and other virtual components of the plurality of virtual components; and
simulating future interactions between each virtual component of the plurality of virtual components and a virtual representation of the environment.

### Claim 7 (depends on 6)

The method of claim 6,
wherein the anomalous event includes receiving anomalous performance data of a physical component of the plurality of physical components that indicates an anomalous behavior, and
wherein generating the alert comprises generating the alert in response to simulating a future interaction between a virtual component corresponding to the physical component that matches the anomalous behavior.

### Claim 8

A system comprising:
a processing system configured to:
receive performance data of a physical system;
generate a virtual representation of the physical system based on the performance data of the physical system;
simulate interactions between the virtual representation and an environment of the physical system based on the performance data of the physical system;
generate an alert indicating an occurrence of an anomalous event in the physical system based on the simulated interactions;
determine that the alert was a false positive indicator of the occurrence of the anomalous event in the physical system;
in response to determining that the alert was a false positive indicator of the occurrence of the anomalous event in the physical system, determine differences between a behavior of the physical system and the simulated interactions between the virtual representation and the environment;
determine an adjustment to the virtual representation of the physical system to mitigate the differences between the behavior of the physical system and the simulated interactions; and
modify the virtual representation of the physical system in accordance with the determined adjustment.

### Claim 9 (depends on 8)

The system according to claim 8, wherein, when generating the alert indicating the occurrence of the anomalous event in the physical system, the processing system is configured to:
determine whether the simulated interactions include a simulation of the anomalous event; and
in response to determining that the simulated interactions include the simulation of the anomalous event, generate the alert.

### Claim 10 (depends on 9)

The system according to claim 9, wherein, when determining the adjustment to the virtual representation of the physical system, the processing system is configured to:
identify parameters of the performance data of the physical system that were not used to generate the virtual representation;
generate another virtual representation of the physical system based on one or more of the parameters of the performance data of the physical system that were not used to generate the virtual representation;
simulate other interactions between the other virtual representation and the environment;
determine whether the other simulated interactions include the simulation of the anomalous event; and
in response to determining that the other simulated interactions do not include the simulation of the anomalous event, determine that the adjustment to the virtual representation of the physical system includes modifying the virtual representation to be based on the one or more of the parameters.

### Claim 11 (depends on 8)

The system according to claim 8, wherein the processing system is further configured to:
receive performance data of a plurality of physical systems, the plurality of physical systems comprising the physical system; and
record a behavior history of the plurality of physical systems by storing the performance data of the plurality of physical systems,
wherein, when generating the virtual representation of the physical system, the processing system is configured to generate the virtual representation of the physical system based on the behavior history of the plurality of physical systems, and
wherein, when simulating the interactions between the virtual representation and the environment, the processing system is configured to simulate the interactions between the virtual representation and the environment based on the behavior history of the plurality of physical systems.

### Claim 12 (depends on 8)

The system according to claim 8, wherein the differences between the behavior of the physical system and the simulated interactions include different responses by the physical system and the virtual representation to the same performance data of the physical system.

### Claim 13 (depends on 8)

The system according to claim 8,
wherein the physical system comprises a plurality of physical components,
wherein the performance data of the physical system comprises performance data for each physical component of the plurality of physical components,
wherein the virtual representation of the physical system comprises a plurality of virtual components, each virtual component of the plurality of virtual components corresponding to a respective physical component of the plurality of physical components, and
wherein, when simulating the interactions between the virtual representation and the environment, the processing system is configured to:
simulate future interactions between each virtual component of the plurality of virtual components and other virtual components of the plurality of virtual components; and
simulate future interactions between each virtual component of the plurality of virtual components and a virtual representation of the environment.

### Claim 14 (depends on 13)

The system according to claim 13,
wherein the anomalous event includes receiving anomalous performance data of a physical component of the plurality of physical components that indicates an anomalous behavior, and
wherein, when generating the alert, the processing system is configured to generate the alert in response to simulating a future interaction between a virtual component corresponding to the physical component that matches the anomalous behavior.

### Claim 15

A computer program product comprising:
a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising:
computer readable program code configured to receive performance data of a physical system;
computer readable program code configured to generate a virtual representation of the physical system based on the performance data of the physical system;
computer readable program code configured to simulate interactions between the virtual representation and an environment of the physical system based on the performance data of the physical system;
computer readable program code configured to generate an alert indicating an occurrence of an anomalous event in the physical system based on the simulated interactions;
computer readable program code configured to determine that the alert was a false positive indicator of the occurrence of the anomalous event in the physical system;
computer readable program code configured to, in response to determining that the alert was a false positive indicator of the occurrence of the anomalous event in the physical system, determine differences between a behavior of the physical system and the simulated interactions between the virtual representation and the environment;
computer readable program code configured to determine an adjustment to the virtual representation of the physical system to mitigate the differences between the behavior of the physical system and the simulated interactions; and
computer readable program code configured to modify the virtual representation of the physical system in accordance with the determined adjustment.

### Claim 16 (depends on 15)

The computer program product of claim 15,
wherein the computer readable program code configured to generate the alert indicating the occurrence of the anomalous event in the physical system comprises:
computer readable program code configured to determine whether the simulated interactions include a simulation of the anomalous event; and
computer readable program code configured to, in response to determining that the simulated interactions include the simulation of the anomalous event, generate the alert.

### Claim 17 (depends on 16)

The computer program product of claim 16,
wherein the computer readable program code configured to determine the adjustment to the virtual representation of the physical system comprises:
computer readable program code configured to identify parameters of the performance data of the physical system that were not used to generate the virtual representation;
computer readable program code configured to generate another virtual representation of the physical system based on one or more of the parameters of the performance data of the physical system that were not used to generate the virtual representation;
computer readable program code configured to simulate other interactions between the other virtual representation and the environment;
computer readable program code configured to determine whether the other simulated interactions include the simulation of the anomalous event; and
computer readable program code configured to, in response to determining that the other simulated interactions do not include the simulation of the anomalous event, determine that the adjustment to the virtual representation of the physical system includes modifying the virtual representation to be based on the one or more of the parameters.

### Claim 18 (depends on 15)

The computer program product of claim 15, further comprising:
computer readable program code configured to receive performance data of a plurality of physical systems, the plurality of physical systems comprising the physical system; and
computer readable program code configured to record a behavior history of the plurality of physical systems by storing the performance data of the plurality of physical systems,
wherein the computer readable program code configured to generate the virtual representation of the physical system comprises:
computer readable program code configured to generate the virtual representation of the physical system based on the behavior history of the plurality of physical systems, and
wherein the computer readable program code configured to simulate the interactions between the virtual representation and the environment comprises:
computer readable program code configured to simulate the interactions between the virtual representation and the environment based on the behavior history of the plurality of physical systems.

### Claim 19 (depends on 15)

The computer program product of claim 15,
wherein the physical system comprises a plurality of physical components,
wherein the performance data of the physical system comprises performance data for each physical component of the plurality of physical components,
wherein the virtual representation of the physical system comprises a plurality of virtual components, each virtual component of the plurality of virtual components corresponding to a respective physical component of the plurality of physical components, and
wherein the computer readable program code configured to simulate the interactions between the virtual representation and the environment comprises:
computer readable program code configured to simulate future interactions between each virtual component of the plurality of virtual components and other virtual components of the plurality of virtual components; and
computer readable program code configured to simulate future interactions between each virtual component of the plurality of virtual components and a virtual representation of the environment.

### Claim 20 (depends on 19)

The computer program product of claim 19,
wherein the anomalous event includes receiving anomalous performance data of a physical component of the plurality of physical components that indicates an anomalous behavior, and
wherein the computer readable program code configured to generate the alert comprises:
computer readable program code configured to generate the alert in response to simulating a future interaction between a virtual component corresponding to the physical component that matches the anomalous behavior.
