Making a failure scenario using adversarial reinforcement learning background

A computer program product including one or more computer readable storage mediums collectively storing program instructions that are executable by a processor or programmable circuitry to cause the processor or programmable circuitry to perform operations comprising:

• storing, in a first storage, a plurality of first experiences of failures of a player agent due to an adversarial agent;
• performing a simulation of an environment including the player agent and the adversarial agent;
• calculating a similarity of a second experience of a failure of the player agent in the simulation and each of the plurality of first experiences in the first storage;
• updating the first storage by adding the second experience as a new first experience of the plurality of first experiences in response to the similarity being less than a threshold;
• and
• training the adversarial agent by using at least one of the plurality of first experiences in the first storage to generate an adversarial agent having diverse experiences.

An apparatus comprising:

• a processor or a programmable circuitry;
• and
• one or more computer readable mediums collectively including instructions that, when executed by the processor or the programmable circuitry, cause the processor or the programmable circuitry to:
• store, in a first storage, a plurality of first experiences of failures of a player agent due to an adversarial agent;
• perform a simulation of an environment including the player agent and the adversarial agent;
• calculate a similarity of a second experience of a failure of the player agent in the simulation and each of the plurality of first experiences in the first storage;
• update the first storage by adding the second experience as a new first experience of the plurality of first experiences in response to the similarity being less than a threshold;
• and
• train the adversarial agent by using at least one of the plurality of first experiences in the first storage to generate an adversarial agent having diverse experiences.

An apparatus comprising:

• a first storage configured to store a plurality of first experiences of failures of a player agent due to an adversarial agent;
• a simulating section configured to perform a simulation of an environment including the player agent and the adversarial agent;
• a calculating section configured to calculate a similarity of a second experience of a failure of the player agent in the simulation and each of the plurality of first experiences in the first storage;
• an updating section configured to update the first storage by adding the second experience as a new first experience of the plurality of first experiences in response to the similarity being less than a threshold;
• and
• a training section configured to train the adversarial agent by using at least one of the plurality of first experiences in the first storage to generate an adversarial agent having diverse experiences.