Multi-agent simulations

A method performed by one or more computers for generating one or more simulations of an environment over a plurality of time steps, the method comprising, for each of one or more time steps:

• obtaining a plurality of current simulation states for the time step;
• generating, for each of the plurality of current simulation states, a plurality of candidate next simulation states for a next time step based on the current simulation state, wherein generating each candidate next simulation state comprises:
• determining, for each of a plurality of agents included in the environment, a respective next state of the agent at the next time step if the agent performs a respective action in response to the current simulation state at the current time step;
• and
• selecting a proper subset of the plurality of candidate next simulation states as current simulation states for the next time step.

A system comprising:

• one or more computers;
• and
• one or more storage devices communicatively coupled to the one or more computers, wherein the one or more storage devices store instructions that, when executed by the one or more computers, cause the one or more computers to perform operations for generating one or more simulations of an environment over a plurality of time steps, the operations comprising, for each of one or more time steps:
• obtaining a plurality of current simulation states for the time step;
• generating, for each of the plurality of current simulation states, a plurality of candidate next simulation states for a next time step based on the current simulation state, wherein generating each candidate next simulation state comprises:
• determining, for each of a plurality of agents included in the environment, a respective next state of the agent at the next time step if the agent performs a respective action in response to the current simulation state at the current time step;
• and
• selecting a proper subset of the plurality of candidate next simulation states as current simulation states for the next time step.

One or more non-transitory computer storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations for generating one or more simulations of an environment over a plurality of time steps, the operations comprising, for each of one or more time steps:

• obtaining a plurality of current simulation states for the time step;
• generating, for each of the plurality of current simulation states, a plurality of candidate next simulation states for a next time step based on the current simulation state, wherein generating each candidate next simulation state comprises:
• determining, for each of a plurality of agents included in the environment, a respective next state of the agent at the next time step if the agent performs a respective action in response to the current simulation state at the current time step;
• and
• selecting a proper subset of the plurality of candidate next simulation states as current simulation states for the next time step.