Determining causal models for controlling environments

A system comprising:

• at least one computing device comprising one or more processors;
• and
• at least one memory coupled to at least one of the one or more processors, wherein the at least one memory comprises instructions that configure the at least one computing device to:
• repeatedly select control settings for the environment based on (i) a causal model that identifies causal relationships between possible settings for controllable elements in the environment and environment responses that reflect a performance of the control system in controlling the environment and (ii) current values of a set of internal parameters;
• and
• during the repeatedly selection:
• monitor environment responses to the selected control settings;
• determine, based on the environment responses, an indication that one or more properties of the environment have changed;
• and
• in response, modify the current values of one or more of the internal parameters and control the environment based on the one or more modified internal parameters.

One or more non-transitory computer-readable medium storing instructions that, when executed, configure at least one processor for:

• repeatedly selecting control settings for the environment based on (i) a causal model that identifies causal relationships between possible settings for controllable elements in the environment and environment responses that reflect a performance of the control system in controlling the environment and (ii) current values of a set of internal parameters;
• and
• during the repeatedly selecting:
• monitoring environment responses to the selected control settings;
• determining, based on the environment responses, an indication that one or more properties of the environment have changed;
• and
• in response, modifying the current values of one or more of the internal parameters and controlling the environment based on the one or more modified internal parameters.