Systems and methods for adaptive optimization for energy systems

A computer-implemented system, comprising:

• a database comprising historical control environment data associated with an energy system having a plurality of controllable assets;
• one or more electronic devices each having one or more processors and memory configured to:
• train an agent selection policy of a control agent selector, wherein the training comprises:
• calculating a historical system-wide performance score for each of a plurality of system-wide control agents based on the historical control environment data and on historical performance information of the control agents, wherein each of the plurality of control agents comprises a system-wide control policy for controlling the energy system, and wherein each of the historical system-wide performance scores relates to the performance of a respective control agent with its respective system-wide control policy in controlling the energy system;
• and
• training the agent selection policy based on the historical control environment data and the calculated historical system-wide performance scores, wherein the training comprises learning a function that maps the historical control environment data to the historical system-wide performance score for each of the plurality of control agents;
• and
• input new control environment data associated with the energy system into the control agent selector;
• select, by the control agent selector based on the trained agent selection policy, a system-wide control agent from among the plurality of control agents, the selecting comprising:
• calculating predicted system-wide performance scores for the plurality of control agents based on the new control environment data;
• and
• selecting the control agent based on the calculated predicted system-wide performance scores;
• control the energy system using the system-wide control policy of the selected system-wide control agent and based on the new control environment data to perform at least one of:
• charge or discharge at least one of the controllable assets, and turn on or turn off at least one of the controllable assets.

A non-transitory computer-readable medium having computer-readable instructions stored thereon, the computer-readable instructions executable by a processor of one or more electronic devices to cause the performance of operations comprising:

• storing a database comprising historical control environment data associated with an energy system having a plurality of controllable assets;
• training an agent selection policy of a control agent selector, wherein the training comprises:
• calculating a historical system-wide performance score for each of a plurality of system-wide control agents based on the historical control environment data and on historical performance information of the control agents, wherein each of the plurality of control agents comprises a system-wide control policy for controlling the energy system, and wherein each of the historical system-wide performance scores relates to the performance of a respective control agent with its respective system-wide control policy in controlling the energy system;
• and
• training the agent selection policy based on the historical control environment data and the calculated historical system-wide performance scores, wherein the training comprises learning a function that maps the historical control environment data to the historical system-wide performance score for each of the plurality of control agents;
• inputting, new control environment data associated with the energy system into the control agent selector;
• selecting, by the control agent selector based on the trained agent selection policy, a system-wide control agent from among the plurality of control agents, the selecting comprising:
• calculating predicted system-wide performance scores for the plurality of control agents based on the new control environment data;
• and
• selecting the control agent based on the calculated predicted system-wide performance scores;
• and
• controlling the energy system using the system-wide control policy of the selected system-wide control agent and based on the new control environment data to perform at least one of:
• charge or discharge at least one of the controllable assets, and turn on or turn off at least one of the controllable assets.