Automatic control loop grading and data labeling

A computer-readable storage medium comprising computer-executable instructions that, when executed by a processor, cause the processor to perform operations comprising:

• defining a plurality of policies;
• activating an automated control loop grading and data labeling (“ACLGDL”) system for a control loop to be executed by a control loop system, wherein the control loop uses data collected from a domain;
• determining that the control loop system has executed the control loop and has generated a result;
• analyzing the result of the control loop based upon a grading-analysis policy that defines how the ACLGDL system is to evaluate a performance of the control loop;
• grading the result of the control loop based upon a grading-results policy that defines how the ACLGDL system is to determine a grade for the performance of the control loop;
• instructing the control loop system to collect additional data from the domain based upon a labeling-collection policy that defines the additional data to be collected;
• preparing the additional data for labeling based upon a labeling assembly policy that defines how the additional data is to be aggregated, organized, and formatted for labeling;
• labeling the additional data for use by an output system based upon a labeling policy that defines how the additional data is to be labeled, thereby creating labeled data;
• and
• publishing, to the output system, the grade for the performance of the control loop and the labeled data based upon a publishing policy that defines how the labeled data is to be published.

An automated control loop grading and data labeling (“ACLGDL”) system comprising:

• a processor;
• and
• a memory comprising computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising
• defining a plurality of policies,
• activating the ACLGDL system for a control loop to be executed by a control loop system, wherein the control loop uses data collected from a domain,
• determining that the control loop system has executed the control loop and has generated a result,
• analyzing the result of the control loop based upon a grading-analysis policy that defines how the ACLGDL system is to evaluate a performance of the control loop,
• grading the result of the control loop based upon a grading-results policy that defines how the ACLGDL system is to determine a grade for the performance of the control loop,
• instructing the control loop system to collect additional data from the domain based upon a labeling-collection policy that defines the additional data to be collected,
• preparing the additional data for labeling based upon a labeling assembly policy that defines how the additional data is to be aggregated, organized, and formatted for labeling,
• labeling the additional data for use by an output system based upon a labeling policy that defines how the additional data is to be labeled, thereby creating labeled data, and
• publishing, to the output system, the grade for the performance of the control loop and the labeled data based upon a publishing policy that defines how the labeled data is to be published.