Back to results
US 11,900,226 B2Granted
Systems for constructing hierarchical training data sets for use with machine-learning and related methods therefor
AssigneeSource Global, PBC
InventorsCody Alden Friesen, Paul Bryan Johnson, Heath Lorzel, Kamil Salloum, Jonathan Edward Goldberg, Grant Harrison Friesen, Jason Douglas Horwitz
Life of this patent
Estimating the term…
Abstract
Some embodiments include a system operable to construct hierarchical training data sets for use with machine-learning for multiple controlled devices. Other embodiments of related systems and methods are also provided.
Claims18
A system comprising:
- a processor;
- and
- a tangible, non-transitory memory configured to communicate with the processor,
- the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:
- receiving a first training data set comprising first training data having been generated by a first controlled device;
- determining that the first training data set is inadequate to fully form a hierarchical training data set such that the first training data set does not include a first optimal control input value of a first control input for each potential combination of controlled device inputs and controlled device outputs;
- receiving a second training data set comprising second training data having been generated by the first controlled device and a second controlled device;
- receiving first free inputs of the first controlled device and second free inputs of the second controlled device, wherein the first free inputs and the second free inputs are respective measurable inputs of the first controlled device and the second controlled device that are not subject to the control of an operator of the first controlled device and the second controlled device;
- supplementing the first training data set with the second training data set to fill in missing combinations of the controlled device inputs, the controlled device outputs, the first free inputs and the second free inputs in the first training data set and to form the hierarchical training data set;
- supplementing the hierarchical training data set with simulated optimal values of the controlled device inputs, the controlled device outputs, the first free inputs and the second free inputs, in response to the first training data set with the second training data set being inadequate;
- training a neural network using the hierarchical training data set to determine the first optimal control input value of the first control input for the first controlled device of multiple controlled devices;
- wherein the multiple controlled devices comprise the first controlled device and the second controlled device;
- using the hierarchical training data set with the trained neural network, the controlled device inputs, the first free inputs and the second free inputs to determine the controlled device outputs, and
- implementing a perturbation system configured to cause a control system of the first controlled device to operate the first controlled device with values of the first control input other than the first optimal control input value of the first control input.
11 more elements
A method being implemented via execution of computer instructions configured to run on one or more processors and configured to be stored at on one or more non-transitory memory storage devices, the method comprising:
- receiving a first training data set comprising first training data having been generated by a first controlled device;
- determining that the first training data set is inadequate to fully form a hierarchical training data set such that the first training data set does not include a first optimal control input value of a first control input for each potential combination of controlled device inputs and controlled device outputs;
- receiving a second training data set comprising second training data having been generated by the first controlled device and a second controlled device;
- receiving first free inputs of the first controlled device and second free inputs of the second controlled device, wherein the first free inputs and the second free inputs are respective measurable inputs of the first controlled device and the second controlled device that are not subject to the control of an operator of the first controlled device and the second controlled device;
- supplementing the first training data set with the second training data set to fill in missing combinations of the controlled device inputs, the controlled device outputs, the first free inputs and the second free inputs in the first training data set and to form the hierarchical training data set;
- supplementing the hierarchical training data set with simulated optimal values of the controlled device inputs, the controlled device outputs, the first free inputs and the second free inputs, in response to the first training data set with the second training data set being inadequate;
- training a neural network using the hierarchical training data set to determine the first optimal control input value of the first control input for the first controlled device of multiple controlled devices;
- wherein the multiple controlled devices comprise the first controlled device and the second controlled device;
- using the hierarchical training data set with the trained neural network, the controlled device inputs, the first free inputs and the second free inputs to determine the controlled device outputs;
- and
- causing, using a perturbation system, a control system of the first controlled device to operate the first controlled device with values of the first control input other than the first optimal control input value of the first control input.
8 more elements
Dependencies are inferred from the claim text.