Systems and methods for simulation-based real time production control
AssigneeArizona Board of Regents on behalf of Arizona State University
InventorsFeng Ju, Feifan Wang
Life of this patent
Estimating the term…
Abstract
A computer-implemented model is trained or otherwise configured for real-time production control. The model incorporates a plurality of classes of residence time control and optimizes produce performance by managing an associated machine's behavior according to real-time system states. The model can formulate a Markov decision process and feature-extraction method and feature-based approximation architecture to reduce state space of the model. Simulation is employed in training to estimate parameters of feature-based approximate architecture to obtain a lookahead function of the Markov decision process.
Claims10
A method for artificial intelligence (AI) driven simulation-based real-time control to improve production control in face of various classes of residence time constraints, comprising:
- accessing input data related to a production control process associated with a serial line defining a plurality of machines, the serial line defining a plurality of segments;
- and
- formulating a control problem to improve system performance for the production control process, the control problem seeking to maximize a production rate of the production control process in view of a plurality of residence time constraints associated with the serial line of the production control process;
- applying a model with a feature-based architecture to reduce dimensionality of and solve the control problem to control actions associated with the plurality of machines of the serial line, including:
- conducting feature extraction to map a system state associated with the production control process into a feature vector, and
- approximating a lookahead function by linearly weighting features of the feature vector, wherein the lookahead function includes parameters estimated from simulations during training,
- wherein the lookahead function accommodates storage of an optimal control policy to map the system state to an optimal action for maximizing the production rate.
A non-transitory medium having instructions encoded thereon, the instructions executable by a processor, to:
- access input data related to a production control process associated with a serial line defining a plurality of machines, the serial line defining a plurality of segments;
- and
- formulate a control problem to improve system performance for the production control process, the control problem seeking to maximize a production rate of the production control process in view of a plurality of residence time constraints associated with the serial line of the production control process;
- and
- apply a model with a feature-based architecture to reduce dimensionality of and solve the control problem to control actions associated with the plurality of machines of the serial line.
A system for production control with different classes of residence time constraints, comprising:
- a processor;
- and
- a memory in operable communication with the processor, the memory storing instructions executable by the processor such that the processor is configured to:
- access input data associated with a serial line defining a plurality of machines;
- and
- apply the input data associated with the serial line to a model configured for simulation-based real-time production control for the serial line related to residence time using a plurality of classes of residence time constraints, wherein the model is trained to output parameter settings defining system states to control the plurality of machines so as to increase production rate and reduce scrape rate.
Dependencies are inferred from the claim text.