AI-based System and Method for Optimizing Lot Dispatching in Semiconductor Fabrication Using Reinforcement Learning and Fab-wide Digital Twin
AssigneeInspiring Atoms Pte Ltd
InventorYang Pan
Life of this patent
Estimating the term…
Abstract
Disclosed herein is an AI-based system and method for optimizing lot dispatching in a semiconductor Fab using reinforcement learning (RL) and a Fab-wide digital twin. The system leverages a policy neural network and Monte Carlo Tree Search (MCTS) to enhance cycle time, output, and on-time delivery. The RL agent continuously trains in the background, adapting to changes in Fab operations, ensuring optimized real-time decision-making.
Claims20
A lot dispatching system in a semiconductor Fab, comprising:
- an AI machine including an AI engine;
- a Fab-wide digital twin comprising models of various process systems, grouped by types based on manufacturing capacity available for processing a plurality of lots;
- and
- a policy neural network configured to generate outputs representing the probability of selecting a lot for processing in an available process system, wherein the policy neural network is trained using a self-initiated reinforcement learning (RL) process by an RL agent within the AI engine, leveraging data generated by the digital twin.
A method for dispatching lots in a semiconductor Fab, comprising:
- initiating, by an RL agent of an AI engine in an AI machine, an episode for training a policy neural network through an RL process, wherein the episode includes a plurality of simulated cases leveraging a Fab-wide digital twin, and wherein the Fab-wide digital twin includes digital twins for various types of process systems;
- assigning, by the RL agent, weights to the policy neural network, wherein the policy neural network includes an input layer, a plurality of hidden layers, and an output layer, and wherein the output layer includes outputs describing softmax or logistic functions for generating probability distributions of the lots to be selected for processing by an available process system;
- establishing, by the RL agent, a node associated with the states of the process systems and the states of the lots, and expanding the node into a network comprising a plurality of nodes consisting of a plurality of state-action pairs, wherein the RL agent employs the policy neural network and a Monte Carlo Tree Search (MCTS) program to form the state-action pairs, and wherein the states are generated based on the Fab-wide digital twin;
- calculating, by the RL agent, a reward for each case, wherein the case includes a chain of state-actions, and wherein the last state is a terminal state meeting criteria for the reward calculation;
- determining, by the RL agent, a reward for each state-action pair;
- determining a value for each node after the episode is completed;
- updating the weights of the policy neural network by leveraging the determined rewards for the state-action pairs and the value for the node, whereby the updated policy neural network becomes more efficient in generating actions with higher value;
- finalizing the policy neural network after the RL process has converged;
- and
- applying the trained policy neural network for real-world applications.
An AI machine for coordinating operations of a Fab, comprising:
- an AI engine comprising a compute engine, wherein the compute engine utilizes a GPU, a high-bandwidth memory (HBM), and a compute unified device architecture (CUDA);
- an RL agent, part of the compute engine, designed to conduct a self-initiated reinforcement learning process to train a policy neural network, wherein the trained policy neural network generates probability distributions for selecting lots pending for processing using an available process system;
- and
- a Fab-wide digital twin that generates synthetic data to support the reinforcement learning process, wherein the Fab-wide digital twin comprises digital twins for various process systems in the Fab.
Dependencies are inferred from the claim text.