Assembly error correction for assembly lines
AssigneeNanotronics Imaging, Inc.
InventorsMatthew C. Putman, Vadim Pinskiy, Eun-Sol Kim, Andrew Sundstrom
Life of this patent
Estimating the term…
Abstract
Aspects of the disclosed technology provide a computational model that utilizes machine learning for detecting errors during a manual assembly process and determining a sequence of steps to complete the manual assembly process in order to mitigate the detected errors. In some implementations, the disclosed technology evaluates a target object at a step of an assembly process where an error is detected to a nominal object to obtain a comparison. Based on this comparison, a sequence of steps for completion of the assembly process of the target object is obtained. The assembly instructions for creating the target object are adjusted based on this sequence of steps.
Claims20
A method for optimizing workflow in an assembly line, the method comprising:
- monitoring tooling at a step of an assembly process for assembling a target object;
- based on the monitoring, detecting, at the step of the assembly process of the target object, an error in assembly of the target object using a first neural network model;
- evaluating data associated with the tooling at the step of the assembly process using a second neural network to predict a quality metric for the target object;
- comparing the quality metric for the target object at the step of the assembly process to a nominal object at the step of the assembly process;
- based on the comparing, determining that the quality metric is out of specification;
- based the determining, generating an updated sequence of steps to bring the target object into specification using a gated recurrent unit model;
- and
- adjusting subsequent steps in the assembly process using updated assembly instructions for the target object based on the updated sequence of steps.
A system for optimizing workflow in an assembly line, the system comprising:
- a plurality of image capture devices, wherein each of the plurality of image capture devices is disposed at a different position to capture movement of an operator during an assembly process of a target object;
- and
- an assembly instruction module configured to automatically modify guidance and instructions provided to the operator, wherein the assembly instruction module is coupled to the plurality of image capture devices, and wherein the assembly instruction module is configured to perform operations comprising:
- receiving, by the assembly instruction module, motion data from the plurality of image capture devices, wherein the motion data corresponds to performance of a set of steps by the operator to assemble the target object;
- determining, based on the motion data and at a step of the set of steps, an error in assembly of the target object using a first neural network model;
- evaluating the motion data using a second neural network model to predict a quality metric for the target object;
- comparing the quality metric for the target object to a nominal object;
- based on the comparing, determining that the quality metric is out of specification;
- based the determining, generating an updated sequence of steps to bring the target object into specification using a gated recurrent unit model;
- and
- adjusting subsequent steps in the assembly processing using updated assembly instructions that are provided to the operator based on the updated sequence of steps.
A non-transitory computer-readable media comprising instructions stored thereon which, when executed by one or more processors, are configured to cause the one or more processors to perform operations comprising:
- monitoring tooling at a step of an assembly process for assembling a target object;
- based on the monitoring, detecting, at the step of the assembly process of a target object, an error in assembly of the target object using a first neural network model;
- evaluating data associated with the tooling at the step of the assembly process using a second neural network to predict a quality metric for the target object;
- comparing the quality metric for the target object at the step of the assembly process to a nominal object at the step of the assembly process;
- based on the comparing, determining that the quality metric is out of specification;
- based the determining, generating an updated sequence of steps to bring the target object into specification using a gated recurrent unit model;
- and
- adjusting subsequent steps in the assembly process using updated assembly instructions for the target object based on the updated sequence of steps.
Dependencies are inferred from the claim text.