Intelligent identification and warning method for uncertain object of production line in digital twin environment (DTE)

An intelligent identification and warning method for an uncertain physical object entering a production line system in a digital twin environment (DTE), comprising the following steps:

• S1:
• establishing a model library for uncertain physical objects from a non-production line system, wherein establishing the model library by establishing, for a specific workshop production line system with computer aided design (CAD) software, three-dimensional (3D) solid models of all uncertain physical objects entering the production line system from the non-production line system, and classifying the 3D solid models of the uncertain physical objects to obtain model families;
• S2:
• adding attribute data to the uncertain physical objects from the non-production line system, wherein adding the attribute data to the uncertain physical objects by determining, according to knowledge of a design engineer and a manufacturing engineer, the attribute data for the uncertain physical objects from the non-production line system, comprising a name, a serial number, a type, dimensions, a safety and a danger level, and directly adding the attribute data to the established 3D solid models of the uncertain physical objects through a secondary development interface of the CAD software;
• S3:
• importing a newly established model library based on the added attribute data for the uncertain physical objects from the non-production line system in steps S1 and S2 into a model library of an existing DT production line system;
• S4:
• performing, based on you only look once (YOLO), auto-detection on the uncertain physical object entering the production line system to obtain a type and a position of the uncertain physical object;
• S5:
• detecting, based on binocular vision, an actual size of the uncertain physical object entering the production line system;
• S6:
• determining, in real time according to a result of the uncertain physical object detection in each of steps S4 and S5, a safety of the uncertain physical object entering the production line system, warning a danger when the uncertain physical object is an unsafe object, and performing model matching when the uncertain physical object is a safe object;
• S7:
• warning the danger, wherein warning the danger for the unsafe object by means of voice prompting, system alarming and information pushing, and selecting a different warning content according to a danger level of the unsafe object, when a transport vehicle not from the production line system enters the production line system, prompting an on-site worker with a voice prompt for a caution, and notifying a workshop manager by pushing information to check an identity of the transport vehicle, and when a fire occurs in the production line system, alarming a danger by the production line system and prompting all workers with a voice prompt for an orderly evacuation;
• S8:
• matching, for the safe object, a corresponding virtual model in the new established model library according to the detected type and actual size of the uncertain physical object entering the production line system, matching, according to the detected type of the uncertain physical object in step S4, a model family of a same type in the new established model library for the uncertain physical objects from the non-production line system in step S1, and finding a specific 3D solid model from the model family according to the detected actual size in step S5;
• and
• S9:
• loading a matched 3D solid model to the existing DT production line system according to the position data of the detected uncertain physical object entering the production line system, to implement virtual-real synchronization.