Detection method for spinning workshop, electronic device and storage medium

An electronic device, comprising:

• at least one processor;
• and
• a memory connected in communication with the at least one processor;
• wherein the memory stores instructions executable by the at least one processor, and the instructions, when executed by the at least one processor, enable the at least one processor to execute a method comprising:
• performing image collection on a process control device of a spinning box in a spinning workshop to obtain an image to be processed;
• extracting a first image feature from the image to be processed, comprising:
• inputting the image to be processed into an everything segmentation model to obtain a mask image of a target position, said target position being a damaged position in a heat preservation layer included in the process control device of the spinning box in the spinning workshop;
• generating a minimum rectangular bounding box to accommodate the mask image of the target position based on the mask image of the target position;
• cutting out a visible sub-image from the image to be processed based on the minimum rectangular bounding box, and cutting out a thermal sub-image within the minimum rectangular bounding box from a thermal image with a same viewing range as the image to be processed;
• inputting the visible sub-image into a backbone network to obtain a first sub-image feature;
• inputting the first sub-image feature into an encoder network to obtain a sub-image feature to be fused;
• extracting a thermal feature from the thermal sub-image;
• and
• fusing the sub-image feature to be fused, the thermal feature, and a second sub-image feature extracted by the everything segmentation model from the minimum rectangular bounding box of the image to be processed, to obtain the first image feature;
• and
• processing the first image feature based on a decoder network to obtain a fault detection result for the process control device, wherein the fault detection result output by the decoder network comprises a fault classification result and a fault position output by the decoder network.

A non-transitory computer-readable storage medium storing computer instructions thereon, wherein the computer instructions are used to cause a computer to execute a method comprising:

• performing image collection on a process control device of a spinning box in a spinning workshop to obtain an image to be processed;
• extracting a first image feature from the image to be processed, comprising:
• inputting the image to be processed into an everything segmentation model to obtain a mask image of a target position, said target position being a damaged position in a heat preservation layer included in the process control device of the spinning box in the spinning workshop;
• generating a minimum rectangular bounding box to accommodate the mask image of the target position based on the mask image of the target position;
• cutting out a visible sub-image from the image to be processed based on the minimum rectangular bounding box, and cutting out a thermal sub-image within the minimum rectangular bounding box from a thermal image with a same viewing range as the image to be processed;
• inputting the visible sub-image into a backbone network to obtain a first sub-image feature;
• inputting the first sub-image feature into an encoder network to obtain a sub-image feature to be fused;
• extracting a thermal feature from the thermal sub-image;
• and
• fusing the sub-image feature to be fused, the thermal feature, and a second sub-image feature extracted by the everything segmentation model from the minimum rectangular bounding box of the image to be processed, to obtain the first image feature,
• wherein a fault detection result output by a decoder network comprises a fault classification result and a fault position output by the decoder network.