Method and system for manufacturing operations workflow monitoring using structural similarity index based activity detection

A workflow monitoring system for monitoring manufacturing operation workflow, the system comprising:

• a processor;
• and
• a memory communicatively coupled to the processor, wherein the memory stores processor-executable instructions, which on execution, cause the processor to:
• receive video data corresponding to a manufacturing operation activity;
• extract a plurality of video frames from the video data;
• measure Structural Similarity (SSIM) index for each video frame of the plurality of video frames with respect to next consecutive video frame of the plurality of video frames;
• compare the SSIM index of the each video frame with the SSIM index of the next consecutive video frame of the plurality of video frames to identify one or more local maxima, wherein the identifying of one or more local maxima is based on at least one of a minimal horizontal distance between two SSIM indexes of video frames, and a minimal vertical distance between SSIM index of a video frame and lowest SSIM index of a video frame;
• and
• determine at least one manufacturing operation activity based on the one or more local maxima using machine learning technique.

A non-transitory computer readable medium including instructions stored thereon that when processed by at least one processor cause a workflow monitoring system to perform operations comprising:

• receiving video data corresponding to a manufacturing operation activity;
• extracting a plurality of video frames from the video data;
• measuring Structural Similarity (SSIM) index for each video frame of the plurality of video frames with respect to next consecutive video frame of the plurality of video frames;
• comparing the SSIM index of the each video frame with the SSIM index of next consecutive video frame of the plurality of video frames to identify one or more local maxima, wherein the identifying of one or more local maxima is based on at least one of a minimal horizontal distance between two SSIM indexes of video frames, and a minimal vertical distance between SSIM index of a video frame and lowest SSIM index of a video frame;
• and
• determining at least one manufacturing operation activity based on the one or more local maxima using machine learning technique.