System module of simulating machine operation screen based on non-invasive data-extraction system

A system module of simulating a machine operation screen based on an non-invasive data-extraction system, is applied to a machine controller and configured to control a machine, and a system module comprises:

• an image capture device configured to receive an original operation screen outputted from a machine control program of the machine controller, and transmit the original operation screen to an non-invasive data-extraction system to extract information shown on the original operation screen of the machine;
• a high-speed image process unit configured to receive the original operation screen of the machine, and perform an image process on the original operation screen to provide the machine operational information, wherein the high-speed image process unit recognizes a specific page-pattern shown on the operation screen and note a page-ID, obtained from a recognition result, in the image of the operation screen, and compares an icon of a mouse cursor on the operation screen to position a coordinate of the mouse cursor, and define a threshold for an image change to detect occurrence of a pop-up window;
• a software control system configured to receive information from the non-invasive data-extraction system, and analyze the machine operational information transmitted from the high-speed image process unit, wherein the software control system periodically updates an operational page of the operation screen according to the page-ID, and compare a coordinate and a range of a control component embedded in the operational page, to create an operational flow of the machine controller for generating a simulated machine operation screen image, and wherein when the high-speed image process unit detects occurrence of the pop-up window, the high-speed image process unit outputs a warning message;
• an image output device configured to output the simulated machine operation screen image linked with the control component, to a screen of the machine controller;
• a signal receiving device configured to transmit a control signal of a keyboard/mouse inputted from the machine controller, to the software control system for processing, and wherein the signal receiving device is configured to find the control component in the operational flow according to a position of mouse-clicking, and
• an HID simulation device configured to simulate the keyboard/mouse to transmit a corresponding control signal to the machine controller, so as to enable the machine controller to execute an inputted command.