Process planning apparatus based on augmented reality

A process planning apparatus based on augmented reality (AR), the process planning apparatus comprising:

• a camera set capturing color and depth images of a processing machine and a probe or a dispenser tip operated by a human user in a real scene to obtain scene data;
• a processor, which is signal-connected to the camera set and the processing machine, creates spatial intelligences for motion planning of the probe or the dispenser tip operated by the human user in an AR environment combining a virtual workpiece with the scene data, and generates instructional data from the spatial intelligences to guide the human user to operate the probe or the dispenser tip to produce machine motion data;
• and
• an output interface, which is signal-connected to the processor, and outputs the scene data, the virtual workpiece and the instructional data to the human user, wherein:
• the processing machine is an adhesive dispenser;
• an occlusion relationship between the real scene and the virtual workpiece is calculated by the processor and displayed with depth data of the depth image to increase spatial understanding of the human user;
• when the camera set instantly obtains the scene data, the processor instantly creates the spatial intelligences for motion planning in the AR environment presented on the output interface and generates the instructional data presented on the output interface so that the human user can instantly see the scene data, the virtual workpiece and the instructional data on the output interface while operating the probe or the dispenser tip;
• and
• when the human user is guided by the output interface and instantly operates the probe or the dispenser tip, the processor instantly produces the machine motion data according to operations of the human user on the probe or the dispenser tip to determine dispensing locations.