Inspection assistance system, inspection assistance method, and inspection assistance computer-readable recording medium storing program

An inspection assistance method comprising:

• a step of recognizing a shape of an inspection target object included in a two-dimensional photographed image based on the two-dimensional photographed image obtained by capturing the inspection target object with an imaging device;
• a step of detecting a defect of the inspection target object included in the two-dimensional photographed image;
• a step of estimating a coordinate transformation parameter to transform a first coordinate system corresponding to the three-dimensional CAD model into a second coordinate system corresponding to a viewpoint of the imaging device that has captured the two-dimensional photographed image, based on the shape and a three-dimensional CAD model of the inspection target object;
• a step of modifying a position and a direction of viewpoint information of the three-dimensional CAD model of the inspection target object by using the coordinate transformation parameter;
• a step of extracting a two-dimensional simulated image corresponding to the two-dimensional photographed image from the three-dimensional CAD model after the viewpoint information is modified;
• and
• a step of depicting a defect image on the three-dimensional CAD model by fitting the two-dimensional photographed image including the defect image illustrating the defect to the two-dimensional simulated image.

A computer-readable storage medium that stores an inspection assistance computer-readable recording medium storing a program that causes a computer to execute:

• a step of recognizing a shape of an inspection target object included in a two-dimensional photographed image based on the two-dimensional photographed image obtained by capturing the inspection target object with an imaging device;
• a step of detecting a defect of the inspection target object included in the two-dimensional photographed image;
• a step of estimating a coordinate transformation parameter to transform a first coordinate system corresponding to the three-dimensional CAD model into a second coordinate system corresponding to a viewpoint of the imaging device that has captured the two-dimensional photographed image, based on the shape and a three-dimensional CAD model of the inspection target object;
• a step of modifying a position and a direction of viewpoint information of the three-dimensional CAD model of the inspection target object by using the coordinate transformation parameter;
• a step of extracting a two-dimensional simulated image corresponding to the two-dimensional photographed image from the three-dimensional CAD model after the viewpoint information is modified;
• and
• a step of depicting a defect image on the three-dimensional CAD model by fitting the two-dimensional photographed image including the defect image illustrating the defect to the two-dimensional simulated image.