Image manipulation for material information determination

An apparatus for extracting material information of an object from a pattern image of the object, wherein the apparatus comprises:

• a receiving unit configured to receive the pattern image showing the object;
• a manipulating unit configured to manipulate the pattern image to generate a partial image;
• an extracting unit configured to extract material information of the object from the partial image by providing the partial image to a data-driven model, wherein
• the data-driven model is parametrized according to a training data set including partial images and material information;
• and
• a provisioning unit configured to provide the extracted material information.

A computer implemented method for training a data-driven model suitable for extracting material information of an object from a pattern image of the object, wherein the method comprises:

• receiving the pattern image showing the object while the object is illuminated with a light pattern;
• manipulating the pattern image to generate a partial image;
• training a data-driven model to determine material information of the object from the partial image, wherein
• the training comprises parametrizing the data-driven model according to a training data set including partial images and material information, and
• providing the trained data-driven model.

An apparatus for training a data-driven model suitable for extracting material information of an object from a pattern image of the object, wherein the method comprises:

• a receiving unit configured to receive the pattern image showing the object;
• a manipulating unit configured to manipulate the pattern image to generate a partial image;
• a training unit configured to train a data-driven model to determine material information of the object from the partial image, wherein
• the training comprises parametrizing the data-driven model according to a training data set including partial images and material information, and
• a provisioning unit configured to provide the trained data-driven model.

A data structure product comprising manipulated image data for extracting material information from a pattern image, wherein

• the manipulated image data includes partial images;
• and/or
• at least one representation associated with a physical signature of the partial image;
• and/or
• at least one cluster associated with the representation and/or
• material information labelling the pattern features in the pattern image.