Determination of the decision-relevant image components for an image classifier using binary masks

A method for measuring components of an input image on which an image classifier bases its decision regarding an assignment of the input image to one or multiple class(es) of a predefined classification, the method comprising the following steps:

• providing binary masks which indicate which pixels of the input image and/or of an intermediate product formed in the image classifier, are considered relevant;
• assessing each binary mask of the binary masks using a quality function, which is a measure of an extent to which at least one classification score, supplied by the image classifier, with respect to at least one target class changes when the pixels of the input image or of the intermediate product, which are relevant according to the binary mask, are changed;
• and
• ascertaining sought-after components of the input image relevant for the decision of the image classifier from a combination of the binary masks with their respective assessments by the quality function.

A non-transitory machine-readable data medium on which is stored a computer program including machine-readable instructions for measuring components of an input image on which an image classifier bases its decision regarding an assignment of the input image to one or multiple class(es) of a predefined classification, the machine-readable instructions, when executed by one or more computers, causing the one or more computers to perform the following steps:

• providing binary masks which indicate which pixels of the input image and/or of an intermediate product formed in the image classifier, are considered relevant;
• assessing each binary mask of the binary masks using a quality function, which is a measure of an extent to which at least one classification score, supplied by the image classifier, with respect to at least one target class changes when the pixels of the input image or of the intermediate product, which are relevant according to the binary mask, are changed;
• and
• ascertaining sought-after components of the input image relevant for the decision of the image classifier from a combination of the binary masks with their respective assessments by the quality function.

A computer configured to measure components of an input image on which an image classifier bases its decision regarding an assignment of the input image to one or multiple class(es) of a predefined classification, the computer configured to:

• provide binary masks which indicate which pixels of the input image and/or of an intermediate product formed in the image classifier, are considered relevant;
• assess each binary mask of the binary masks using a quality function, which is a measure of an extent to which at least one classification score, supplied by the image classifier, with respect to at least one target class changes when the pixels of the input image or of the intermediate product, which are relevant according to the binary mask, are changed;
• and
• ascertain sought-after components of the input image relevant for the decision of the image classifier from a combination of the binary masks with their respective assessments by the quality function.