Methods and systems for detecting photograph replacement in a photo identity document

A non-transitory computer-readable medium storing one or more instructions executable by a computer system to perform operations for detecting identity document photograph replacement, comprising:

• receiving image data of a cropped photograph region of an identity document (ID), wherein the ID comprises a photograph, and wherein the cropped photograph region comprises at least the photograph;
• predicting, by a multiclass classification model and as a predicted ID category, an ID category based on the image data of the cropped photograph region, wherein the predicted ID category corresponds to a predefined class of a set of predefined classes in the multiclass classification model;
• comparing the predicted ID category with an indicated category of the ID;
• and
• in response to a calculated mismatch between the predicted ID category and the indicated category of the ID, determining that the cropped photograph region includes a replaced photograph.

A computer-implemented system for detecting identity document photograph replacement, comprising:

• one or more computers;
• and
• one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, cause the one or more computers to perform one or more operations comprising:
• receiving image data of a cropped photograph region of an identity document (ID), wherein the ID comprises a photograph, and wherein the cropped photograph region comprises at least the photograph;
• predicting, by a multiclass classification model and as a predicted ID category, an ID category based on the image data of the cropped photograph region, wherein the predicted ID category corresponds to a predefined class of a set of predefined classes in the multiclass classification model;
• comparing the predicted ID category with an indicated category of the ID;
• and
• in response to a calculated mismatch between the predicted ID category and the indicated category of the ID, determining that the cropped photograph region includes a replaced photograph.