Method and system for preprocessing digital documents for data extraction

A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for performing preprocessing of documents for data extraction, the method comprising:

• identifying a document type prediction model generation event;
• in response to identifying the document type prediction model generation event:
• obtaining training documents associated with the document type prediction model generation event;
• performing data preparation on the training documents to generate updated training documents, wherein the updated training documents comprise augmented training documents and new training documents, wherein:
• generating the augmented training documents comprises performing blurring, rotating, flipping, adding noise to, or shape shifting to the training documents, and
• generating the new training documents comprises using linear interpolations of training document image tensors between at least two different document image tensor representations of corresponding ones of the training documents;
• generating the document type prediction model using the updated training documents;
• after the generating, obtaining a document preprocessing request;
• in response to obtaining a document preprocessing request:
• obtaining a document associated with the document preprocessing request;
• performing data preparation on the document to generate an updated document;
• generating a document type prediction using the updated document and a document type prediction model;
• identifying a data extraction service of a plurality of data extraction services associated with the document type prediction;
• and
• initiating further processing of the document to perform data extraction using the identified data extraction service.

A system for performing data extraction for documents comprises:

• a plurality of clients;
• and
• a document preprocessing engine configured to:
• identify a document type prediction model generation event;
• in response to identifying the document type prediction model generation event:
• obtain training documents associated with the document type prediction model generation event;
• perform data preparation on the training documents to generate updated training documents, wherein the updated training documents comprise augmented training documents and new training documents, wherein:
• generating the augmented training documents comprises performing blurring, rotating, flipping, adding noise to, or shape shifting to the training documents, and
• generating the new training documents comprises using linear interpolations of training document image tensors between at least two different document image tensor representations of corresponding ones of the training documents;
• generate the document type prediction model using the updated training documents;
• after the generating, obtain a document preprocessing request from a client of the plurality of clients;
• in response to obtaining a document preprocessing request:
• obtain a document associated with the document preprocessing request;
• perform data preparation on the document to generate an updated document;
• generate a document type prediction using the updated document and a document type prediction model;
• identify a data extraction service of a plurality of data extraction services associated with the document type prediction;
• and
• initiate further processing of the document to perform data extraction using the identified data extraction service.