Systems and methods for machine learning based content extraction from document images

A non-transitory computer readable storage medium including instructions that, when executed by a computer processing system, cause the computer processing system to perform operations for recognizing and extracting data from a form depicted within an image of a document, the operations comprising:

• receiving the image of the document, the image depicting the form and data contained one the form, and wherein the form depicted in the image is unstructured;
• transforming the image of the document to a set of one or more key, value pairs by processing the image of the document with a sequence of two or more trained machine learning based image analysis processes, wherein keys are relevant to forms of the type depicted in the image, and wherein each value is associated with a key, wherein the two or more trained machine learning based image analysis processes comprise a plurality of different machine learning based image analysis processes performed within a document processing pipeline;
• and
• generating a data output that comprises the set of key, value pairs for textual data recognized and extracted from the form depicted in the image.

A system, comprising:

• a network interface that receives an image of a document, the image depicting a form and data contained on the form, and wherein the form depicted in the image is unstructured;
• a memory that stores the image of the document;
• and
• a processor coupled with the memory configured to access the image of the document and further configured to:
• transform the image of the document to a set of one or more key, value pairs by processing the image of the document with a sequence of two or more trained machine learning based image analysis processes, wherein keys are relevant to forms of the type depicted in the image, and wherein each value is associated with a key, wherein the two or more trained machine learning based image analysis processes comprise a plurality of different machine learning based image analysis processes performed within a document processing pipeline, and
• generate a data output that comprises the set of key, value pairs for textual data recognized and extracted from the form depicted in the image.