Systems and Methods for Extracting Information from a Physical Document

A computing system, the system comprising:

• one or more processors;
• and
• a computer-readable medium having instructions stored thereon that, when executed by the one or more processors, cause the system to perform operations, the operations comprising:
• obtaining, by the computing system, data representing one or more units of text extracted from an image of a document;
• determining, by the computing system, one or more annotated values from the one or more units of text;
• determining, by the computing system, a label for each annotated value of the one or more annotated values, wherein the label for each annotated value comprises a key that explains the annotated value, and wherein determining, by the computing system, the label for each annotated value comprises performing, by the computing system for each annotated value, a search for the label among the one or more units of text based at least in part on a location of the annotated value within the document;
• and
• mapping, by the computing system, at least one annotated value from the one or more annotated values to an action that is presented to a user based at least in part on the label associated with the at least one annotated value.

A computer-readable medium having instructions stored thereon that, when executed by one or more processors of a computing system, cause the computing system to perform operations, the operations comprising:

• obtaining by the computing system, data representing one or more units of text extracted from an image of a document;
• determining, by the computing system, one or more annotated values from the one or more units of text;
• determining, by the computing system, a label for each annotated value of the one or more annotated values, wherein the label for each annotated value comprises a key that explains the annotated value, and wherein determining, by the computing system, the label for each annotated value comprises performing, by the computing system for each annotated value a search for the label among the one or more units of text based at least in part on a location of the annotated value within the document;
• and
• mapping, by the computing system, at least one annotated value from the one or more annotated values to an action that is presented to a user based at least in part on the label associated with the at least one annotated value.