User interface for contextual document recognition

One or more non-transitory computer-readable media storing computer-executable instructions for a method of presenting a user interface for verifying automatically recognized information that, when executed:

• receive a form image of a form, the form including plurality of values and a corresponding plurality of labels for the plurality of values;
• identifying a plurality of regions of the form image corresponding to the plurality of values,
• wherein each region of the form image contains an image of a value and a label corresponding to the region;
• for each of the plurality of regions, perform automatic recognition of the value and the label for the region to obtain an automatically recognized value for the region and an automatically recognized label for the region;
• determining if the automatically recognized value is correct or incorrect based on a comparison of the automatically recognized value for the region with the form image after automatic recognition;
• determining a needed value based on the comparison;
• identify a region of the plurality of regions of the form image corresponding to the needed value, and
• presenting a user interface to the user comprising:
• the plurality of regions of the form image;
• the identified region of the form image corresponding to the needed value,
• wherein the identified region is automatically magnified prior to input by the user;
• an automatically recognized value for the identified region;
• an automatically recognized label for the identified region;
• a first control allowing the user to accept the automatically recognized value and an automatically recognized label.

A system comprising:

• a user interface comprising:
• an identified region of a form image corresponding to a needed value;
• an automatically recognized value for the identified region;
• a first control allowing a user to accept the automatically recognized value,
• wherein a plurality of regions of the form image that do not correspond to a needed value are not presented via the user interface;
• and
• one or more non-transitory computer-readable media storing computer-executable instructions that, when executed perform a method of presenting a user interface for verifying automatically recognized information, the method comprising the steps of:
• identifying the plurality of regions of the form image of a form, wherein the form includes a plurality of values, and wherein each region of the plurality of regions corresponds to a value of the plurality of values;
• performing automatic recognition of the plurality of regions of the form image to obtain automatically recognized values;
• determining if the automatically recognized values are correct or incorrect based on a comparison of the automatically recognized values for each region with the form image after automatic recognition;
• determining the needed value based on the comparison of the form image and the automatically recognized plurality of regions;
• identifying a region of the plurality of regions of the form image corresponding to the needed value.