Template-Based Key-Value Extraction for Inferring OCR Key Values Within Form Images

A non-transitory computer-readable storage medium containing instructions that when executed by a computer processor perform actions comprising:

• obtaining, at one or more processors, a form image originating from a client device;
• identifying, by the one or more processors using a neural network, regions of text within the form image;
• selecting, by the one or more processors, a form template from a database storing a plurality of form templates according to the identified regions of text;
• computing, by the one or more processors, a spatial mapping between the selected form template and the obtained form image;
• computing, by the one or more processors, spatial relationships between key regions and value regions of the selected form template;
• determining, by the one or more processors, for each key of a plurality of keys of the selected form template, using the computed spatial mappings and spatial relationships, an estimated region on the form image for the value corresponding to the key;
• and
• extracting, by the one or more processors, from the estimated regions on the form image based on overlap of the identified text regions and the estimated regions, text corresponding to values of the plurality of keys of the selected form template.