Back to results
US 12,626,527 B2Granted
Automatic document template inference, generation, and refinement
AssigneeSage Global Services Limited
InventorsGal Isaac Lellouche, Saed Hussain, Ernest Ho Hin Chow, Alexander Millar
Life of this patent
Estimating the term…
Abstract
Various embodiments offer improved functionality for generating and/or refining templates that can be used for automatically extracting information from within an invoice or other document, based on geometric characteristics of the document. An initial template may be automatically generated, and such initial template may then be refined over time based on user feedback, so as to improve reliability and accuracy in information extraction.
Claims27
A computer-implemented method for extracting information from a document, comprising:
- at a hardware processing device, receiving a document;
- at the hardware processing device, automatically extracting image data from the received document;
- at the hardware processing device, automatically determining a source of the received document;
- at the hardware processing device, automatically determining whether a template exists for the determined source in a data storage device;
- responsive to a template not existing for the determined source:
- at the hardware processing device, automatically extracting information from the image data representing the received document;
- based on the extracted information, at the hardware processing device, automatically creating a template for the determined source;
- and
- storing the created template in the data storage device;
- responsive to a template existing for the determined source, automatically retrieving the template from the data storage device;
- based on the template for the determined source, at the hardware processing device, automatically extracting information from the image data representing the received document;
- at the hardware processing device, receiving feedback from at least one user specifying data expected to be found within the received document;
- at the hardware processing device, automatically assigning a confidence metric to the received feedback;
- at the hardware processing device, automatically identifying at least a subset of the feedback as having a confidence metric indicating that the subset is trustworthy;
- at the hardware processing device, comparing the identified subset of the received feedback with the extracted information;
- at the hardware processing device, automatically refining the template based on the results of the comparison;
- and
- outputting the extracted information on an output device.
15 more elements
A non-transitory computer-readable medium for extracting information from a document, comprising instructions stored thereon, that when performed by a hardware processor, perform the steps of:
- receiving a document;
- automatically extracting image data from the received document;
- automatically determining a source of the document;
- automatically determining whether a template exists for the determined source in a data storage device;
- responsive to a template not existing for the determined source:
- automatically extracting information from the image data representing the received document;
- based on the extracted information, automatically creating a template for the determined source;
- and
- causing the created template to be stored in the data storage device;
- responsive to a template existing for the determined source, automatically retrieving the template from the data storage device;
- based on the template for the determined source, automatically extracting information from the image data representing the received document;
- receiving feedback from at least one user specifying data expected to be found within the received document;
- automatically assigning a confidence metric to the received feedback;
- automatically identifying at least a subset of the feedback as having a confidence metric indicating that the subset is trustworthy;
- comparing the identified subset of the received feedback with the extracted information;
- automatically refining the template based on the results of the comparison;
- and
- causing the extracted information to be output on an output device.
15 more elements
A system for extracting information from a document, comprising:
- a data storage device;
- an output device;
- a hardware processing device, communicatively coupled to the data storage device and the output device, configured to:
- receive a document;
- automatically extract image data from the received document;
- automatically determine a source of the document;
- automatically determine whether a template exists for the determined source in the data storage device;
- responsive to a template not existing for the determined source:
- automatically extract information from the image data representing the received document;
- based on the extracted information, automatically create a template for the determined source;
- and
- cause the created template to be stored in the data storage device;
- responsive to a template existing for the determined source, automatically retrieve the template from the data storage device;
- and
- based on the template for the determined source, automatically extract information from the image data representing the received document;
- and an input device, communicatively coupled to the hardware processing device, configured to receive feedback from at least one user specifying data expected to be found within the received document;
- automatically assign a confidence metric to the received feedback;
- wherein:
- the hardware processing device is further configured to:
- automatically identify at least a subset of the feedback as having a confidence metric indicating that the subset is trustworthy;
- compare the identified subset of the received feedback with the extracted information;
- and
- automatically refine the template based on the results of the comparison;
- and
- the output device is configured to output the extracted information.
22 more elements
Dependencies are inferred from the claim text.