Finding low variance regions in document images for generating image anchor templates for content anchoring, data extraction, and document classification
AssigneesPalo Alto Research Center Incorporated, Xerox Corporation
InventorsEric Saund, Prateek Sarkar, Alejandro E. Brito, Marshall W. Bern, Francois Ragnet
Life of this patent
Estimating the term…
Abstract
Methods of generating image anchor templates from low variance regions of document images of a first class are provided. The methods select a document image from the document images of the first class and align the other document images of the first class to the selected document image. Low variance regions are then determined by comparing the aligned document images and the selected document image and used to generate image anchor templates.
Claims16
A method of generating image anchor templates from low variance regions of document images of a first class, wherein the document images of the first class is a collection of document images of a same type, said method comprising:
- selecting a document image from the document images of the first class;
- aligning the other document images of the first class to the selected document image, the aligning comprising:
- selecting a plurality of sub-regions from each of the other document images;
- determining a best match in the selected document for each of the selected sub-regions of the each of the other document images;
- determining a transformation for the each of the other document images using a least squares analysis to minimize the difference between the best matches of the selected sub-regions of the each of the other document images and the selected sub-regions of the each of the other document images;
- and
- transforming the each of the other document images according to the determined transformation of the each of the other document images;
- determining the low variance regions by comparing the aligned document images and the selected document image, wherein the low variance regions are those regions that vary little between the selected document image and other document images;
- and
- generating image anchor templates from the determined low variance regions, wherein the method is performed using at least one digital processor.
A method of generating image anchor templates from low variance regions of document images of a first class, wherein the document images of the first class is a collection of document images of a same type, said method comprising:
- electing a document image from the document images of the first class;
- aligning the other document images of the first class to the selected document image, the aligning comprising:
- defining each of the other document images as an ensemble of blocks, wherein each of the blocks of the ensemble of blocks of the each of the other document images includes neighbors;
- determining a best match in the selected document image for the each of the blocks of the ensemble of blocks of the each of the other document images, wherein the best match of the each of the blocks of the ensemble of blocks of the each of the other document images includes a match score;
- determining a translation vector for the each of the blocks of the ensemble of blocks of the each of the other document images;
- and
- shifting the each of the blocks of the ensemble of blocks of the each of the other document images by the translation vector of the each of the blocks of the ensemble of blocks of the each of the other document images to define aligned documents;
- determining the low variance regions by comparing the aligned document images and the selected document image, wherein the low variance regions are those regions that vary little between the selected document image and other document images;
- and
- generating image anchor templates from the determined low variance regions, wherein the method is performed using at least one digital processor.
A method of generating image anchor templates from low variance regions of document images of a first class, said method comprising:
- selecting a document image from the document images of the first class, wherein the document images of the first class is a collection of document images of a same type;
- aligning the other document images of the first class to the selected document image;
- determining the low variance regions by comparing the aligned document images and the selected document image;
- and
- generating image anchor templates from the determined low variance regions, wherein the generated image anchor templates (i) facilitate discrimination between the document mages of the first class and document images of other classes, or (ii) facilitate data extraction from a data field of the document images of the first class, the generating image anchor templates comprising:
- generating one or more candidate image anchor templates using one or more seed image anchor templates and/or at least one of the low variance regions;
- determining a quality score for each of the one or more candidate image anchor templates and (i) the document images of the first class, or (ii) known locations of the data field within the document image;
- ranking the one or more candidate image anchor templates according to quality score;
- and
- selecting one or more of the most highly ranked image anchor templates;
- wherein the method is performed using at least one digital processor.
A method of generating image anchor templates from a clean document image generated from document images of a first class, wherein the document images of the first class is a collection of document images of a same type, wherein the document images of the first class is a collection of document images of a same type, said method comprising:
- selecting a document image from the document images of the first class;
- aligning the other document images of the first class to the selected document image;
- generating the clean document image by combining the aligned document images and the selected document image;
- identifying large salient structures in the clean document image;
- and
- generating image anchor templates from the clean document image, wherein the image anchor templates are generated from the identified salient structures and wherein the method is performed using at least one digital processor.
A system carried on a computer readable medium, of generating image anchor templates from low variance regions of document images of a first class, wherein the document images of the first class is a collection of document images of a same type, said system comprising:
- a selection module that selects a document image from the document images of the first class;
- an alignment module that aligns the other document images of the class to the selected document image, the alignment module comprising:
- a sub-region selection module that selects a plurality of sub-regions from each of the other document images;
- a match module that determines a best match in the selected document for each of the selected sub-regions of the each of the other document images;
- an analysis module that determines a transformation for the each of the other document images using a least squares analysis to minimize the difference between the best matches of the selected sub-regions of the each of the other document images and the selected sub-regions of the each of the other document images;
- and
- a transformation module that transform the each of the other document images according to the determined transformation of the each of the other document images;
- a variance module that determines the low variance regions by comparing the aligned document images and the selected document image, wherein the low variance regions are those regions that vary little between the selected document image and other document images;
- and
- an image anchor template module that generates image anchor templates from the determined low variance regions.
A system carried on a computer readable medium, of generating image anchor templates from low variance regions of document images of a first class, wherein the document images of the first class is a collection of document images of a same type, wherein the document images of the first class is a collection of document images of a same type, said system comprising:
- a selection module that selects a document image from the document images of the first class;
- an alignment module that aligns the other document images of the first class to the selected document image, the alignment module comprising:
- a partition module that defines each of the other document images as an ensemble of blocks, wherein each of the blocks of the ensemble of blocks of the each of the other document images includes neighbors;
- a search module that determines a best match in the selected document image for the each of the blocks of the ensemble of blocks of the each of the other document images, wherein the best match of the each of the blocks of the ensemble of blocks of the each of the other document images includes a match score;
- a displacement computing module that determines a translation vector for the each of the blocks of the ensemble of blocks of the each of the other document images;
- and
- a translation module that shifts the each of the blocks of the ensemble of blocks of the each of the other document images by the translation vector to define aligned documents;
- a variance module that determines the low variance regions by comparing the aligned document images and the selected document image, wherein the low variance regions are those regions that vary little between the selected document image and other document images;
- and
- an image anchor template module that generates image anchor templates from the determined low variance regions.
Dependencies are inferred from the claim text.