Back to results
US 2019/0197334 A1Published application
Optical character recognition of series of images
AssigneeABBYY Development LLC
InventorAleksey Ivanovich Kalyuzhny
Life of this patent
Estimating the term…
Abstract
Systems and methods for performing OCR of a series of images depicting text symbols. An example method comprises performing OCR a series of images to produce symbol sequences and corresponding symbol sequence quadrangles; identifying median string; calculating transformation of the symbol sequence quadrangles into a common coordinate system; determining distances between the transformed symbol sequence quadrangles; identifying a median symbol sequence quadrangle; displaying, using the median symbol sequence quadrangle, a resulting OCR text representing at least a portion of the original document.
Claims20
A method, comprising:
- receiving, by a processing device, a current image of a series of images of an original document, wherein the current image at least partially overlaps with a previous image of the series of images;
- performing optical symbol recognition (OCR) of the current image to produce a current symbol sequence and a corresponding text layout,
- wherein the text layout of the current image comprises coordinates of a current symbol sequence quadrangle containing the symbol sequence in the current image;
- associating, using a coordinate transformation, the current symbol sequence with a first cluster of a plurality of clusters of previous symbol sequences, wherein each previous symbol sequence in the first cluster is produced by processing one of the previously received images of the series of images, wherein each of the previously received images has a corresponding previous image text layout comprising coordinates of a previous symbol sequence quadrangle containing the previous symbol sequence;
- merging the symbol sequences from the first cluster by identifying a first median string representing the first cluster of symbol sequences based on a first subset of images of the series of images, wherein the first median string is a resulting OCR text representing at least a portion of the original document;
- calculating transformations of the previous symbol sequence quadrangles to the current image to produce transformed previous symbol sequence quadrangles;
- determining distances between the transformed previous symbol sequence quadrangles and the current symbol sequence quadrangle;
- identifying a median symbol sequence quadrangle for the previous symbol sequence quadrangles and the current symbol sequence quadrangle based on the distances between the transformed previous symbol sequence quadrangles and the current symbol sequence quadrangle;
- displaying, using the median symbol sequence quadrangle, a resulting OCR text representing at least a portion of the original document.
6 more elements
A system, comprising:
- a memory;
- a processing device, coupled to the memory, the processing device configured to:
- receive, by a processing device, a current image of a series of images of an original document, wherein the current image at least partially overlaps with a previous image of the series of images;
- perform optical symbol recognition (OCR) of the current image to produce a current symbol sequence and a corresponding text layout,
- wherein the text layout of the current image comprises coordinates of a current symbol sequence quadrangle containing the symbol sequence in the current image;
- associate, using a coordinate transformation, the current symbol sequence with a first cluster of a plurality of clusters of previous symbol sequences, wherein each previous symbol sequence in the first cluster is produced by processing one of the previously received images of the series of images, wherein each of the previously received images has a corresponding previous image text layout comprising coordinates of a previous symbol sequence quadrangle containing the previous symbol sequence;
- merge the symbol sequences from the first cluster by identifying a first median string representing the first cluster of symbol sequences based on a first subset of images of the series of images, wherein the first median string is a resulting OCR text representing at least a portion of the original document;
- calculate transformations of the previous symbol sequence quadrangles to the current image to produce transformed previous symbol sequence quadrangles;
- determine distances between the transformed previous symbol sequence quadrangles and the current symbol sequence quadrangle;
- identify a median symbol sequence quadrangle for the previous symbol sequence quadrangles and the current symbol sequence quadrangle based on the distances between the transformed previous symbol sequence quadrangles and the current symbol sequence quadrangle;
- display, using the median symbol sequence quadrangle, a resulting OCR text representing at least a portion of the original document.
8 more elements
A computer-readable non-transitory storage medium comprising executable instructions that, when executed by a processing device, cause the processing device to:
- receive, by a processing device, a current image of a series of images of an original document, wherein the current image at least partially overlaps with a previous image of the series of images;
- perform optical symbol recognition (OCR) of the current image to produce a current symbol sequence and a corresponding text layout,
- wherein the text layout of the current image comprises coordinates of a current symbol sequence quadrangle containing the symbol sequence in the current image;
- associate, using a coordinate transformation, the current symbol sequence with a first cluster of a plurality of clusters of previous symbol sequences, wherein each previous symbol sequence in the first cluster is produced by processing one of the previously received images of the series of images, wherein each of the previously received images has a corresponding previous image text layout comprising coordinates of a previous symbol sequence quadrangle containing the previous symbol sequence;
- merge the symbol sequences from the first cluster by identifying a first median string representing the first cluster of symbol sequences based on a first subset of images of the series of images, wherein the first median string is a resulting OCR text representing at least a portion of the original document;
- calculate transformations of the previous symbol sequence quadrangles to the current image to produce transformed previous symbol sequence quadrangles;
- determine distances between the transformed previous symbol sequence quadrangles and the current symbol sequence quadrangle;
- identify a median symbol sequence quadrangle for the previous symbol sequence quadrangles and the current symbol sequence quadrangle based on the distances between the transformed previous symbol sequence quadrangles and the current symbol sequence quadrangle;
- display, using the median symbol sequence quadrangle, a resulting OCR text representing at least a portion of the original document.
6 more elements
Dependencies are inferred from the claim text.