US 2018/0005082 A1 · SYSTEMS AND METHODS FOR RECOGNIZING CHARACTERS IN DIGITIZED DOCUMENTS

Abstract

Methods and systems are provided for end-to-end text recognition in digitized documents of handwritten characters over multiple lines without explicit line segmentation. An image is received. Based on the image, one or more feature maps are determined. Each of the one or more feature maps include one or more feature vectors. Based at least in part on the one or more feature maps, one or more scalar scores are determined. Based on the one or more scalar scores, one or more attention weights are determined. By applying the one or more attention weights to each of the one or more feature vectors, one or more image summary vectors are determined. Based at least in part on the one or more image summary vectors, one or more handwritten characters are determined.

Claims20

Dependent claims

A method of recognizing a plurality of handwritten characters over multiple lines, the method comprising:

receiving an image of a document including a plurality of handwritten characters;
determining, based at least in part on the image, a plurality of feature maps, each of which includes a plurality of feature vectors corresponding to the respective plurality of handwritten characters;
determining, based at least in part on the plurality of feature maps, a plurality of scalar scores;
determining, based on the plurality of scalar scores, a plurality of attention weights;
determining, by applying the plurality of attention weights to each of the plurality of feature vectors, a plurality of image summary vectors;
and
recognizing, based at least in part on the plurality of image summary vectors, the plurality of handwritten characters.

4 more elements

A system for recognizing a plurality of handwritten characters over multiple lines, the system comprising:

an image capturing device configured to capture an image of a document including a plurality of handwritten characters;
at least one processor and at least one memory coupled to the at least one processor, the at least one memory having instructions stored thereon, which, when executed by the at least one processor, cause the processor to:
receive the image of the document including the plurality of handwritten characters;
determine, based at least in part on the image, a plurality of feature maps, each of which includes a plurality of feature vectors corresponding to the respective plurality of handwritten characters;
determine, based at least in part on the plurality of feature maps, a plurality of scalar scores;
determine, based on the plurality of scalar scores, a plurality of attention weights;
determine, by applying the plurality of attention weights to each of the plurality of feature vectors, a plurality of image summary vectors;
and
recognize, based at least in part on the plurality of image summary vectors, the plurality of handwritten characters;
and
a display device configured to display the plurality of recognized handwritten characters.

8 more elements

Dependencies are inferred from the claim text.

Systems and methods for recognizing characters in digitized documents

Life of this patent

Systems and methods for recognizing characters in digitized documents

Life of this patent

Abstract

Claims20