Method and system of performing domain-based error correction after optical character recognition

A system of performing domain-based optical character recognition (OCR) error correction, the system comprising:

• a processor;
• and
• a memory communicably coupled to the processor, wherein the memory stores processor-executable instructions, which, on execution by the processor, cause the processor to:
• receive at least one document image,
• wherein the at least one document image comprises data corresponding to at least one domain;
• determine one or more text entities in the data using an Optical Character Recognition (OCR) technique,
• wherein the one or more text entities are determined based on recognition of each character of each of the one or more text entities;
• for each of the one or more text entities:
• determine a character embedding indicative of each character recognized in a corresponding text entity;
• determine a style embedding indicative of one or more text-characteristic information of each character recognized in the corresponding text entity;
• determine a layout embedding of each of the one or more text entities indicative of a layout hierarchy information of each of the one or more text entities in the at least one document image;
• determine a concatenated embedding of each of the one or more text entities based on the corresponding character embedding, style embedding and document layout embedding of each of the one or more text entities;
• and
• for each of the one or more text entities:
• determine a corrected character embedding of each character recognized in the corresponding text entity based on the corresponding concatenated embedding using an encoder-decoder model,
• wherein the encoder-decoder model is trained to recognize data corresponding to the at least one domain.

A non-transitory computer-readable medium storing computer-executable instructions for performing domain-based optical character recognition (OCR) error correction, the computer-executable instructions configured for:

• receiving at least one document image,
• wherein the at least one document image comprises data corresponding to at least one domain;
• determining one or more text entities in the data using an Optical Character Recognition (OCR) technique,
• wherein the one or more text entities are determined based on recognition of each character of each of the one or more text entities;
• for each of the one or more text entities:
• determining a character embedding indicative of each character recognized in a corresponding text entity;
• determining a style embedding indicative of one or more text-characteristic information of each character recognized in the corresponding text entity;
• determining a layout embedding of each of the one or more text entities indicative of a layout hierarchy information of each of the one or more text entities in the at least one document image;
• determining a concatenated embedding of each of the one or more text entities based on the corresponding character embedding, the style embedding and the document layout embedding of each of the one or more text entities;
• and
• for each of the one or more text entities:
• determining a corrected character embedding of each character recognized in the corresponding text entity based on the corresponding concatenated embedding using an encoder-decoder model,
• wherein the encoder-decoder model is trained to recognize data corresponding to the at least one domain.