US 2023/0147778 A1 · METHOD AND SYSTEM FOR GENERATING SYNTHETIC DOCUMENTS FOR LAYOUT RECOGNITION AND INFORMATION RETRIEVAL

Abstract

A solution to identify the layout elements in a document is provided. The documents are formulated in an integrated visual space, where they are treated uniformly as a rasterized image. The transformation to image space facilitates exploitation of a spectrum of stylistic cues, such as spacing between the lines and paragraphs. Effective recognition of layout elements is provided by applying a synthetic generator model that creates artificial documents with the required labels and bounding boxes. The generator model is based on a Bayesian Network, offers full flexibility in controlling the document types and labels, and can introduce artificial defects to synthesize low-quality documents. An artificial intelligence model for detecting layouts is trained based on these synthetic documents and the resultant model is used to identify the layout elements in real-world documents. The resulting layout elements, when augmented with the text content, greatly aids in effective information retrieval.

Claims20

Dependent claims

A method for retrieving information from a document, the method being implemented by at least one processor, the method comprising:

generating, by the at least one processor, a first synthetic document and at least a second synthetic document, the first synthetic document including a first plurality of elements and first annotation information that relates to the first plurality of elements, and the second synthetic document including a second plurality of elements and second annotation information that relates to the second plurality of elements;
training, by the at least one processor, a machine learning algorithm that is configured to detect a layout of a real-world document by using each of the first synthetic document, the first annotation information, the second synthetic document, and the second annotation information as inputs;
receiving, by the at least one processor, a first real-world document;
and
generating, by the at least one processor, a modified version of the first real-world document by applying the trained machine learning algorithm to the received first real-world document.

2 more elements

A computing apparatus for retrieving information from a document, the computing apparatus comprising:

a processor;
a memory;
a display;
and
a communication interface coupled to each of the processor, the memory, and the display,
wherein the processor is configured to:
generate a first synthetic document and at least a second synthetic document, the first synthetic document including a first plurality of elements and first annotation information that relates to the first plurality of elements, and the second synthetic document including a second plurality of elements and second annotation information that relates to the second plurality of elements;
train a machine learning algorithm that is configured to detect a layout of a real-world document by using each of the first synthetic document, the first annotation information, the second synthetic document, and the second annotation information as inputs;
receive, via the communication interface, a first real-world document;
and
generate a modified version of the first real-world document by applying the trained machine learning algorithm to the received first real-world document.

8 more elements

Dependencies are inferred from the claim text.

Method and system for generating synthetic documents for layout recognition and information retrieval

Life of this patent

Method and system for generating synthetic documents for layout recognition and information retrieval

Life of this patent

Abstract

Claims20