Automatic document generation and segmentation system
AssigneeRedShred LLC
InventorsJames M. Kukla, Maryam Esmaeilkhanian
Life of this patent
Estimating the term…
Abstract
Methods and systems are provided for generating a corpus of documents from an original document or document corpus. Original documents are processed to extract document layout and elements. Elements are clustered and processed by neural networks, such as GANs, to generate additional elements that are then combined with the extracted layout to produce new documents, such as for training automated document processing systems.
Claims14
A method of generating a document corpus, the method comprising:
- receiving an original document, wherein the original document is a restricted-access document having security requirements that restrict access to the original document;
- separating the original document into a plurality of pages;
- for a first page of the plurality of pages, performing a first sub-process comprising:
- converting the first page to an image;
- determining a layout of the first page, the layout indicating a location of a first element of the first page;
- assigning an element type to the first element;
- and
- based upon the element type, assigning the first element to an element cluster;
- based upon the element cluster, generating a plurality of generated elements of the same type as the first element;
- based upon the layout and the plurality of generated elements, generating a plurality of generated documents that include the generated elements, wherein the plurality of generated documents are not restricted-access documents and wherein no generated document duplicates the entirety of the original document;
- and
- training a machine learning system based upon the plurality of generated documents.
A system for generating a document corpus, the system comprising:
- a computer-readable data storage storing a plurality of documents;
- and
- a computer processor configured to:
- obtain an original document from the plurality of documents, wherein the original document is a restricted-access document having security requirements that restrict access to the original document;
- separate the original document into a plurality of pages;
- for a first page of the plurality of pages, perform a first sub-process comprising:
- converting the first page to an image;
- determining a layout of the first page, the layout indicating a location of a first element of the first page;
- assigning an element type to the first element;
- and
- based upon the element type, assigning the first element to an element cluster;
- based upon the element cluster, generate a plurality of generated elements of the same type as the first element;
- based upon the layout and the plurality of generated elements, generate a plurality of generated documents that include the generated elements, wherein the plurality of generated documents are not restricted-access documents and no generated document duplicates the entirety of the original document;
- and
- training a machine learning system based upon the plurality of generated documents.
A non-transitory computer-readable medium storing a plurality of instructions which, when executed by a computer processor, cause the processor to perform a method comprising:
- receiving an original document, wherein the original document is a restricted-access document having security requirements that restrict access to the original document;
- separating the original document into a plurality of pages;
- for a first page of the plurality of pages, performing a first sub-process comprising:
- converting the first page to an image;
- determining a layout of the first page, the layout indicating a location of a first element of the first page;
- assigning an element type to the first element;
- and
- based upon the element type, assigning the first element to an element cluster;
- based upon the element cluster, generating a plurality of generated elements of the same type as the first element;
- based upon the layout and the plurality of generated elements, generating a plurality of generated documents that include the generated elements, wherein the plurality of generated documents are not restricted-access documents and wherein no generated document duplicates the entirety of the original document;
- and
- training a machine learning system based upon the plurality of generated documents.
Dependencies are inferred from the claim text.