US 12,118,294 B2 · Machine learning systems and methods for automatically tagging documents to enable accessibility to impaired individuals

Abstract

Systems, methods, and products for auto tagging structured PDF documents that do not have accessibility tags. In one embodiment, structured PDF documents having accessibility tags are first parsed and analyzed to organize the visual components of the documents. The relationships of the identified objects to DOM elements (e.g., tags) are determined, and the objects and related DOM elements are stored in training files. The training files are used to train various classifiers. Untagged PDF documents are then parsed to identify included visual objects, and the classifiers are used to determine DOM elements that should be associated with visual objects identified in the untagged PDF documents. This information is used to construct a DOM structure corresponding to each untagged document. A new PDF is then generated corresponding to each untagged document using the generated DOM structure and visual object information.

Claims20

Dependent claims

A method comprising:

obtaining a set of tagged pdf documents, each having a corresponding a document object model (DOM) structure;
determining, for each tagged pdf document, relationships between graphical objects in the tagged pdf document and corresponding elements of the DOM structure of the tagged pdf document;
generating, for each tagged pdf document, a corresponding training record identifying the determined relationships;
training, using the training records, a machine learning model to determine DOM structure elements that are associated with graphical objects;
obtaining a set of untagged PDF documents which do not contain corresponding DOM structures;
and
for each untagged PDF document, automatically generating, using the trained machine learning model, a corresponding tagged PDF document having one or more DOM structure elements corresponding to one or more graphical objects contained in the untagged PDF document.

4 more elements

A system comprising:

a processor coupled to a memory that stores one or more instructions, the instructions executable by the processor to perform the method comprising:
obtaining a set of tagged pdf documents, each having a corresponding a document object model (DOM) structure;
determining, for each tagged pdf document, relationships between graphical objects in the tagged pdf document and corresponding elements of the DOM structure of the tagged pdf document;
generating, for each tagged pdf document, a corresponding training record identifying the determined relationships;
training, using the training records, a machine learning model to determine DOM structure elements that are associated with graphical objects;
obtaining a set of untagged PDF documents which do not contain corresponding DOM structures;
and
for each untagged PDF document, automatically generating, using the trained machine learning model, a corresponding tagged PDF document having one or more DOM structure elements corresponding to one or more graphical objects contained in the untagged PDF document.

5 more elements

A computer program product comprising a non-transitory computer-readable medium storing instructions executable by a processor to perform:

obtaining a set of tagged pdf documents, each having a corresponding a document object model (DOM) structure;
determining, for each tagged pdf document, relationships between graphical objects in the tagged pdf document and corresponding elements of the DOM structure of the tagged pdf document;
generating, for each tagged pdf document, a corresponding training record identifying the determined relationships;
training, using the training records, a machine learning model to determine DOM structure elements that are associated with graphical objects;
obtaining a set of untagged PDF documents which do not contain corresponding DOM structures;
and
for each untagged PDF document, automatically generating, using the trained machine learning model, a corresponding tagged PDF document having one or more DOM structure elements corresponding to one or more graphical objects contained in the untagged PDF document.

4 more elements

Dependencies are inferred from the claim text.

Machine learning systems and methods for automatically tagging documents to enable accessibility to impaired individuals

Life of this patent

Machine learning systems and methods for automatically tagging documents to enable accessibility to impaired individuals

Life of this patent

Abstract

Claims20