Back to results
US 2023/0147276 A1Published application
System and method for determining a structured representation of a form document utilizing multiple machine learning models
AssigneeIntuit Inc.
InventorsStephanie BROYLES, Andrew Van CAO, Stephen A. EUBANKS, William R. GEORGEN, Karpaga Ganesh PATCHIRAJAN
Life of this patent
Estimating the term…
Abstract
Systems and methods may be used to generate and use a structured form representation and structured metadata. The structured form representation and structured metadata may include information relevant to a particular context and may be used to update document templates, import new documents and update document versions into software, automate data entry for document completion, update records to include new and or updated information, and provide other functionality of an information service.
Claims20
A computer implemented method for providing and using structured metadata, the method comprising:
- acquiring, by a computer, from a document in a digital format, a plurality of document elements and a plurality of attributes describing the plurality of document elements, wherein at least one of the document elements is a field that receives data;
- detecting, by the computer a plurality of form components using the plurality of attributes wherein each form component corresponds to a document element included in the plurality of document elements;
- determining, by the computer a relevance to a particular context for the document element corresponding to each form component in the plurality of form components by applying a first machine learning model to the attributes of the plurality of document elements;
- acquiring, by the computer, for the document element corresponding to each form component, an accuracy label for the relevance to the particular context determined by the first machine learning model, wherein the accuracy label indicates whether the document element is relevant to the particular context;
- generating, by the computer, training data that includes the document element corresponding to each form component and the accuracy label for the document element, wherein the document element is represented as vectors indicating one or more location of the document element, type of the document element, type of data associated with the document element, and statistical data of how frequently a field associated with the document element was left blank;
- retraining, by the computer, the first machine learning model using the training data;
- re-determining, by the computer, the relevance to the particular context of the document element using the first machine learning model retrained on the training data;
- clustering, by the computer the plurality of form components into a structured form representation based on the relevance to the particular context of the document element corresponding to each form component;
- using, by the computer, the structured form representation to acquire, by the computer, from a reference document including the plurality of document elements, metadata input into the field and a plurality of attributes describing the metadata;
- clustering, by the computer, a plurality of metadata components corresponding to the metadata into structured metadata by applying a second machine learning model to the plurality of attributes describing the metadata;
- and
- distributing, by the computer at least one of the structured form representation and the structured metadata to a server.
9 more elements
A system comprising:
- a memory coupled to a computer processor;
- a repository configured to store:
- a document in a digital format comprising a plurality of document elements and a plurality of attributes describing the plurality of document elements, wherein at least one of the document elements is a field that receives data;
- a reference document including the plurality of document elements, metadata input into the field, and a plurality of attributes describing the metadata;
- a structured form representation comprising a plurality of form components;
- structured metadata comprising a plurality of metadata components;
- a first machine learning model;
- and
- a second machine learning model;
- and
- an information transfer engine, executing on the computer processor and using the memory, configured to:
- acquire, from the document, the plurality of document elements and the plurality of attributes describing the plurality of document elements;
- detect the plurality of form components using the plurality of attributes wherein each form component corresponds to a document element included in the plurality of document elements;
- determine a relevance to a particular context for the document element corresponding to each form component in the plurality of form components by applying the first machine learning model to the plurality of attributes describing the plurality of document elements;
- acquire for the document element corresponding to each form component, an accuracy label for the relevance to the particular context determined by the first machine learning model, wherein the accuracy label indicates whether the document element is relevant to the particular;
- generate training data that includes the document element corresponding to each form component and the accuracy label for the document element, wherein the document element is represented as vectors indicating one or more location of the document element, type of the document element, type of data associated with the document element, and statistical data of how frequently a field associated with the document element was left blank;
- retrain the first machine learning model using the training data;
- re-determine the relevance to the particular context of the document element using the first machine learning model retrained on the training data;
- cluster the plurality of form components into the structured form representation based on the relevance to the particular context of the document element corresponding to each form component;
- using the structured form representation, acquire, from the reference document, the metadata input into the field and the plurality of attributes describing the metadata;
- cluster a plurality of metadata components corresponding to the metadata into the structured metadata by applying the second machine learning model to the plurality of attributes describing the metadata;
- and
- distribute at least one of the structured form representation and the structured metadata to a server.
20 more elements
Dependencies are inferred from the claim text.