System and method for automatically understanding lines of compliance forms through natural language patterns
AssigneeIntuit Inc.
InventorsSaikat Mukherjee, Karpaga Ganesh Patchirajan
Life of this patent
Estimating the term…
Abstract
A method and system parses natural language in a unique way, determining important words pertaining to a text corpus of a particular genre, such as tax preparation. Sentences extracted from instructions or forms pertaining to tax preparation, for example are parsed to determine word groups forming various parts of speech, and then are processed to exclude words on an exclusion list and word groups that don't meet predetermined criteria. From the resulting data, synonyms are replaced with a common functional operator and the resulting sentence text is analyzed against predetermined patterns to determine one or more functions to be used in a document preparation system.
Claims24
A computing system implemented method for learning and incorporating forms in an electronic document preparation system, the method comprising:
- receiving electronic textual data relating to a plurality of forms for which one or more functions need to be determined, the electronic textual data including at least a portion of electronic textual data including instructions to determine one or more form field values of one or more forms of the plurality of forms;
- analyzing the electronic textual data to determine sentence data representing a plurality of separate sentences of the electronic textual data;
- separating the electronic textual data into a data array formed of the sentence data of the determined plurality of separate sentences;
- for each given sentence of sentence data representing sentences in the data array:
- extracting operand data of the sentence data of the given sentence, the extracted operand data representing one or more extracted operands of the given sentence, the extracted operands representing one or more dependencies reflecting that a function to determine a data value of the given sentence depends on a data value of a different sentence of the determined plurality of separate sentences;
- determining sentence fragment data for parts of speech for sentence fragments of the given sentence, a sentence fragment including sentence fragment data representing word groups forming one or more parts of speech of the given sentence, resulting in determined sentence fragment data;
- separating sentence fragment data of the given sentence containing verbs and sentence fragment data containing “if” or “minus” where the associated part of speech is either a prepositional phrase or a clause introduced by a subordinating conjunction, resulting in separated sentence fragment data;
- for each token present in sentence data:
- processing the sentence data to remove any word present in exclusion data representing a predetermined exclusion list;
- filtering the sentence data to keep only tokens meeting at least one of a plurality of token tests, resulting in filtered token data;
- combine the filtered token data and the separated sentence fragment data, resulting in combined sentence fragment data:
- filtering the combined sentence fragment data to eliminate sentence fragments containing words from the exclusion data representing a predetermined exclusion list, resulting in filtered sentence fragment data;
- replacing, within sentences of the data array, all single-word sentence fragments of the filtered sentence fragment data having similar meanings with a single word;
- extract text-readable functions from sentences of the data array by matching predetermined patterns and replacing matched patterns with function data representing text-readable functions;
- converting the function data to computer readable functions;
- and
- implementing one or more of the computer readable functions in a document preparation system.
A computing system implemented system for learning and incorporating forms in an electronic document preparation system comprising:
- one or more computing processors;
- one or more memories coupled to the one or more computing processors, the one or more memories having stored therein which when executed by the one or more computing processors perform a process for learning and incorporating forms in an electronic document preparation system comprising:
- receiving electronic textual data relating to a plurality of forms for which one or more functions need to be determined, the electronic textual data including at least a portion of electronic textual data including instructions to determine one or more form field values of one or more forms of the plurality of forms;
- analyzing the electronic textual data to determine sentence data representing a plurality of separate sentences of the electronic textual data;
- separating the electronic textual data into a data array formed of the sentence data of the determined plurality of separate sentences;
- for each given sentence of sentence data representing sentences in the data array:
- extracting operand data of the sentence data of the given sentence, the extracted operand data representing one or more extracted operands of the given sentence, the extracted operands representing one or more dependencies reflecting that a function to determine a data value of the given sentence depends on a data value of a different sentence of the determined plurality of separate sentences;
- determining sentence fragment data for parts of speech for sentence fragments of the given sentence, a sentence fragment including sentence fragment data representing word groups forming one or more parts of speech of the given sentence, resulting in determined sentence fragment data;
- separating sentence fragment data of the given sentence containing verbs and sentence fragment data containing “if” or “minus” where the associated part of speech is either a prepositional phrase or a clause introduced by a subordinating conjunction, resulting in separated sentence fragment data;
- for each token present in sentence data:
- processing the sentence data to remove any word present in exclusion data representing a predetermined exclusion list;
- filtering the sentence data to keep only tokens meeting at least one of a plurality of token tests, resulting in filtered token data;
- combine the filtered token data and the separated sentence fragment data, resulting in combined sentence fragment data:
- filtering the combined sentence fragment data to eliminate sentence fragments containing words from the exclusion data representing a predetermined exclusion list, resulting in filtered sentence fragment data;
- replacing, within sentences of the data array, all single-word sentence fragments of the filtered sentence fragment data having similar meanings with a single word;
- extract text-readable functions from sentences of the data array by matching predetermined patterns and replacing matched patterns with function data representing text-readable functions;
- converting the function data to computer readable functions;
- and
- implementing one or more of the computer readable functions in a document preparation system.
Dependencies are inferred from the claim text.