Processing an electronic document for information extraction
AssigneeMicrosoft Corporation
InventorsPaul Viola, Hiu Chung Law, James Rinker
Life of this patent
Estimating the term…
Abstract
The present invention relates generally to automatically processing electronic documents. In one aspect, features and/or properties of words are identified from a set of training documents to aid in extracting information from documents to be processed. The features and/or properties relate to text of the words, position of the words and the relationship to other words. A classifier is developed to express these features and/or properties. During information extraction, documents are processed and analyzed based on the classifier and information is extracted based on correspondence of the documents and the features/properties expressed by the classifier.
Claims10
A method of identifying features to be used when extracting information from a document, comprising:
- obtaining a set of training documents, the set comprising a plurality of training documents;
- identifying potential classifying keywords indicative of an informational element associated with the set of training documents;
- selecting a number of the potential classifying keywords based on a frequency of the potential classifying keywords in the plurality of training documents;
- identifying potential features of each of the selected classifying keywords in each of the plurality of training documents based on text of the selected classifying keywords, relation of the selected classifying keywords to other words identified from text in each training document, relation of the selected classifying keywords to graphic lines in each training document, and a layout of each training document;
- selecting a number of the potential features of the selected classifying keywords that are indicative of the informational element being associated with a document, wherein selecting comprises:
- assigning a score to each of the potential features;
- and
- selecting a number of the potential features based on the score assigned to the potential features;
- and
- utilizing the selected features to develop a classifier using a processor of a computing device, wherein the classifier is developed based on a combination of the selected features that is weighted based on the score assigned to each of the selected features, the classifier being configured to be utilized to extract information from the document.
A method of processing a document, the method comprising:
- identifying keywords in the document indicative of an informational property of the document;
- assigning a score to each of the keywords in the document based on a location of each of the keywords, a relation of each of the keywords to other words identified from text in the document, a relation between graphic lines and each of the keywords, and text of each keyword;
- assigning a combined score to the document based on the score assigned to each of the keywords in the document, wherein assigning the combined score comprises assigning a combined score to the document for each of a plurality of types of document;
- and
- using a processor of a computing device, classifying the document as being one type of document selected from the plurality of types of document based on the combined score, wherein classifying the document comprises comparing the combined score to a threshold value.
Dependencies are inferred from the claim text.