Method to identify common structures in formatted text documents
AssigneeInternational Business Machines Corporation
InventorsYuan-chi Chang, Debdoot Mukherjee, Vibha Singhal Sinha, Biplav Srivastava
Life of this patent
Estimating the term…
Loading patent…
AssigneeInternational Business Machines Corporation
InventorsYuan-chi Chang, Debdoot Mukherjee, Vibha Singhal Sinha, Biplav Srivastava
Estimating the term…
A computer implemented method, computer program product and data processing system, for identifying common structures shared across a plurality of formatted text documents. The common structure is presented as a sequence of landmarks, each of which has a starting and ending marker to describe the borders of text. The common structure is identified by counting the occurrences of repeating text segments across documents. Frequently co-occurred adjacent segments become candidates for markers of landmarks. In addition, styling information of textual content within a landmark is extracted and mapped to rules. The rules are used to merge and summarize content from multiple documents, which gives an advantage over current practice of content concatenation.
A computerized method to discover hidden structures in documents stored in a repository or document collection, said method comprising:
The method of claim wherein only a portion of said documents in said repository are retrieved for said clustering, as representative of said repository.
Dependencies are inferred from the claim text.