Automatic linear text segmentation
AssigneeContent Analyst Company, LLC
InventorRobert Price
Life of this patent
Estimating the term…
Abstract
An embodiment of the present invention provides a method for automatically subdividing a document into conceptually cohesive segments. The method includes the following steps: subdividing the document into contiguous blocks of text; generating an abstract mathematical space based on the blocks of text, wherein each block of text has a representation in the abstract mathematical space; computing similarity scores for adjacent blocks of text based on the similarity scores; and aggregating similar adjacent blocks of text based on the similarity scores.
Claims24
A method for automatically organizing a document into conceptually cohesive segments, comprising:
- (a) subdividing the document into contiguous blocks of text;
- (b) generating an abstract mathematical space based on the blocks of text, wherein each block of text has a representation in the abstract mathematical space;
- (c) computing similarity scores for adjacent blocks of text based on the representations of the adjacent blocks of text;
- and
- (d) aggregating similar adjacent blocks of text based on the similarity scores.
A computer program product for automatically organizing a document into conceptually cohesive segments, comprising:
- a computer usable medium having computer readable program code means embodied in said medium for causing an application program to execute on an operating system of a computer, said computer readable program code means comprising:
- a computer readable first program code means for subdividing the document into contiguous blocks of text;
- a computer readable second program code means for generating an abstract mathematical space based on the blocks of text, wherein each block of text has a representation in the abstract mathematical space;
- a computer readable third program code means for computing similarity scores for adjacent blocks of text based on the representations of the adjacent blocks of text;
- and
- a computer readable fourth program code means for aggregating similar adjacent blocks of text based on the similarity scores.
Dependencies are inferred from the claim text.