Linguistically intelligent text compression
AssigneeMicrosoft Corporation
InventorsSimon H. Corston-Oliver, Sharad Mathur
Life of this patent
Estimating the term…
Abstract
A text processor processes text in a message. The text processor generates a plurality of compressed forms of components of the message. The processor performs a linguistic analysis on the body of text to obtain a linguistic output indicative of linguistic components of the body of text. The processor then generates the plurality of compressed forms that can be used to compress the body of text. The plurality of compressed forms are generated based on the linguistic output. The invention can be implemented as a method of generating the compressed forms and as an apparatus.
Claims12
A method of processing a body of text to generate compression options, comprising:
- performing a syntactic analysis on the body of text to obtain a linguistic output indicative of linguistic components of the body of text wherein the syntactic analysis includes a tree having non-terminal nodes representing multi-word portions of the body of text and terminal nodes indicative of words in the body of text;
- after performing the syntactic analysis, automatically generating a plurality of compression options for each of a plurality of different portions of the body of text to compress the body of text based on the linguistic output each of the compression options comprising a different compressed form of an instance of the portion in the body of text wherein automatically generating comprises:
- automatically subjecting the portions of the body of text to different sets of compression rules to obtain the plurality of compression options, by subjecting each portion of the body of text to the different sets of compression rules in a predetermined order such that the compression options reflect varying degrees of compression of a same portion of the body of text, wherein both the non-terminal nodes and terminal nodes are subjected to the compression rules;
- generating a compression identifier attribute indicative of at least one of the sets of compression rules to which the portion of the body of text is subjected;
- and
- generating a ShortForm attribute indicative of a compressed form of the portion of the body of text by applying the set of compression rules to the syntactic analysis;
- and
- selecting one of the plurality of compression options for each of the plurality of different portions of the body of text to output a compressed form of the body of text.
Dependencies are inferred from the claim text.