System and method for compression of words and phrases in text based on language features

A system for compressing and decompressing text using variable length codes, the system comprising:

• a first memory device configured to store a set of variable length codes for a plurality of languages for compression of text, wherein the set of variable length codes includes variable code lengths based on language features;
• an encoder coupled to the first memory device, the encoder configured to receive text in at least one of the plurality of languages, to generate a compressed text by assigning a code to each word in the text based on codes from the set of variable length codes that are associated with the at least one language of the text and to generate at least one header to be inserted in the compressed text, the header including information regarding the location in the compressed text of a subsequent change in code length;
• a second memory device configured to store the set of variable length codes for a plurality of languages for decompression of the text;
• and
• a decoder in data communication with the encoder and coupled to the second memory device, the decoder configured to receive the compressed text, to generate a decompressed text by identifying a word associated with each code in the compressed text based on the set of variable length codes stored in the second memory device;
• wherein the decoder identifies changes in code length based on the at least one header included in the compressed text.

A system for decoding compressed text using variable length codes, the system comprising:

• a memory device configured to store a set of variable length codes for a plurality of languages for decompression of the text, wherein the set of variable length codes includes variable code lengths based on language features;
• and
• a decoder coupled to the memory device, the decoder configured to receive the compressed text having a plurality of codes and at least one header, to generate a decompressed text by identifying a word associated with each code in the compressed text based on the set of variable length codes stored in the second memory device;
• wherein the at least one header includes information regarding the location in the compressed text of a subsequent change in code length;
• wherein the decoder identifies changes in code length based on the at least one header included in the compressed text.

A method for compressing text using variable length codes, the method comprising:

• receiving text to be compressed;
• identifying a language of the text;
• generating a compressed text by assigning a code to each word of the text using a set of variable length codes associated with the language of the text;
• identifying each change in code length in the compressed text;
• and
• inserting at least one header in the compressed text, the at least one header including information regarding the location in the compressed text of a subsequent change in code length.