Semantically Preserved File Compression System Utilizing Optimized Lookup Tables Enabling Active Processing of Compressed Data

A non-transitory computer-readable storage medium storing one or more programs for compressing data, the one or more programs comprising instructions, which, when executed by at least one processor of an electronic system, cause the electronic system to:

• receive input data;
• read the input data;
• perform a level 1 compression on the input data, the level 1 compression comprising:
• update a level 1 P-table based upon a predefined probability threshold,
• detect at least one low-probability n-gram,
• create a distinct level 1 charter for each low-probability n-gram, and
• replace each detected n-gram with its level 1 charter;
• perform a level n compression wherein n is a number greater than 1, comprising:
• update a level n P-table based upon a predefined probability threshold,
• detect at least one low-probability n-gram,
• create a distinct level n charter for each low-probability n-gram, and
• replace each low-probability n-gram with a level n token to create level n output;
• and
• create at least one charter-encoded file format from the level n output.

A method for decompressing data from a compressed format, comprising:

• an electronic system having at least one processor, and a memory coupled to the at least one processor comprising instructions executable by the processors, the at least one processor operable when executing the instructions to:
• read a plurality of compressed data and associated metadata containing at least one token;
• utilize a pattern-matching automata and at least one lookup table to map each tokens back to a corresponding charter;
• reconstruct an original data by replacing each token with its corresponding charters to produce decompressed data;
• and
• verify the integrity and functionality of the decompressed data.

A system for semantically preserving data compression, the system comprising at least one processor, and a memory coupled to the at least one processor comprising instructions executable by the at least one processor, the at least one processor operable when executing the instructions to:

• read input data;
• identify level 1 prefixes, level 1 suffixes, and level 1 prefix-suffix combinations in the input data;
• calculate a count for and an associated probability of each of the level 1 prefix-suffix combination;
• update at least one level 1 probabilistic table with the level 1 counts and associated probabilities;
• detect low-probability level 1 prefix-suffix combinations;
• assign a level 1 token to each detected low-probability level 1 prefix-suffix combination;
• replace each of the low-probability level 1 prefix-suffix combinations with the assigned level 1 charter to create a level 1 output;
• identify level 2 prefixes, level 2 suffixes, and level 2 prefix-suffix combinations in the level 1 output;
• calculate a count for and an associated probability of each of the level 2 prefix-suffix combination;
• update at least one level 2 probabilistic table with the level 2 counts and associated probabilities;
• detect low-probability level 2 prefix-suffix combinations;
• assign a level 2 token to each detected low-probability level 2 prefix-suffix combination;
• replace each of the low probability level 2 prefix-suffix combinations with the assigned level 2 token to create a level 2 output;
• and
• store all assigned tokens in at least one deduplication database.

A computer implemented method for transforming input data into a charter-encoded file format, the method employing at least one processor, and a memory coupled to the at least one processor comprising instructions executable by the at least one processor, the at least one processor operable when executing the instructions to:

• receiving a plurality of input data;
• reading the input data;
• performing a level 1 compression on the input data, the level 1 compression comprising:
• updating a level 1 P-Table based upon a predetermined probability threshold,
• detecting low-probability n-grams,
• creating at least one distinct level 1 charter, and
• replacing each detected n-grams with a token;
• performing a level n compression wherein n is a number greater than 1, comprising:
• updating a level n P-Table based upon a predetermined probability threshold,
• detecting low-probability n-grams,
• creating at least one distinct level n charter, and
• replacing each level n charter with a level n token to create level n output;
• and
• creating at least one charter-encoded file format from the level n output.

A computer implemented method for compressing and decompressing data using a computing device comprising a processor in communication with a non-transitory processor-readable storage medium and a memory, the method configured to:

• receive input data;
• read the input data into smaller data segments;
• process the data segments through a level 1 compression to generate level 1 output;
• process the level 1 output through a level 2 compression to generate level 2 output;
• create a charter-encoded file from the level 2 output;
• parse the charter-encoded file;
• perform a level 2 decompression on the charter-encoded file;
• perform a level 1 decompression on the charter-encoded file to produce a restored file;
• and
• validate the restored file for semantic accuracy.