Systems and methods for telemetry data compression

A system for compressing and restoring data, comprising:

• a computing device comprising at least a memory and a processor;
• a telemetry encoding module comprising a first plurality of programming instructions stored in the memory and operable on the processor, wherein the first plurality of programming instructions, when operating on the processor, cause the computing device to:
• receive and tokenize telemetry data;
• generate probability distributions for tokens of the telemetry data using a transformer-based neural network (TBNN);
• rank the tokens according to the generated probability distributions;
• perform lossless compression of the tokens based on the ranking of the tokens to create compressed telemetry data;
• and
• generate a bitstream of the compressed telemetry data;
• a telemetry decoding module comprising a second plurality of programming instructions stored in the memory and operable on the processor, wherein the second plurality of programming instructions, when operating on the processor, cause the computing device to:
• receive the bitstream of the compressed telemetry data;
• apply the bitstream of compressed telemetry data as input to the telemetry decoding module;
• and
• decompress the bitstream of compressed telemetry data to generate a reconstructed version of the telemetry data.