Systems and methods for data compression
AssigneeFacebook, Inc.
InventorsOleksandr Barykin, Josh Metzler
Life of this patent
Estimating the term…
Abstract
Event data comprising an unordered string set may be received. String set dictionary indexes may be assigned for strings of the unordered string set in a string set dictionary. The unordered string set may be sorted to provide a sorted series based on the string set dictionary indexes for the unordered string set. A differential series may be computed from the sorted series. The differential series may be encoded into binary code words. In an embodiment, the event data also may comprise strings. A schema version associated with the strings in a row may be determined. Computing resources may be allocated based on the schema version.
Claims20
A system comprising:
- at least one processor;
- and
- a memory storing instructions configured to instruct the at least one processor to perform:
- receiving event data comprising an unordered string set;
- assigning string set dictionary indexes for strings of the unordered string set in a string set dictionary;
- sorting the unordered string set to provide a sorted series based on the string set dictionary indexes for the unordered string set;
- computing a differential series from the sorted series;
- and
- encoding the differential series into binary code words.
A computer implemented method comprising:
- receiving, by a computer system, event data containing an unordered string set;
- assigning, by the computer system, string set dictionary indexes for strings of the unordered string set in a string set dictionary;
- sorting, by the computer system, the unordered string set to provide a sorted series based on the string set dictionary indexes for the unordered string set;
- computing, by the computer system, a differential series from the sorted series;
- and
- encoding, by the computer system, the differential series into binary code words.
A computer storage medium storing computer-executable instructions that, when executed, cause a computer system to perform a computer-implemented method comprising:
- receiving event data comprising an unordered string set;
- assigning string set dictionary indexes for strings of the unordered string set in a string set dictionary;
- sorting the unordered string set to provide a sorted series based on the string set dictionary indexes for the unordered string set;
- computing a differential series from the sorted series;
- and
- encoding the differential series into binary code words.
Dependencies are inferred from the claim text.