Systems and methods for reducing data density in large datasets

A system comprising:

• one or more processors;
• one or more non-transitory machine-readable storage media containing instructions which when executed on the one or more processors, cause the one or more processors to perform operations including:
• obtaining a reference data point;
• determining first representative data associated with the reference data point, the first representative data indicating a relationship between a vector associated with the reference data point and a plurality of projected vectors;
• removing a number of bits associated with the reference data point from storage in response to determining the first representative data;
• obtaining an unknown data point;
• determining second representative data associated with the unknown data point, the second representative data indicating a relationship between a vector associated with the unknown data point and the plurality of projected vectors;
• and
• identifying, using the first representative data and the second representative data, one or more candidate data points for matching the unknown data point, wherein identifying the one or more candidate data points includes comparing the unknown data point to the reference data point.