Techniques for efficient data categorization

A system comprising memory and one or more processors communicatively coupled to the memory, the one or more processors configured to:

• receive (i) a data set including a plurality of data points and (ii) a rule group including a plurality of rules and a plurality of rule sets, wherein each data point in the plurality of data points includes one or more data lines, and wherein all of the one or more data lines in the plurality of data points collectively form a set of data lines;
• wherein the rule group further includes at least one rule hierarchy indicating a prioritized ordering of rule sets from the plurality of rule sets;
• apply a categorization algorithm to the data set and the rule group, wherein applying the categorization algorithm includes:
• generating a plurality of rule signatures, wherein each rule signature in the plurality of rule signatures is generated for a respective data line in the set of data lines, and wherein a rule signature in the plurality of rule signatures represents at least one rule from the plurality of rules that is satisfied by the respective data line, identifying a set of unique rule signatures within the plurality of rule signatures, and determining a plurality of categorizations, wherein each categorization in the plurality of categorizations is determined for a unique rule signature from the set of unique rule signatures based on the unique rule signature and at least one rule set from the plurality of rule sets;
• analyzing each unique rule signature from the set of unique rule signatures and the at least one rule set from the plurality of rule sets in an order defined by the at least one rule hierarchy;
• and
• store one or more data objects indicative of the plurality of categorizations.

One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to:

• receive (i) a data set including a plurality of data points and (ii) a rule group including a plurality of rules and a plurality of rule sets, wherein each data point in the plurality of data points includes one or more data lines, and wherein all of the one or more data lines in the plurality of data points collectively form a set of data lines;
• wherein each rule set of the plurality of rule sets corresponds to an outcome of applying at least one rule from the plurality of rules to an individual data line in the set of data lines;
• apply a categorization algorithm to the data set and the rule group, wherein applying the categorization algorithm includes:
• generating a plurality of rule signatures, wherein each rule signature in the plurality of rule signatures is generated for a respective data line in the set of data lines, and wherein a rule signature in the plurality of rule signatures represents at least one rule from the plurality of rules that is satisfied by the respective data line, identifying a set of unique rule signatures within the plurality of rule signatures, and determining a plurality of categorizations, wherein each categorization in the plurality of categorizations is determined for a unique rule signature from the set of unique rule signatures based on the unique rule signature and at least one rule set from the plurality of rule sets;
• wherein the rule group further includes at least one rule hierarchy indicating a prioritized ordering of rule sets from the plurality of rule sets, and the instructions, when executed, cause the one or more processors to determine the plurality of categorizations by:
• analyzing each unique rule signature from the set of unique rule signatures and the at least one rule set from the plurality of rule sets in an order defined by the at least one rule hierarchy;
• and
• store one or more data objects indicative of the plurality of categorizations.