On-the-fly encoding method for efficient grouping and aggregation

A system for encoding data, the system comprising:

• at least one memory storing computer-executable instructions;
• and
• at least one processor configured to access the at least one memory and execute the computer-executable instructions to:
• receive a query comprising predicates;
• reduce a set of database values by application of the predicates;
• determine a group of database values from the reduced set of database values associated with the query to be encoded for completing the query request;
• encode the group of database values associated with the query to obtain an encoded value, wherein the at least one processor is configured to encode the group of database values by executing the computer-executable instructions to:
• perform a group-by operation on a database table to obtain an encoding table that associates the group of database values from the encoded value;
• perform an aggregation distinct on the group of database values and another group of database values not subject to the group-by operation during a scan of a dimension table;
• and
• perform, using the aggregation distinct, a join operation on the database table and the encoding table to convert the group of database values into the encoded value, wherein the join operation is performed without having to perform an additional scan of the dimension table;
• processing the query, wherein processing the query comprises executing at least one processing operation on the encoded value;
• and
• decode the encoded value to obtain the group of database values.

A computer program product for encoding data, the computer program product comprising a non-transitory storage medium readable by a processing circuit, the storage medium storing instructions executable by the processing circuit to cause a method to be performed, the method comprising:

• receiving a query comprising predicates;
• reducing a set of database values by application of the predicates;
• determining a group of database values from the reduced set of database values associated with the query to be encoded for completing the query request;
• encoding the group of database values associated with the query to obtain an encoded value, wherein encoding the group of database values comprises:
• performing a group-by operation on a database table to obtain an encoding table that associates the group of database values with the encoded value;
• performing an aggregation distinct on the group of database values and another group of database values not subject to the group-by operation during a scan of a dimension table;
• and
• performing, using the aggregation distinct, a join operation on the database table and the encoding table to convert the group of database values into the encoded value, wherein the join operation is performed without having to perform an additional scan of the dimension table;
• processing the query, wherein processing the query comprises executing at least one processing operation on the encoded value;
• and
• decoding the encoded value to obtain the group of database values.