System and method for generating a multi dimensional data cube for analytics using a map-reduce program

A method for generating a multidimensional data cube, comprising:

• receiving, from one or more data sources, a source data comprising a plurality of columns of data;
• combining each of a plurality of categorical columns within the source data with each of a plurality of numerical columns within the source data, to generate a plurality of data column combinations from the source data;
• generating a plurality of key-value pairs corresponding to the plurality of data column combinations and row values in the source data;
• collecting values paired with a same key to determine one or more aggregate numerical values or frequency values within the source data;
• generating a plurality of output files, including for each of the plurality of data column combinations generated for the source data, an output file that stores a pre-computed result of a query on the source data represented by the aggregate numerical values or the frequency values;
• storing the plurality of output files into a data cube, wherein the data cube stores the pre-computed results for the possible queries on the plurality of columns of the source data;
• and
• generating a mapping string for each of the plurality of output files in the data cube and indicative of a column of the source data;
• and
• upon receiving another query from a client application, utilizing a generated mapping string to map the received the another query to one of the plurality of output files in order to provide, in response to the another query, a pre-computed result stored at the one of the plurality of output files.

A non-transitory computer readable storage medium, including instructions stored thereon which when read and executed by one or more computers cause the one or more computers to perform a method comprising:

• receiving, from one or more data sources, a source data comprising a plurality of columns of data;
• combining each of a plurality of categorical columns within the source data with each of a plurality of numerical columns within the source data, to generate a plurality of data column combinations from the source data;
• generating a plurality of key-value pairs corresponding to the plurality of data column combinations and row values in the source data;
• collecting values paired with a same key to determine one or more aggregate numerical values or frequency values within the source data;
• generating a plurality of output files, including for each of the plurality of data column combinations generated for the source data, an output file that stores a pre-computed result of a query on the source data represented by the aggregate numerical values or the frequency values;
• storing the plurality of output files into a data cube, wherein the data cube stores the pre-computed results for the possible queries on the plurality of columns of the source data;
• and
• generating a mapping string for each of the plurality of output files in the data cube and indicative of a column of the source data;
• and
• upon receiving another query from a client application, utilizing a generated mapping string to map the received the another query to one of the plurality of output files in order to provide, in response to the another query, a pre-computed result stored at the one of the plurality of output files.