Hierarchy of servers for query processing of column chunks in a distributed column chunk data store

A non-transitory computer-readable medium storing instructions executable by a processor and that upon execution by the processor cause the processor to perform operation comprising:

• creating, by the one or more processors, a first column chunk for a particular data table including data rows having one or more columns, the first column chunk including data stored in particular columns of the data rows in the particular data table, wherein the first column chunk is created based at least in part on a storage policy and a distribution policy associated with the particular data table, wherein the storage policy specifies the number of column chunks into which columns of the data table are partitioned, and wherein the distribution policy specifies the distribution of the column chunks to the plurality of storage servers;
• creating, by the one or more processors, a second column chunk including data stored in the particular columns of second data rows in the particular data table different than the first data rows, wherein the second column chunk is created based at least in part on the storage policy associated with the particular data table;
• and
• creating, by the one or more processors, a parity column chunk based on the first column chunk and the second column chunk, the parity column chunk including information to recover data from the first column chunk and the second column chunk;
• and
• distributing the first and second column chunks for storage by one or more servers of the plurality of storage servers based at least in part on the storage policy associated with the particular data table;
• receiving a query identifying requested data associated with the particular data table;
• transforming the query into a plurality of sub-queries;
• distributing a first and second sub-query to respective query servers to search respective column chunks the query servers being two different query servers;
• receiving a first and second sub-results from the query servers responsive to the first and second sub-query;
• and
• combining the first and second sub-results into a master result including the requested data;
• and
• sending a response to the query, the response including the master result.

A system comprising:

• a memory for storing instructions executable by one or more processors;
• and
• the one or more processors executing the instructions to perform operations comprising:
• creating, by the one or more processors, a first column chunk for a particular data table including data rows having one or more columns, the first column chunk including data stored in particular columns of the data rows in the particular data table, wherein the first column chunk is created based at least in part on a storage policy and a distribution policy associated with the particular data table, wherein the storage policy specifies the number of column chunks into which columns of the data table are partitioned, and wherein the distribution policy specifies the distribution of the column chunks to the plurality of storage servers;
• creating, by the one or more processors, a second column chunk including data stored in the particular columns of second data rows in the particular data table different than the first data rows, wherein the second column chunk is created based at least in part on the storage policy associated with the particular data table;
• and
• creating, by the one or more processors, a parity column chunk based on the first column chunk and the second column chunk, the parity column chunk including information to recover data from the first column chunk and the second column chunk;
• and
• distributing the first and second column chunks for storage by one or more servers of the plurality of storage servers based at least in part on the storage policy associated with the particular data table;
• receiving a query identifying requested data associated with the particular data table;
• transforming the query into a plurality of sub-queries;
• distributing a first and second sub-query to respective query servers to search respective column chunks the query servers being two different query servers;
• receiving a first and second sub-results from the query servers responsive to the first and second sub-query;
• and
• combining the first and second sub-results into a master result including the requested data;
• and
• sending a response to the query, the response including the master result.