Methods and systems for indexlet based aggregation
AssigneeQliktech International AB
InventorsJohan Nilsson, Pawel Rafal Krupinski, Khoa Tan Nguyen, José Diaz López
Life of this patent
Estimating the term…
Abstract
Provided are methods and systems for traversing a data model with a plurality of workers to generate a plurality of virtual records for use in evaluating an expression by a plurality of aggregators. Each aggregator may receive a respective virtual record and evaluate a hypercube function and determine a respective hash based on the respective virtual record. The virtual records based on the respective hash values of the respective virtual records may be stored by the plurality of aggregators.
Claims20
A method comprising:
- determining a plurality of dimensions for evaluating a hypercube associated with a data model;
- assigning, to each worker node of a plurality of worker nodes, a partition of the data model based on the plurality of dimensions, wherein each partition is associated with at least one dimension of the plurality of dimensions, and wherein each partition comprises a block of rows of at least one table of the data model comprising values for the at least one dimension of the plurality of dimensions;
- traversing, by each of the plurality of worker nodes, the block of rows of the at least one table corresponding to the partition assigned to that worker node to populate a virtual record for the partition assigned to that worker node, wherein the virtual records are populated by the plurality of worker nodes with the values for the at least one dimension within the partition assigned to the corresponding worker node;
- evaluating, by a plurality of aggregators, the hypercube based on the virtual records;
- generating, by the plurality of aggregators, a hash value for each of the virtual records;
- and
- storing, by the plurality of aggregators, the virtual records based on the hash value for each of the virtual records.
A method comprising:
- determining a plurality of dimensions for evaluating a hypercube associated with a data model;
- assigning, to each worker node of a plurality of worker nodes, a partition of the data model based on the plurality of dimensions, wherein each partition is associated with at least one dimension of the plurality of dimensions, and wherein each partition comprises a block of rows of at least one table of the data model comprising values for the at least one dimension of the plurality of dimensions;
- traversing, by each of the plurality of worker nodes, the block of rows of the at least one table corresponding to the partition assigned to that worker node to populate a virtual record for the partition assigned to that worker node, wherein the virtual records are populated by the plurality of worker nodes with the values for the at least one dimension within the partition assigned to the corresponding worker node;
- and
- providing, by the plurality of worker nodes, the virtual records to a plurality of aggregators.
A method comprising:
- receiving, by each aggregator of a plurality of aggregators, a virtual record comprising values for at least one dimension of a plurality of dimensions of a data model, wherein each virtual record received by each aggregator is based on a partition, of the data model, comprising a block of rows of at least one table of the data model comprising the values for the at least one dimension, and wherein each virtual record is populated with the values for the at least one dimension within the corresponding partition;
- evaluating, by each aggregator of the plurality of aggregators, a portion of a hypercube based on the values for the at least one dimension within the virtual record for that aggregator;
- generating, by each aggregator of the plurality of aggregators, a hash value for the virtual record for that aggregator;
- and
- storing, by the plurality of aggregators, the virtual records based on the hash values.
Dependencies are inferred from the claim text.