Hadoop olap engine
AssigneeeBay Inc.
InventorsLuke Qing Han, Xu Jiang, Yi Song, Chauncey Li
Life of this patent
Estimating the term…
Abstract
In various example embodiments, systems and methods for building data cubes to be stored in a cube store are presented. In some embodiments, a metadata engine generates the cube metadata. In further embodiments, cube data is generated by a cube build engine based on the cube metadata and source data. The cube build engine performs a multi-stage MapReduce job on the source data to produce a multi-dimensional cube lattice having multiple cuboids. In further embodiments, the cube data is provided to the cube store.
Claims20
A system comprising:
- at least one processor of a machine;
- a metadata engine to generate cube metadata comprising dimension and measure information for a cube;
- and
- a cube build engine to generate cube data for the cube based on the cube metadata received from the metadata engine and source data, executing on the at least one processor of the machine, by performing a multi-stage MapReduce job on the source data to produce a multi-dimensional cube lattice having multiple cuboids, the cube build engine further to provide the cube data to a cube store.
A method comprising:
- receiving source data from a database, the source data represented by star schema data;
- receiving cube metadata from a metadata engine, the cube metadata including dimension and measure information for a cube;
- building the cube based on the cube metadata and the source data, executing on at least one processor of a machine, by performing a multi-stage MapReduce job on the star schema data to produce a multi-dimensional cube lattice having multiple cuboids representing cube data;
- and
- providing the cube data to a cube store.
A machine readable medium not having any transitory signals and storing instructions that, when executed by at least one processor of a machine, cause the machine to perform operations comprising:
- receiving source data from a database, the source data represented by star schema data;
- receiving cube metadata from a metadata engine, the cube metadata including dimension and measure information for a cube;
- building the cube based on the cube metadata and the source data by performing a multi-stage MapReduce job on the star schema data to produce a multi-dimensional cube lattice having multiple cuboids representing cube data;
- and
- providing the cube data to a cube store.
Dependencies are inferred from the claim text.