# US 2015/0178367 A1 · System and method for implementing online analytical processing (olap) solution using mapreduce

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0178367 A1
- Document ID: US20150178367A1
- Status: Published application
- Kind: A1
- Application number: 14/559,642
- Filed: 2014-12-03
- Published: 2015-06-25
- Earliest claimed: 2013-12-20
- Assignees: Infosys Limited
- Applicants: Infosys Limited
- Inventors: Shyam Kumar Doddavula; Arun Viswanathan
- Web page: https://patentgrep.com/patent/US20150178367A1

## CPC

- G06F 16/283: {Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP}
- G06F 16/254: {Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The technique relates to a system and method for implementing petabyte scale online analytical processing solutions using MapReduce. The technique involves receiving an OLAP query from a user through an OLAP-QL Driver. After receiving the query it is parsed through the compiler. Then the metadata information is retrieved from the parsed query through the metadata manager. Validating the parsed query using plan generator module for generating a MapReduce job execution plan based on the retrieved metadata information. The next step is to identify the scope for optimization in the generated MapReduce job execution plan and optimizing the MapReduce job execution plan using the identified scope. Then executing the optimized MapReduce job plan using the execution engine and finally storing the output data in the cube specific distributed file system directory.

## Claims

### Claim 1

A method for implementing an Online Analytical Processing (OLAP) solution using Map Reduce, the method comprising:
parsing, by the OLAP processing computing system, a received OLAP query;
retrieving, by the OLAP processing computing system, metadata information from the parsed OLAP query;
validating, by the OLAP processing computing system, the parsed OLAP query and generating a MapReduce job execution plan based on the retrieved metadata information;
identifying, by the OLAP processing computing system, a scope for optimization in the generated MapReduce job execution plan and optimizing the MapReduce job execution plan using the identified scope;
executing, by the OLAP processing computing system, the optimized MapReduce job execution plan; and
storing, by the OLAP processing computing system, data output as a result of the execution in a cube specific distributed file system (DFS) directory.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein the validating further comprises compiler validates the OLAP query for correct syntax.

### Claim 3 (depends on 1)

The method as claimed in claim 1, wherein the retrieved metadata information comprises cube schema information comprises a fact name, a dimension name, a measure, an aggregation function, an analytical function or other axis details from the received OLAP query.

### Claim 4 (depends on 1)

The method as claimed in claim 1, wherein the optimizing further comprises:
identifying relevant attributes in the retrieved metadata information;
re-ordering one or more entities in the retrieved metadata information;
optimizing one or more joins using a map side bloom filter; and
rearranging the order of execution of one or more tasks across multiple jobs.

### Claim 5

A Online Analytical Processing (OLAP) processing computing system, comprising a processor and a memory coupled to the processor which is configured to be capable of executing programmed instructions comprising and stored in the memory to:
parse a received OLAP query;
retrieve metadata information from the parsed OLAP query;
validate the parsed OLAP query and generating a MapReduce job execution plan based on the retrieved metadata information;
identify a scope for optimization in the generated MapReduce job execution plan and optimizing the MapReduce job execution plan using the identified scope;
execute the optimized MapReduce job execution plan; and
store data output as a result of the execution in a cube specific distributed file system (DFS) directory.

### Claim 6 (depends on 5)

The system as claimed in claim 5, wherein the validating further comprises compiler validates the OLAP query for correct syntax.

### Claim 7 (depends on 5)

The system as claimed in claim 5, wherein the retrieved metadata information comprises cube schema information comprises a fact name, a dimension name, a measure, an aggregation function, an analytical function or other axis details from the received OLAP query.

### Claim 8 (depends on 5)

The system as claimed in claim 5, wherein the processor coupled to the memory is further configured to be capable of executing additional programmed instructions comprising and stored in the memory to:
identify relevant attributes in the retrieved metadata information;
re-order one or more entities in the retrieved metadata information;
optimize one or more joins using a map side bloom filter; and
rearrange the order of execution of one or more tasks across multiple jobs.

### Claim 9

A non-transitory computer readable medium having stored thereon instructions for implementing an Online Analytical Processing (OLAP) solution using Map Reduce comprising executable code which when executed by a processor, causes the processor to perform steps comprising:
parsing a received OLAP query;
retrieving metadata information from the parsed OLAP query;
validating the parsed OLAP query and generating a MapReduce job execution plan based on the retrieved metadata information;
identifying a scope for optimization in the generated MapReduce job execution plan and optimizing the MapReduce job execution plan using the identified scope;
executing the optimized MapReduce job execution plan; and
storing data output as a result of the execution in a cube specific distributed file system (DFS) directory.

### Claim 10 (depends on 9)

The non-transitory computer readable medium as claimed in claim 9, wherein the validating further comprises compiler validates the OLAP query for correct syntax.

### Claim 11 (depends on 9)

The non-transitory computer readable medium as claimed in claim 9, wherein the retrieved metadata information comprises cube schema information comprises a fact name, a dimension name, a measure, an aggregation function, an analytical function or other axis details from the received OLAP query.

### Claim 12 (depends on 9)

The non-transitory computer readable medium as claimed in claim 9, wherein the optimizing further comprises:
identifying relevant attributes in the retrieved metadata information;
re-ordering one or more entities in the retrieved metadata information;
optimizing one or more joins using a map side bloom filter; and
rearranging the order of execution of one or more tasks across multiple jobs.
