Load plan generation
AssigneeOracle International Corporation
InventorsTerrel Co Seng, Saurabh Verma, Peter Songwen Xu
Life of this patent
Estimating the term…
Abstract
Load Plan Generator (LPG) is a BIAPPS utility for generating ODI load plans based on desired subset of fact tables for loading BIAPPS Data Warehouse. The tool simplifies the configurations process by minimizing the manual steps and configurations and provides a guided list of configurations steps and checklists. The load plan components are basically different sets of load plans that will be stitched together by the load plan generator to create one load plan for loading chosen fact groups in the warehouse sourcing from different transaction systems.
Claims24
A method for generating load plans used to load data from data sources into data warehouses, the method comprising:
- receiving, at a computer system, one or more data source definitions each specifying one or more data sources from which to load data into a data warehouse, one or more fact groups associated with the one or more data sources, and one or more dimension groups associated with the one or more data sources;
- receiving, at the computer system, information indicative of one or more phases for loading data between data sources and data warehouses, wherein the one or more phases comprises one of a source data extract phase, a source independent load phase, and a post load process phase;
- and
- for each data source definition in the one or more data source definitions:
- configuring, with a processor associated with the computer system, the one or more phases with one or more of a plurality of predefined load plan components based on the one or more data sources of the data source definition satisfying one or more design dependencies, wherein each of the plurality of predefined load plan components automatically specifies one or more tasks indicative of how data is to be loaded between a data source and a data warehouse, and
- configuring, with the processor associated with the computer system, the one or more of the plurality of predefined load plan components based on satisfying one or more runtime dependencies between the one or more tasks in the one or more of the plurality of predefined load plan components, wherein the runtime dependencies are calculated based on association information, wherein the association information comprises an association of dimension to fact, or an association of the dimension or fact to corresponding staging tables;
- and
- generating, with the processor associated with the computer system, a load plan based on the configured one or more phases and the configured one or more of the plurality of predefined load plan components.
A non-transitory computer-readable medium storing computer-executable code for generating load plans used to load data from data sources into data warehouses, the non-transitory computer-readable medium comprising:
- code for receiving one or more data source definitions each specifying one or more data sources from which to load data into a data warehouse, one or more fact groups associated with the one or more data sources, and one or more dimension groups associated with the one or more data sources;
- code for receiving information indicative of one or more phases for loading data between data sources and data warehouses, wherein the one or more phases comprises one of a source data extract phase, a source independent load phase, and a post load process phase;
- and
- code for, for each data source definition in the one or more data source definitions:
- configuring the one or more phases with one or more of a plurality of predefined load plan components based on the one or more data sources of the data source definition satisfying one or more design dependencies, wherein each of the plurality of predefined load plan components automatically specifies one or more tasks indicative of how data is to be loaded between a data source and a data warehouse, and
- configuring the one or more of the plurality of predefined load plan components based on satisfying one or more runtime dependencies between the one or more tasks in the one or more of the plurality of predefined load plan components, wherein the runtime dependencies are calculated based on association information, wherein the association information comprises an association of dimension to fact, or an association of the dimension or fact to corresponding staging tables;
- and
- code for generating a load plan based on the configured one or more phases and the configured one or more of the plurality of predefined load plan components.
A system for generating load plans used to load data from data sources into data warehouses, the system comprising:
- a hardware processor;
- and
- a non-transitory memory storing a set of instructions which when executed by the processor configure the processor to:
- receive one or more data source definitions each specifying one or more data sources from which to load data into a data warehouse, one or more fact groups associated with the one or more data sources, and one or more dimension groups associated with the one or more data sources;
- receive information indicative of one or more phases for loading data between data sources and data warehouses, wherein the one or more phases comprises one of a source data extract phase, a source independent load phase, and a post load process phase;
- and
- for each data source definition in the one or more data source definitions:
- configure the one or more phases with one or more of a plurality of predefined load plan components based on the one or more data sources of the data source definition satisfying one or more design dependencies, wherein each of the plurality of predefined load plan components automatically specifies one or more tasks indicative of how data is to be loaded between a data source and a data warehouse, and
- configure the one or more of the plurality of predefined load plan components based on satisfying one or more runtime dependencies between the one or more tasks in the one or more of the plurality of predefined load plan components, wherein the runtime dependencies are calculated based on association information, wherein the association information comprises an association of dimension to fact, or an association of the dimension or fact to corresponding staging tables;
- and
- generate a load plan based on the configured one or more phases and the configured one or more of the plurality of predefined load plan components.
Dependencies are inferred from the claim text.