Load plan generation
AssigneeOracle International Corporation
InventorsTerrel Co Seng, Saurabh Verma, Peter Songwen Xu
Life of this patent
Estimating the term…
Abstract
Load Plan Generator (LPG) is a BIAPPS utility for generating ODI load plans based on desired subset of fact tables for loading BIAPPS Data Warehouse. The tool simplifies the configurations process by minimizing the manual steps and configurations and provides a guided list of configurations steps and checklists. The load plan components can include different sets of load plans that will be stitched together by the load plan generator to create one load plan for loading chosen fact groups in the warehouse sourcing from different transaction systems.
Claims21
A method for generating a load plan used to load data from a data source into a data warehouse, the method comprising:
- invoking, by a computer system of a data integration system, a load plan generator, wherein the load plan generator orchestrates loading data from one or more sources into one or more data warehouses to execute a package sequence in a runtime environment and is configured to use metadata stored in a repository of the data integration system, wherein the repository of the metadata is shared by the data integration system and the load plan generator;
- receiving, at the computer system, one or more data source definitions each of the one or more data source definitions specifying the data source from which to load data into the data warehouse, a fact group associated with the data source, and a dimension group associated with the data source, wherein the fact group comprises factual information regarding dimensions in the dimension group, and wherein the dimension group comprises dependency information for the factual information in the fact group, and wherein the dimension group represents a hierarchical arrangement of the data;
- and
- configuring, with a processor associated with the computer system, for each data source definition in the one or more data source definitions, a phase with a plurality of predefined load plan components based on the data source of the data source definition satisfying one or more design dependencies, wherein each of the plurality of predefined load plan components specifies a task indicative of how data is to be loaded between the data source and the data warehouse, wherein the plurality of predefined load plan components are configured dynamically based on load plan rules, and wherein the plurality of predefined load plan components resolve local dependencies within the fact group or dimension group, and
- wherein the computer system determines how to load data to the data warehouse based on a type of a load plan component.
A non-transitory computer-readable medium comprising instructions which, when executed by one or more processors of a computer system of a data integration system, causes the one or more processors to generate a load plan used to load data from a data source into a data warehouse, the instructions comprising:
- invoke a load plan generator, wherein the load plan generator orchestrates loading data from one or more sources into one or more data warehouses to execute a package sequence in a runtime environment and is configured to use metadata stored in a repository of the data integration system, wherein the repository of the metadata is shared by the data integration system and the load plan generator;
- receive one or more data source definitions each specifying the data source from which to load data into the data warehouse, a fact group associated with the data source, and a dimension group associated with the data source, wherein the fact group comprises factual information regarding dimensions in the dimension group, and wherein the dimension group comprises dependency information for the factual information in the fact group, and wherein the dimension group represents a hierarchical arrangement of the data;
- and
- configure a phase with a plurality of predefined load plan components based on the data source of the data source definition satisfying one or more design dependencies, wherein each of the plurality of predefined load plan components specifies a task indicative of how data is to be loaded between the data source and the data warehouse, wherein the plurality of predefined load plan components are configured dynamically based on load plan rules, and wherein the plurality of predefined load plan components resolve local dependencies within the fact group or dimension group, and
- wherein the computer system determines how to load data to the data warehouse based on a type of a load plan component.
A system of a data integration system for generating a load plan used to load data from a data source into a data warehouse, the system comprising:
- one or more processors;
- and
- a memory storing a set of instructions which when executed by the one or more processors causes the one or more processors to:
- invoke a load plan generator, wherein the load plan generator orchestrates loading data from one or more sources into one or more data warehouses to execute a package sequence in a runtime environment and is configured to use metadata stored in a repository of the data integration system, wherein the repository of the metadata is shared by the data integration system and the load plan generator;
- receive one or more data source definitions each specifying the data source from which to load data into the data warehouse, a fact group associated with the data source, and a dimension group associated with the data source, wherein the fact group comprises factual information regarding dimensions in the dimension group, and wherein the dimension group comprises dependency information for the factual information in the fact group, and wherein the dimension group represents a hierarchical arrangement of the data;
- and
- configure one or more phases with a plurality of predefined load plan components based on the data source of the data source definition satisfying one or more design dependencies, wherein each of the plurality of predefined load plan components specifies a task indicative of how data is to be loaded between the data source and the data warehouse, wherein the plurality of predefined load plan components are configured dynamically based on load plan rules, and wherein the plurality of predefined load plan components resolve local dependencies within the fact group or dimension group, and
- wherein the system determines how to load data to the data warehouse based on a type of a load plan component.
Dependencies are inferred from the claim text.