Optimizing federated and ETL'd databases with considerations of specialized data structures within an environment having multidimensional constraint
AssigneeInternational Business Machines Corporation
InventorsRobert R. Friedlander, James R. Kraemer
Life of this patent
Estimating the term…
Abstract
A method for creating a data warehousing scheme having optimally selected components. A mathematical model of a goal for the data warehousing scheme is input into an optimization engine. At least one constraint on the data warehousing scheme is input into the optimization engine. A mathematical optimization algorithm is performed using the optimization engine, wherein an output of the optimization engine is an optimized data warehousing scheme having optimally selected components. The optimized data warehousing scheme can be stored.
Claims20
A computer-implemented method for creating a data warehousing scheme having optimally selected components, the computer-implemented method comprising:
- inputting into an optimization engine a mathematical model of a goal for the data warehousing scheme, wherein the data warehousing scheme is a system of data processing systems, networking systems, software, data storage types, and data types used to maintain data and operations of an organization;
- inputting into the optimization engine at least one constraint on the data warehousing scheme and an affinity matrix, wherein the affinity matrix indicates relationships between groups of data sources and groups of output objects, and relationships between groups of available logical processes and groups of output objects, wherein each relationship is represented by a cell containing a binary value in which a zero indicates that a data source is not needed or is incomplete for a particular output object data structure and a one indicates that the data source exists and is used for the particular output object data structure and wherein upon completion of a major information technology project associated with the affinity matrix, every cell of the affinity matrix has a one;
- performing a mathematical optimization algorithm using the optimization engine, the at least one constraint, and the affinity matrix, wherein an output of the optimization engine is an optimized data warehousing scheme having the optimally selected components in a specified order;
- and
- storing the optimized data warehousing scheme.
A computer program product comprising:
- a non-transitory computer storage device having computer usable program code stored thereon for creating a data warehousing scheme having optimally selected components, the computer usable program code including:
- computer usable program code for inputting into an optimization engine a mathematical model of a goal for the data warehousing scheme, wherein the data warehousing scheme is a system of data processing systems, networking systems, software, data storage types, and data types used to maintain data and operations of an organization;
- computer usable program code for inputting into the optimization engine at least one constraint on the data warehousing scheme and an affinity matrix, wherein the affinity matrix indicates relationships between groups of data sources and groups of output objects, and between groups of available logical processes and groups of output objects, wherein each relationship is a cell containing a binary value in which a zero indicates that a data source is not needed or is incomplete for a particular output object data structure and a one indicates that the data source exists and is used for the particular output object data structure and wherein upon completion of a major information technology project associated with the affinity matrix, every cell of the affinity matrix has a one;
- computer usable program code for performing a mathematical optimization algorithm using the optimization engine, the constraint, and the affinity matrix, wherein an output of the optimization engine is an optimized data warehousing scheme having the optimally selected components in a specified order;
- and
- computer usable program code for storing the optimized data warehousing scheme.
A data processing system comprising:
- a bus;
- at least one processor coupled to the bus;
- a computer usable medium coupled to the bus, wherein the computer usable medium contains a set of instructions for creating a data warehousing scheme having optimally selected components, wherein the at least one processor is adapted to carry out the set of instructions to:
- input into an optimization engine a mathematical model of a goal for the data warehousing scheme, wherein the data warehousing scheme is a system of data processing systems, networking systems, software, data storage types, and data types used to maintain data and operations of an organization;
- input into the optimization engine at least one constraint on the data warehousing scheme and an affinity matrix indicating relationships between groups of data sources and groups of output objects, and between groups of available logical processes and groups of output objects, wherein each relationship is a cell containing a binary value in which a zero indicates that a data source is not needed or is incomplete for a particular output object data structure and a one indicates that the data source exists and is used for the particular output object data structure and wherein upon completion of a major information technology project associated with the affinity matrix, every cell of the affinity matrix has a one;
- perform a mathematical optimization algorithm using the optimization engine, the constraint, and the affinity matrix, wherein an output of the optimization engine is an optimized data warehousing scheme having the optimally selected components in a specified order;
- and
- store the optimized data warehousing scheme.
Dependencies are inferred from the claim text.