Method and Apparatus for Loading Data Files into a Data-Warehouse System
AssigneeKnowledge Computing Corporation
InventorsAdrian Boyko, William Oliver, Wojciech Wyzga, Zach Heidepriem
Life of this patent
Estimating the term…
Loading patent…
AssigneeKnowledge Computing Corporation
InventorsAdrian Boyko, William Oliver, Wojciech Wyzga, Zach Heidepriem
Estimating the term…
Date-warehouse systems are populated using an enhanced Extraction-Load-Transform (ETL) process and system by employing three ideas: Out-of-order-fill ETL, relative-ordering index (ROI), and dependent queries. Out-of-order-fill ETL allows a data warehouse to accept the loading of data files in any order, and does not require the loading of any previous backup data files in order to provide some functionality to end users under the view that some functionality or data access is better than none at all. Dependent queries are processes that use defined data structures for use in constructing, extracting, and validating each record to be written in said data-warehouse system in order to ensure that referential integrity is maintained and that no orphaned data is pushed into the data warehouse. Finally, ROI is a process wherein a value is determined, based on the constraints of the source data, which indicates the relative newness of the data.
In a data-warehouse system wherein there is to be data loaded or restored for use, said system having at least one computing device communicatively coupled with a large dataset, said large dataset having at least one storage device, said at least one storage device containing a full-backup data file and at least one partial-backup data file, said data files containing real-world entity data, said computing device having a Extraction Load Program (ETL) program to subject the data intended to be loaded to a transform stage according to data-warehouse-specific rules, a method of loading data into a data-warehouse system, comprising the step of:
A data-warehouse system wherein there is to be data loaded or restored for use, said system having at least one computing device communicatively coupled with a large dataset, said large dataset having at least one storage device, said at least one storage device containing a full-backup data file and at least one partial-backup data file, said data files containing real-world entity data, said computing device having a Extraction Load Program (ETL) program to subject the data intended to be loaded to a transform stage according to data-warehouse-specific rules, comprising:
In a data-warehouse system wherein there is to be data loaded for use, said system having at least one computing device communicatively coupled with a large dataset, said large dataset having at least one storage device, said at least one storage device containing one or more data files, said data files containing real-world entity data, said computing device having a Extraction Load Program (ETL) program to subject the data intended to be loaded to a transform stage according to data-warehouse-specific rules, a method of loading data into a data-warehouse system, comprising the step of:
A data-warehouse system wherein there is to be data loaded for use, said system having at least one computing device communicatively coupled with a large dataset, said large dataset having at least one storage device, said at least one storage device containing one or more data files, said data files containing real-world entity data, said computing device having a Extraction Load Program (ETL) program to subject the data intended to be loaded to a transform stage according to data-warehouse-specific rules, a method of loading data into a data-warehouse system, comprising:
A method for deciding when to overwrite an existing record in a in a data-warehouse system for which there is to be data loaded or restored for use, comprising the steps of:
Dependencies are inferred from the claim text.