# US 2014/0156591 A1 · Knowledge catalysts > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0156591 A1 - Document ID: US20140156591A1 - Status: Published application - Kind: A1 - Application number: 14/089,395 - Filed: 2013-11-25 - Published: 2014-06-05 - Earliest claimed: 2012-12-03 - Assignees: UT-Battelle, LLC - Applicants: UT-Battelle, LLC - Inventors: Sreenivas R. Sukumar; Regina K. Ferrell; Mallikarjun Shankar - Web page: https://patentgrep.com/patent/US20140156591A1 ## CPC - G06F 16/254: {Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A computer implemented method integrates data from remote disparate data sources by processing a non-transitory media. The non-transitory media stores instructions for detecting data sets in different formats hosted in a plurality of heterogeneous databases that are accessible through a distributed network. The method extracts schema data from the plurality of heterogeneous databases and identifies related fields in two or more of the heterogeneous databases. The method links the related fields in the two or more of the plurality of heterogeneous databases and makes the data accessible through a virtual warehouse. As schemas change, as new data sources and analysis artifacts are created, the computer implemented method and system can act as a meta-data store, a provenance tracking device, and/or a knowledge management service. ## Claims ### Claim 1 A computer implemented method of integrating data from remote disparate data sources comprising a non-transitory media, comprising programming for: detecting data sets in different formats hosted in a plurality of heterogeneous databases accessible through infrastructures that are coupled through a distributed network; extracting schema data of the plurality of heterogeneous databases; identifying related fields in two or more of the plurality of heterogeneous databases; and linking the related fields in the two or more of the plurality of heterogeneous databases through a virtual warehouse. ### Claim 2 (depends on 1) The computer implemented method of claim 1 further comprising displaying visual representations of the relationship links of the related fields. ### Claim 3 (depends on 1) The computer implemented method of claim 1 further comprising capturing and publishing collaborative discussions about the data associated with the related fields. ### Claim 4 (depends on 1) The computer implemented method of claim 1 further comprising scraping the schema data from the plurality of heterogeneous databases and generating a metadata repository. ### Claim 5 (depends on 1) The computer implemented method of claim 1 where the identification of the related fields occurs through a fuzzy logic. ### Claim 6 (depends on 1) The computer implemented method of claim 1 further comprising displaying visual representations of the relationship links of the related fields and a user interface that allows a user to confirm or reject one or more of the relationship links. ### Claim 7 (depends on 1) The computer implemented method of claim 1 further comprising automatically identifying a plurality of crosswalk keys for identifying common fields in the plurality of heterogeneous databases. ### Claim 8 (depends on 1) The computer implemented method of claim 1 further comprising scraping the schema data from the plurality of heterogeneous databases and generating a metadata repository and a data level matching. ### Claim 9 (depends on 1) The computer implemented method of claim 1 further comprising generating profiles and histogram distributions of a random sample of data sampled from the plurality of heterogeneous databases before identifying the related fields of the databases. ### Claim 10 (depends on 1) The computer implemented method of claim 1 further comprising displaying visual representations of the relationship links of the related fields on a touch sensitive display programmed to accept the linking of the related fields if a user contact is detected that corresponds to a predefined gesture. ### Claim 11 (depends on 1) The computer implemented method of claim 1 further comprising displaying visual representations of the relationship links of the related fields on a touch sensitive display programmed to reject the linking of the related fields if a user contact is detected that corresponds to a predefined gesture. ### Claim 12 A unified data integration system, comprising: one or more processors; a memory; and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: detecting data sets hosted in a plurality of heterogeneous databases that are coupled through a distributed network; extracting schema data from the plurality heterogeneous databases; generating profiles and histogram distributions of a random sample of data sampled from the plurality of heterogeneous databases; generating schema-level hypotheses that makes content connections between data sources accessed from at least two of the plurality heterogeneous databases; and validating at least some of the schema-level hypotheses through a user interface. ### Claim 13 (depends on 12) The unified data integration system of claim 12 further comprising displaying visual representations of the schema-level hypotheses. ### Claim 14 (depends on 12) The unified data integration system of claim 12 further comprising capturing and publishing collaborative information about the data associated with the related fields. ### Claim 15 (depends on 12) The unified data integration system of claim 12 further comprising instructions for scraping the schema data from the plurality of heterogeneous databases and generating a metadata repository. ### Claim 16 (depends on 12) The unified data integration system of claim 12 where the generating schema-level hypotheses occurs through instructions that execute a fuzzy logic matching process. ### Claim 17 (depends on 12) The unified data integration system of claim 12 further comprising displaying visual representations of the schema-level hypotheses and a gesture control user interface that allows a user to confirm or reject one or more of the schema-level hypotheses in response to a gesture. ### Claim 18 A method for analyzing a large data set from disparate sources using a computer, the method comprising: building a virtual schema of the data set in a memory of the computer; linking potential data elements; and displaying the data set visually on a monitor of the computer as an interconnected plurality of databases and tables. ### Claim 19 (depends on 18) The method of claim 18 and further comprising analyzing the displayed data set to find relationships across databases and tables. ### Claim 20 (depends on 18) The method of claim 18 further comprising generating profiles and histograms distributions of a random sample of data sampled from a plurality of heterogeneous databases.