Systems and methods for analysis of data at disparate data sources
AssigneeTIBCO Software Inc.
InventorsSteven Hillion, Yi-Ling Chen, Zhe Dong, Yong-Sheng Yu, Yong Zhao
Life of this patent
Estimating the term…
Abstract
Embodiments are described for a system and method to analyze data at a plurality of data sources. A data analytic workflow may be received. The data analytic workflow may include at least one operation to be performed on a plurality of data sets stored at a plurality of data sources. Instructions may be created based on the operation to be performed and a type of platform that operates the data sources. Furthermore, the instructions may be transmitted to the data sources such that the data sources may execute the operations on the data sets stored at the data sources.
Claims22
A method to perform an analysis of a plurality of data sets stored at a plurality of data sources, the method comprising:
- generating a graphical user interface that specifies a first remote data source and a plurality of operations that can be performed on a first data set and that specifies a second remote data source and another plurality of operations that can be performed on a second data set, wherein the first data source is of a first platform type and the second data source is of a second platform type, the first platform type being different than the second platform type;
- generating a workflow that identifies the first remote data source and the second remote data source, an operation to combine, at the second data source running the second platform type, the first data set and the second data set that are stored at different data sources running different platform types, and at least one other operation;
- receiving the workflow;
- dynamically determining whether to translate the workflow;
- in response to a determination to dynamically translate the workflow, translating the workflow into a set of instructions, wherein the translating is at least partially based on a platform type of the second data source at which the operation to combine is performed;
- and
- transmitting the first data set stored at the first remote data source and the set of instructions to the second remote data source at which the first data set and the second data set are combined after the first data set being transmitted to the second remote data source;
- wherein the at least one other operation is a modeling algorithm operation, model validation operation, prediction operation, sampling operations, or any combination thereof.
A system for analyzing a plurality of data sets stored at a plurality of data sources, the system comprising:
- one or more processors;
- and
- a non-transitory computer-readable medium storing a processor-based application, which when executed on a computer, will cause the one or more processors to:
- generate a graphical user interface that specifies a first remote data source and a plurality of operations that can be performed on a first data set and that specifies a second remote data source and another plurality of operations that can be performed on a second data set, wherein the first data source is of a first platform type and the second data source is of a second platform type, the first platform type being different than the second platform type;
- generate a workflow that identifies the first remote data source and the second remote data source, an operation to combine, at the second data source running the second platform type, the first data set and the second data set that are stored at different data sources running different platform types, and at least one other operation;
- receive the workflow;
- dynamically determining whether to translate the workflow;
- in response to a determination to translate the workflow, translating the workflow into a set of instructions, wherein the translating is at least partially based on a platform type of the second data source at which the operation to combine is performed;
- and
- transmit the first data set stored at the first remote data source and the set of instructions to the second remote data source at which the first data set and the second data set are combined after the first data set being transmitted to the second remote data source;
- wherein the at least one other operation is a modeling algorithm operation, model validation operation, prediction operation, sampling operations, or any combination thereof.
A computer program product, comprising a non-transitory computer readable medium carrying one or more sequences of instructions to analyze a plurality of data sets stored at a plurality of data sources which, when executed by one or more processors, causes the one or more processors to carry out the steps of:
- generating a graphical user interface that specifies a first remote data source and a plurality of operations that can be performed on a first data set and that specifies a second remote data source and another plurality of operations that can be performed on the second data set, wherein the first data source is of a first platform type and the second data source is of a second platform type, the first platform type being different than the second platform type;
- generating a workflow that identifies the first remote data source and the second remote data source, an operation to combine, at the second data source running the second platform type, the first data set and the second data set that are stored at different data sources running different platform types, and at least one other operation;
- receiving the workflow;
- dynamically determining whether to translate the workflow;
- in response to a determination to dynamically translate the workflow, translating the workflow into a set of instructions, wherein the translating is at least partially based on a platform type of the second data source at which the operation to combine is performed;
- and
- transmitting the first data set stored at the first remote data source and the set of instructions to the second remote data source at which the first data set and the second data set are combined after the first data set being transmitted to the second remote data source;
- wherein the at least one other operation is a modeling algorithm operation, model validation operation, prediction operation, sampling operations, or any combination thereof.
Dependencies are inferred from the claim text.