Systems, devices, and methods for data analytics
AssigneeMassachusetts Mutual Life Insurance Company
InventorTimothy Sommers
Life of this patent
Estimating the term…
Abstract
Various systems and methods use a value in a data file for a data process, as the data process is scaled up in terms of dataset dimensionality, data volume, data types, data content, data source quantity, and data source speed, while remaining compliant with ACID principles. As such, these technologies provide for sourcing of data from various data sources, where the data includes the data file storing the value. The data is cleansed and fused, which enables a report to be generated. In response to the value in the data file being modified, the data, inclusive of the data file storing the value, is again cleansed and fused based on the value being modified. This processing in-turn enables the report to modified based on the value being modified.
Claims20
A method comprising:
- sending, by a processor, a multidimensional dataset from a massively parallel processing (MPP) database of a first cloud computing platform (CCP) to an extract, transform, and load (ETL) application of a second CCP;
- sending, by the processor, a first set of datasets and a second set of datasets to the ETL application, wherein the first set of datasets is different from each other in format and content and is sourced from a set of data files external to the first CCP and the second CCP, wherein the set of data files includes a spreadsheet with a cell value, wherein the second set of datasets is sourced from a set of schematically different databases external to the first CCP and the second CCP;
- performing, by the processor, a data cleanse on the multidimensional dataset, the first set of datasets inclusive of the cell value, and the second set of datasets within the ETL application such that a cleansed dataset is generated within the ETL application;
- performing, by the processor, a data fusion on the cleansed dataset within the ETL application such that a fused dataset is generated within the ETL application;
- populating, by the processor, a MPP column-oriented database with the fused dataset sourced from the ETL application;
- generating, by the processor, a report based on the fused dataset sourced from the MPP column-oriented database;
- modifying, by the processor, the cell value in the spreadsheet after the report is generated without modifying the first set of datasets and the second set of datasets;
- updating, by the processor, the fused dataset in the MPP column-oriented database in real-time based on the cell value being modified;
- and
- updating, by the processor, the report in real-time based on the fused dataset in the MPP column-oriented database being updated.
A system comprising:
- a processor programmed to:
- send a multidimensional dataset from a massively parallel processing (MPP) database of a first cloud computing platform (CCP) to an extract, transform, and load (ETL) application of a second CCP;
- send a first set of datasets and a second set of datasets to the ETL application, wherein the first set of datasets is different from each other in format and content and is sourced from a set of data files external to the first CCP and the second CCP, wherein the set of data files includes a spreadsheet with a cell value, wherein the second set of datasets is sourced from a set of schematically different databases external to the first CCP and the second CCP;
- perform a data cleanse on the multidimensional dataset, the first set of datasets inclusive of the cell value, and the second set of datasets within the ETL application such that a cleansed dataset is generated within the ETL application;
- perform a data fusion on the cleansed dataset within the ETL application such that a fused dataset is generated within the ETL application;
- populate a MPP column-oriented database with the fused dataset sourced from the ETL application;
- generate a report based on the fused dataset sourced from the MPP column-oriented database;
- modify the cell value in the spreadsheet after the report is generated without modifying the first set of datasets and the second set of datasets;
- update the fused dataset in the MPP column-oriented database in real-time based on the cell value being modified;
- and
- update the report in real-time based on the fused dataset in the MPP column-oriented database being updated.
Dependencies are inferred from the claim text.