Source to target automated comparison
AssigneeUnited Services Automobile Association (USAA)
InventorsRyan Christopher Crenwelge, Hima Bindu Naga Dadireddy, Narendra Reddy Korisapati, Margaret A. Lynch, Kerry Zeng
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to methods and systems for providing validation of transformed electronic data. A source to target comparison service identifies testing configuration parameters and performs a comparison between source and target electronic data to identify anomalies for each transformed data item in the target automated comparison.
Claims20
A tangible, non-transitory, computer-readable medium comprising instructions that, when executed by one or more processors of a computer, cause the computer to:
- receive one or more test properties configuration files;
- extract one or more test properties from the one or more test properties configuration files, by parsing the one or more test properties configuration files, wherein the one or more test properties comprise:
- a source query, a target query, a key, and values;
- access a source data store identified in the one or more test properties;
- retrieve a source data set from the source data store based upon the source query;
- generate, from the source data set, a source universal data structure, comprising a source key value and associated source column data that is associated with the source key value, by:
- generating and inserting into a row of the source universal data structure the source key value by merging data that is in a common row of the source data set and is in columns of the source data set specified in the key;
- and
- inserting into the row of the source universal data structure, the associated source column data;
- access a target data store identified in the one or more test properties;
- retrieve a target data set from the target data store based upon the target query;
- generate, from the target data set, a target universal data structure, comprising a target key value and associated target column data that is associated with the target key value, by:
- generating and inserting into a row of the target universal data structure the target key value by merging data that is in a common row of the target data set and is in columns of the target data set specified in the key;
- and
- inserting into the row of the target universal data structure, the associated target column data;
- perform a validation test of all of the target data set in accordance with the one or more test properties, by comparing the row of the source universal data structure with the row of the target universal data structure to identify key mismatches, data mismatches associate with the key, or both;
- and
- transmit an electronic indication of results of the validation test to a reporting electronic device.
A computer-implemented method, comprising:
- receiving one or more test properties configuration files, comprising one or more test properties, comprising:
- a source query, a target query, a key, and values;
- accessing a source data store identified in the one or more test properties;
- retrieving a source data set from the source data store based upon the source query;
- generating, from the source data set, a source universal data structure, comprising a source key value and associated source column data that is associated with the source key value, by:
- generating and inserting into a row of the source universal data structure the source key value by merging data that is in a common row of the source data set and is in columns of the source data set specified in the key;
- and
- inserting into the row of the source universal data structure, the associated source column data;
- accessing a target data store identified in the one or more test properties;
- retrieving a target data set from the target data store based upon the target query;
- generate, from the target data set, a target universal data structure, comprising a target key value and associated target column data that is associated with the target key value, by:
- generating and inserting into a row of the target universal data structure the target key value by merging data that is in a common row of the target data set and is in columns of the target data set specified in the key;
- and
- inserting into the row of the target universal data structure, the associated target column data;
- performing a validation test of all of the target data set in accordance with the one or more test properties, by comparing the row of the source universal data structure with the row of the target universal data structure to identify key mismatches, data mismatches associate with the key, or both;
- and
- transmitting an electronic indication of results of the validation test to a reporting electronic device.
A computer-implemented system, comprising:
- a configuration parser, comprising a first at least one hardware-based processor configured to:
- receive one or more test properties configuration files;
- and
- extract one or more test properties from the one or more test properties configuration files, by parsing the one or more test properties configuration files, wherein the one or more test properties comprise:
- a source query, a target query, a key, and values;
- a source data access object (DAO) configured to:
- access a source data store identified in the one or more test properties;
- retrieve a source data set from the source data store based on the source query;
- and
- generate, from the source data set, a source universal data structure, comprising a source key value and associated source column data that is associated with the source key value, by:
- generating and inserting into a row of the source universal data structure the source key value by merging data that is in a common row of the source data set and is in columns of the source data set specified in the key;
- and
- inserting into the row of the source universal data structure, the associated source column data;
- a target data access object (DAO) configured to:
- access a target data store identified in the one or more test properties;
- retrieve a target data set from the target data store based upon the target query;
- and
- generate, from the target data set, a target universal data structure, comprising a target key value and associated target column data that is associated with the target key value, by:
- generating and inserting into a row of the target universal data structure the target key value by merging data that is in a common row of the target data set and is in columns of the target data set specified in the key;
- and
- inserting into the row of the target universal data structure, the associated target column data;
- a validation engine, comprising a second at least one processor that is the same or different than the first at least one processor, where the second at least one processor is configured to:
- perform a validation test of all of the target data set in accordance with the one or more test properties, by comparing the row of the source universal data structure with the row of the target universal data structure to identify key mismatches, data mismatches associate with the key, or both;
- and
- a report utility, comprising a third at least one processor that is the same or different than the first at least one processors and the second at least one processor, wherein the third at least one processor is configured to:
- transmit an electronic indication of results of the validation test to a reporting electronic device.
Dependencies are inferred from the claim text.