Automated Adaptive Data Analysis Using Dynamic Data Quality Assessment

An apparatus for automated adaptive data analysis, the apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

• generate, using a predictive model, a judgment associated with a new data sample having a particular data type, wherein the new data sample is collected from a data stream;
• analyze the new data sample based in part on the judgment and on reservoir summary statistics associated with a reservoir of data samples identified based at least in part on the particular data type;
• determine whether to add the new data sample and the associated judgment to the reservoir of data samples in response to receiving a data quality estimate for the new data sample from an oracle;
• and
• in an instance in which the new data sample and its judgment are added to the reservoir of data, update the reservoir summary statistics.

A system, comprising:

• one or more computers and one or more storage devices, the one or more computers each comprising a processor, the one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to:
• generate, using a predictive model, a judgment associated with a new data sample having a particular data type wherein the new data sample is collected from a data stream;
• analyze the new data sample based in part on the judgment and on reservoir summary statistics associated with a reservoir of data samples identified based at least in part on the particular data type;
• determine whether to add the new data sample and the associated judgment to the reservoir of data samples in response to receiving a data quality estimate for the new data sample from an oracle;
• and
• in an instance in which the new data sample and its judgment are added to the reservoir of data, update the reservoir summary statistics.