Horizontal skimming of composite datasets
AssigneeOath Inc.
InventorsGeorge ALEKSANDROVICH, Allie K. WATFA, Robin SAHNER, Mike PIPPIN
Life of this patent
Estimating the term…
Abstract
Disclosed are embodiments for horizontally skimming composite datasets. In one embodiment, a method is disclosed comprising receiving a script, the script including commands to access a composite dataset; pre-processing the script to identify a set of columns; loading a metadata file associated with the composite dataset file; parsing the metadata file to identify one or more datasets that include a column in the set of columns; loading data from the one or more datasets; and executing the script on the one or more datasets
Claims20
A method comprising:
- receiving, by a processor, a script, the script including commands to access a composite dataset;
- pre-processing, by the processor, the script to identify a set of columns;
- loading, by the processor, a metadata file associated with the composite dataset file;
- parsing, by the processor, the metadata file to identify one or more datasets that include a column in the set of columns;
- loading, by the processor, data from the one or more datasets;
- and
- executing, by the processor, the script on the one or more datasets.
A non-transitory computer-readable storage medium for tangibly storing computer program instructions capable of being executed by a computer processor, the computer program instructions defining the steps of:
- receiving a script, the script including commands to access a composite dataset;
- pre-processing the script to identify a set of columns;
- loading a metadata file associated with the composite dataset file;
- parsing the metadata file to identify one or more datasets that include a column in the set of columns;
- loading data from the one or more datasets;
- and
- executing the script on the one or more datasets.
An apparatus comprising:
- a processor;
- and
- a storage medium for tangibly storing thereon program logic for execution by the processor, the stored program logic causing the processor to perform the operations of:
- receiving a script, the script including commands to access a composite dataset;
- pre-processing the script to identify a set of columns;
- loading a metadata file associated with the composite dataset file;
- parsing the metadata file to identify one or more datasets that include a column in the set of columns;
- loading data from the one or more datasets;
- and
- executing the script on the one or more datasets.
Dependencies are inferred from the claim text.