Systems and methods for facilitating data transformation
AssigneePalantir Technologies Inc.
InventorsJoel Ossher, David Xiao
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for facilitating the transformation of data from a tabular data set organized according to a data schema to an object based data set organized according to data ontology. The data schema and the data ontology may be used to generate a custom coding language suitable for facilitating the creation of a transform script. Error checking, type checking, autocomplete, and preview tools may be provided to permit the verification of the transform script as it is created.
Claims20
A system for performing an integration of an origin data set into a target data set, the system comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the system to:
- receive the origin data set, the origin data set being organized according to an origin data set schema specifying a format for data of the origin data set;
- receive a target data set ontology, the target data set ontology defining data objects of the target data set;
- generate, according to the origin data set schema and the target data set ontology, a transform language specific to the origin data set schema and the target data set ontology;
- receive transform instructions programmed in the transform language specific to the origin data set schema and the target data set ontology;
- analyze the transform instructions to identify one or more errors in the transform instructions, the analysis being performed as the transform instructions are being received;
- and
- integrate, subsequent to a correction of the one or more errors in the transform instructions, at least a portion of the origin data set into the target data set based on the corrected transform instructions.
A computer implemented method of integrating an origin data set into a target data set, the method being performed on a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, cause the computer system to perform the method, the method comprising:
- receiving the origin data set, the origin data set being organized according to an origin data set schema specifying a format for data of the origin data set;
- receiving a target data set ontology, the target data set ontology defining data objects of the target data set;
- generating, according to the origin data set schema and the target data set ontology, a transform language specific to the origin data set schema and the target data set ontology;
- receiving transform instructions programmed in the transform language specific to the origin data set schema and the target data set ontology;
- analyzing the transform instructions to identify one or more errors in the transform instructions, the analysis being performed as the transform instructions are being received;
- and
- integrating, subsequent to a correction of the one or more errors in the transform instructions, at least a portion of the origin data set into the target data set based on the corrected transform instructions.
A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform a method of integrating an origin data set into a target data set, the method comprising:
- receiving the origin data set, the origin data set being organized according to an origin data set schema specifying a format for data of the origin data set;
- receiving a target data set ontology, the target data set ontology defining data objects of the target data set;
- generating, according to the origin data set schema and the target data set ontology, a transform language specific to the origin data set schema and the target data set ontology;
- receiving transform instructions programmed in the transform language specific to the origin data set schema and the target data set ontology;
- analyzing the transform instructions to identify one or more errors in the transform instructions, the analysis being performed as the transform instructions are being received;
- and
- integrating, subsequent to a correction of the one or more errors in the transform instructions, at least a portion of the origin data set into the target data set based on the corrected transform instructions.
Dependencies are inferred from the claim text.