Back to results
US 11,768,851 B2Granted
Systems and methods for facilitating data transformation
AssigneePalantir Technologies Inc.
InventorsJoel Ossher, David Xiao
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for facilitating the transformation of data from a tabular data set organized according to a data schema to an object based data set organized according to data ontology. The data schema and the data ontology may be used to generate a custom coding language suitable for facilitating the creation of a transform script. Error checking, type checking, autocomplete, and preview tools may be provided to permit the verification of the transform script as it is created.
Claims16
A system for performing an integration of an origin data set into a target data set, the system comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the system to:
- receive the origin data set, the origin data set being organized according to an origin data set schema specifying a format for data of the origin data set;
- receive a target data set ontology, the target data set ontology defining data objects of the target data set;
- generate, according to the origin data set schema and the target data set ontology, a transform language according to the origin data set schema and the target data set ontology, wherein the receiving or generating of the transform code comprises:
- receiving an input of a portion of the transform code;
- determining that the portion of the transform code references the origin data set schema or the target data set ontology;
- automatically generating one or more words, phrases, or calls to functions or operations that reference the origin data set schema or the target data set ontology;
- receiving a selection of a word, phrase, or call from the one or more words, phrases, or calls;
- and
- appending the selection into the portion of the transform code;
- receive or generate transform code according to the transform language according to the origin data set schema and the target data set ontology;
- integrate the origin data set into the target data set according to the received transform code to generate the target data set;
- receive an indication of a change in the origin data set;
- and
- generate a portion of the target dataset corresponding to the change in the origin data set according to the transform code.
14 more elements
A computer-implemented method comprising:
- receiving an origin data set, the origin data set being organized according to an origin data set schema specifying a format for data of the origin data set;
- receiving a target data set ontology, the target data set ontology defining data objects of a target data set;
- generating, according to the origin data set schema and the target data set ontology, a transform language according to the origin data set schema and the target data set ontology;
- receiving or generating transform code according to the transform language according to the origin data set schema and the target data set ontology, wherein the receiving or generating of the transform code comprises:
- receiving an input of a portion of the transform code;
- determining that the portion of the transform code references the origin data set schema or the target data set ontology;
- automatically generating one or more words, phrases, or calls to functions or operations that reference the origin data set schema or the target data set ontology;
- receiving a selection of a word, phrase, or call from the one or more words, phrases, or calls;
- and
- appending the selection into the portion of the transform code;
- integrating the origin data set into the target data set according to the received transform code to generate the target data set;
- receiving an indication of a change in the origin data set;
- and
- generating a portion of the target dataset corresponding to the change in the origin data set according to the transform code.
11 more elements
A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform a method of integrating an origin data set into a target data set, the method comprising:
- receiving an origin data set, the origin data set being organized according to an origin data set schema specifying a format for data of the origin data set;
- receiving a target data set ontology, the target data set ontology defining data objects of a target data set;
- generating, according to the origin data set schema and the target data set ontology, a transform language according to the origin data set schema and the target data set ontology;
- receiving or generating transform code according to the transform language according to the origin data set schema and the target data set ontology, wherein the receiving or generating of the transform code comprises:
- receiving an input of a portion of the transform code;
- determining that the portion of the transform code references the origin data set schema or the target data set ontology;
- automatically generating one or more words, phrases, or calls to functions or operations that reference the origin data set schema or the target data set ontology;
- receiving a selection of a word, phrase, or call from the one or more words, phrases, or calls;
- and
- appending the selection into the portion of the transform code;
- integrating the origin data set into the target data set according to the received transform code to generate the target data set;
- receiving an indication of a change in the origin data set;
- and
- generating a portion of the target dataset corresponding to the change in the origin data set according to the transform code.
11 more elements
Dependencies are inferred from the claim text.