# US 2021/0064645 A1 · Data communications between parties

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0064645 A1
- Document ID: US20210064645A1
- Status: Published application
- Kind: A1
- Application number: 17/010,187
- Filed: 2020-09-02
- Published: 2021-03-04
- Earliest claimed: 2019-09-02
- Assignees: Palantir Technologies Inc.
- Applicants: Palantir Technologies Inc.
- Inventors: Francisco Ferreira; Ryan Norris; Viktor Nordling; Kelvin Lau
- Web page: https://patentgrep.com/patent/US20210064645A1

## CPC

- G06F 16/258: {Data format conversion from or to a database}
- G06F 16/367: {Ontology}
- G06F 16/176: Support for shared access to files; File sharing support
- G06F 16/182: Distributed file systems
- G06F 16/215: Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
- G06F 16/254: {Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method, performed by one or more processors, is disclosed, comprising providing, to a plurality of parties permitted to communicate data via a shared database, an ontology application associated with a common core ontology, the core ontology defining constraints required to be met for producing, from one or more received datasets, one or more data objects for storing in the shared database. The ontology application may be configured to receive one or more datasets from one or more parties and to use the core database ontology to determine if the received one or more datasets conform to the constraints of the core ontology, and store the received one or more datasets as data objects in the shared database, conditional on the constraints being met.

## Claims

### Claim 1

A method, performed by one or more processors, comprising:
providing, to a plurality of parties permitted to communicate data via a shared database, an ontology application associated with a common core ontology, the core ontology defining constraints required to be met for producing, from one or more received datasets, one or more data objects for storing in the shared database, the ontology application being configured to:
receive one or more datasets from one or more parties;
use the core database ontology to:
determine if the received one or more datasets conform to the constraints of the core ontology; and
store the received one or more datasets as data objects in the shared database, conditional on the constraints being met.

### Claim 2 (depends on 1)

The method of claim 1, further comprising providing the core ontology to the plurality of parties.

### Claim 3 (depends on 1)

The method of claim 1, wherein the core ontology further defines one or more data verification tests for the one or more received datasets, wherein the ontology application is further configured to:
perform the one or more data verification tests on the one or more received datasets to identify erroneous data; and
generate and provide to said one or more parties an indication of any constraints not being met and/or erroneous data for the received one or more datasets.

### Claim 4 (depends on 3)

The method of claim 3, wherein the core database ontology comprises a data definition language (DDL) defining the constraints and wherein the one or more data verification tests comprise one or more scripts encoded within the DDL which are run by the ontology application.

### Claim 5 (depends on 4)

The method of claim 4, wherein the one or more scripts are run periodically by the ontology application according to a schedule.

### Claim 6 (depends on 2)

The method of claim 2, wherein the one or more data verification tests comprise one or more data health checks to determine, for a received dataset comprising rows and columns of data items, a number of data items in the rows and/or columns determined as unhealthy based on health check criteria in the core ontology, the indication of the erroneous data being based on the number of unhealthy data items in one or more rows and/or columns.

### Claim 7 (depends on 6)

The method of claim 6, wherein the indication of erroneous data is based on the proportion of the number of unhealthy data items in the one or more rows and/or columns to the total number of data items in the corresponding row and/or column.

### Claim 8 (depends on 7)

The method of claim 7, wherein the health check criteria is based on the number of nulls and/or an incorrect format of data items in the received one or more rows and/or columns.

### Claim 9 (depends on 6)

The method of claim 6, wherein the ontology application is configured to prevent creation and/or storage of at least some of the data objects or the received one or more datasets in the shared database if the number or the proportion of unhealthy data items in a row or column exceeds a predetermined threshold.

### Claim 10 (depends on 1)

The method of claim 1, wherein the ontology application is configured only to treat raw datasets as acceptable input to the database ontology.

### Claim 11 (depends on 1)

The method of claim 1, wherein the ontology application is configured, responsive to detecting one or more constraints not being met, to run one or more fixing algorithms automatically to fix non-compliant data items of the dataset, and to fix at least one non-complying data item in the non-complying dataset so that it complies with the core database ontology.

### Claim 12 (depends on 1)

The method of claim 1, further comprising receiving a request from a party to extend the core ontology by means of adding one or more specified data objects and/or data object fields, validating the request based on a number of prior uses of the data objects and/or data object fields in the request, and responsive to a positive validation, updating the core ontology.

### Claim 13 (depends on 12)

The method of claim 12, wherein validating is based on the number of prior uses of the data objects and/or data object fields in the request from a plurality of different party types.

### Claim 14 (depends on 13)

The method of claim 13, wherein positive validation requires determined use by a plurality of data consumer parties and a plurality data producer parties.

### Claim 15 (depends on 1)

The method of claim 1, wherein the ontology application is further configured to prevent non-compliant data from being propagated to one or more further dataset transformations.

### Claim 16 (depends on 1)

The method of claim 1, wherein the ontology application is further configured to permit user-definition of a customized ontology and to permit data complying with the core ontology to be applied to the customized ontology, which customized ontology defines constraints for one or more data objects not in the core ontology.

### Claim 17 (depends on 1)

The method of claim 1, wherein the core ontology and ontology application is provided to a plurality of parties of the shared database in a single file.

### Claim 18

A method, performed by one or more processors, the method being performed at a processing terminal which uses an ontology application and an associated core ontology for producing a plurality of data objects for communicating with one or more other parties via a shared database, the core ontology defining constraints required to be met for producing, from one or more received datasets, one or more data objects for storing in the shared database, the method comprising
receiving one or more datasets for sending to a shared database;
determining if the received one or more datasets conform to the constraints of the core ontology; and
storing the received one or more datasets as data objects in the shared database, conditional on the constraints being met.

### Claim 19

A computer program embedded in a non-transitory computer readable medium, which, when executed by one or more processors of a data processing apparatus cause the data processing apparatus to carry out a method according to any preceding claim.
