# US 2022/0012223 A1 · Selecting backing stores based on data request

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0012223 A1
- Document ID: US20220012223A1
- Status: Published application
- Kind: A1
- Application number: 17/473,320
- Filed: 2021-09-13
- Published: 2022-01-13
- Earliest claimed: 2017-07-06
- Assignees: Palantir Technologies Inc.
- Applicants: Palantir Technologies Inc.
- Inventors: Christopher Brockington-Hill; Neil Rickards
- Web page: https://patentgrep.com/patent/US20220012223A1

## CPC

- G06F 16/2272: {Management thereof}
- G06F 16/221: {Column-oriented storage; Management thereof}
- G06F 16/245: Query processing
- G06F 16/2453: Query optimisation
- G06F 16/278: {Data partitioning, e.g. horizontal or vertical partitioning}
- G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques for improving database searches are described herein. In an embodiment, a server computer system stores one or more first datasets in a first data repository and one or more second datasets in a second data repository. The server computer receives a request to perform an analysis on a particular dataset. The server computer determines that the particular dataset is stored in the first data repository and the second data repository. Based, at least in part, on an attribute of the request, the server computer selects the second data repository and responds to the request with data from the particular dataset stored in the second data repository.

## Claims

### Claim 1

A computer-implemented method of determining a backing store for responding to a query, comprising:
storing, in a columnar datastore, one or more first datasets;
storing, in an index data repository, indices of one or more second datasets;
receiving a query to perform an analysis on a particular dataset;
determining that the particular dataset is stored in the columnar datastore and an index of the particular dataset is stored in the index data repository;
determining whether a number of rows in the particular dataset is more than a threshold;
in response to determining that the number of rows exceeds the threshold, determining whether the query includes a column aggregation;
in response to determining that the threshold exceeds the number of rows, responding to the query with data from the columnar datastore,
wherein one or more steps is performed by a computer.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining that the particular dataset is not subject to access controls,
the determining of whether the number of rows in the particular dataset is more than the threshold being performed in response to determining that the particular dataset is not subject to access controls.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, further comprising determining that a view of the particular dataset is stored in the index data repository before determining that the particular dataset is not subject to access controls.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising, in response to determining that the query includes a column aggregation, responding to the query with data from the columnar datastore.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising, in response to determining that the query does not include a column aggregation, determining whether the query includes a row filtering condition.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, the row filtering condition specifying access controls.

### Claim 7 (depends on 5)

The computer-implemented method of claim 5, further comprising:
in response to determining that the query includes a row filtering condition, identifying a second number of rows that match the query based on the index;
when the second number of rows is greater than a second threshold, responding to the query with data from the columnar datastore;
when the second number of rows is lower than the second threshold, responding to the query using the index.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, the second threshold being expressed as a percentage of the number of rows in the particular dataset.

### Claim 9 (depends on 5)

The computer-implemented method of claim 5, further comprising, in response to determining that the query includes a row filtering condition, responding to the query with data from the index data repository.

### Claim 10 (depends on 5)

The computer-implemented method of claim 5, further comprising, in response to determining that the query does not include a row filtering condition, responding to the query with data from the columnar datastore.

### Claim 11

One or more non-transitory computer-readable storage media storing instructions which when executed cause one or more processors to perform a method of determining a backing store for responding to a query, the method comprising:
storing, in a columnar datastore, one or more first datasets;
storing, in an index data repository, indices of one or more second datasets;
receiving a query to perform an analysis on a particular dataset;
determining that the particular dataset is stored in the columnar datastore and an index of the particular dataset is stored in the index data repository;
determining whether a number of rows in the particular dataset is more than a threshold;
in response to determining that the number of rows exceeds the threshold, determining whether the query includes a column aggregation;
in response to determining that the threshold exceeds the number of rows, responding to the query with data from the columnar datastore.

### Claim 12 (depends on 11)

The one or more non-transitory computer-readable storage media of claim 11, the method further comprising:
determining that the particular dataset is not subject to access controls,
the determining of whether the number of rows in the particular dataset is more than the threshold being performed in response to determining that the particular dataset is not subject to access controls.

### Claim 13 (depends on 12)

The one or more non-transitory computer-readable storage media of claim 12, the method further comprising determining that a view of the particular dataset is stored in the index data repository before determining that the particular dataset is not subject to access controls.

### Claim 14 (depends on 11)

The one or more non-transitory computer-readable storage media of claim 11, the method further comprising, in response to determining that the query includes a column aggregation, responding to the query with data from the columnar datastore.

### Claim 15 (depends on 11)

The one or more non-transitory computer-readable storage media of claim 11, the method further comprising, in response to determining that the query does not include a column aggregation, determining whether the query includes a row filtering condition.

### Claim 16 (depends on 15)

The one or more non-transitory computer-readable storage media of claim 15, the row filtering condition specifying access controls.

### Claim 17 (depends on 15)

The one or more non-transitory computer-readable storage media of claim 15, the method further comprising:
in response to determining that the query includes a row filtering condition, identifying a second number of rows that match the query based on the index;
when the second number of rows is greater than a second threshold, responding to the query with data from the columnar datastore;
when the second number of rows is lower than the second threshold, responding to the query using the index.

### Claim 18 (depends on 17)

The one or more non-transitory computer-readable storage media of claim 17, the second threshold being expressed as a percentage of the number of rows in the particular dataset.

### Claim 19 (depends on 15)

The one or more non-transitory computer-readable storage media of claim 15, the method further comprising, in response to determining that the query includes a row filtering condition, responding to the query with data from the index data repository.

### Claim 20 (depends on 15)

The one or more non-transitory computer-readable storage media of claim 15, further comprising, in response to determining that the query does not include a row filtering condition, responding to the query with data from the columnar datastore.
