Back to results
US 12,585,397 B1Granted
Dynamically partition data
AssigneeAmazon Technologies, Inc.
InventorsYasaswi Vempati, Michael George Clarke, Jake Johnathan Ursetta
Life of this patent
Estimating the term…
Abstract
Techniques and systems can partition data with a partition key to provide data partitioned based on the partition key. Data writes to the data partitioned based on the partition key can be analyzed to identify a predicate shared by at least a plurality of the data writes. That predicate can be used to reparation the data to generate other partitioned data or to replace the data partitioned based on the partition key.
Claims16
A computer-implemented method, comprising:
- storing, by a computer-implemented system, data comprising columns of data, each column of data having an associated column identifier;
- generating, by the computer-implemented system, a partition key based on a first column identifier of the column identifiers associated with the columns of data;
- partitioning, by the computer-implemented system, the data based on the partition key;
- analyzing, by the computer-implemented system, aggregated data write information associated with data writes to the partitioned data based on the partition key to identify a write predicate common to at least a plurality of the data writes;
- determining, by the computer-implemented system, a percentage based on a number of times the write predicate was determined to be associated with the data write information within a predetermined duration;
- determining, by the computer-implemented system, the percentage satisfies a percentage threshold;
- determining, by the computer-implemented system, the write predicate corresponds to a second column identifier of the column identifiers associated with the columns of data;
- generating, by the computer-implemented system, another partition key based on the second column identifier;
- based on determining the percentage satisfies the percentage threshold, partitioning, by the computer-implemented system, the data based on the generated another partition key to generate partitioned data based on the generated another partition key;
- and
- writing, by the computer-implemented system, data to the data partitioned based on the generated another partition key.
8 more elements
A system, comprising:
- one or more processors;
- and
- memory that stores computer-executable instructions that are executable by the one or more processors to cause the system to:
- analyze data write information, stored in computer-implemented storage, associated with data written to data partitioned based on a first partition key to identify a predicate common among at least a plurality of data writes to the partitioned data;
- analyze the data write information to determine a percentage corresponding to a determined number of times the predicate was found to be associated with the plurality of data writes to computer-implemented storage over a predetermined duration;
- and
- based on determining the percentage satisfies a percentage threshold:
- generate a second partition key using the predicate, and
- partition the data using the second partition key;
- write data to the data portioned using the second partition key.
7 more elements
A system, comprising:
- one or more processors;
- and
- memory that stores computer-executable instructions that are executable by the one or more processors to cause the system to:
- partition data, associated with computer-implemented storage, with a partition key to provide data partitioned based on the partition key;
- analyze data writes to the data partitioned based on the partition key to determine a predicate common to least a plurality of the data writes;
- determine a percentage based on a number of times the predicate was found to be associated with the data writes over a predetermined duration;
- determine the percentage satisfies a percentage threshold;
- based on determining the percentage satisfies the percentage threshold, partition the data based on the predicate;
- and
- write data to the data partitioned based on the predicate.
7 more elements
Dependencies are inferred from the claim text.