Targeted sweep method for key-value data storage
AssigneePalantir Technologies Inc.
InventorsGrgur Petric Maretic, James Baker, Nathan Ziebart, Sandor Van Wassenhove
Life of this patent
Estimating the term…
Abstract
A computer-implemented method for targeted sweep of a key-value data storage is provided. The method comprises before a write transaction to a database having a key value store commits, and before each of one or more write commands of the write transaction are persisted to the key value store, writing an entry for each of the one or more write commands to an end of a targeted sweep queue, the entry comprising metadata including: data identifying a cell to which the write command relates, a start timestamp of the write transaction, and information identifying a type of the write transaction.
Claims18
A computer-implemented method comprising:
- writing first entries corresponding to write commands of a write transaction to a targeted sweep queue in a database, wherein each entry from the first entries comprises metadata including:
- data identifying a cell to which a write command of the write commands relate, and
- a timestamp of the write transaction;
- performing the targeted sweep of the database by deleting previous versions of cells associated with second entries, the second entries being selected from the first entries based on respective timestamps of the second entries;
- determining whether an additional entry within a range of the timestamps has been written and persisted into the database;
- and
- in response to determining that the additional entry has been written and persisted into the database, deleting any remaining entries prior to the additional entry.
A system comprising:
- one or more physical processors;
- a memory storing instructions that, when executed by the one or more physical processors, cause the system to:
- write first entries corresponding to write commands of a write transaction to a targeted sweep queue in a database, wherein each entry from the first entries comprises metadata including:
- data identifying a cell to which a write command of the write commands relate, and
- a timestamp of the write transaction;
- perform the targeted sweep of the database by deleting previous versions of cells associated with second entries, the second entries being selected from the first entries based on respective timestamps of the second entries;
- determine whether an additional entry within the range of the timestamps has been written and persisted into the database;
- and
- in response to determining that the additional entry has been written and persisted into the database, delete any remaining entries prior to the additional entry.
A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:
- writing first entries corresponding to write commands of a write transaction to a targeted sweep queue in a database, wherein each entry from the first entries comprises metadata including:
- data identifying a cell to which a write command of the write commands relate, and
- a timestamp of the write transaction;
- and
- performing the targeted sweep of the database by deleting previous versions of cells associated with second entries, the second entries being selected from the first entries based on respective timestamps of the second entries;
- determining whether an additional entry within a range of the timestamps has been written and persisted into the database;
- and
- in response to determining that the additional entry has been written and persisted into the database, deleting any remaining entries prior to the additional entry.
Dependencies are inferred from the claim text.