US 11,238,019 B2Granted

Distributed database systems partition merge

AssigneeMicrosoft Technology Licensing, LLC

InventorsBhalakumaaran Erode Ranganathan, Pankaj Sharma, Padma Priya Aradhyula Bhavani, Harini Chintapally, Krishna Pradeep Reddy Tamma, Bhavya Malik, Rama Krishnan Raghupathy, Ailidani Ailijiang

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

Partitions are enabled to be merged in storage device of distributed database systems. A request to merge a plurality of source partitions into a merged partition is received. Each source partition stores a plurality of data items having corresponding source global identifiers and corresponding source local identifiers. The data items, with corresponding metadata, are appended from the source partitions to an intermediate storage structure in an order defined by the source local identifiers. Target global identifiers and target local identifiers are generated for each of the data items in the intermediate storage structure. The copied data items are flushed from the intermediate storage structure to the merged partition in an order defined by the target global identifiers. The source partitions and intermediate storage structure may then be purged of data, removed, and/or reused for further storage needs.

Claims20

Dependent claims

A storage device, comprising:

at least one processor circuit;
at least one memory that stores program code configured to be executed by the at least one processor circuit, the program code comprising:
a partition merge manager configured to perform a merge a plurality of source partitions into a merged partition, each source partition storing a plurality of data items having corresponding source global identifiers and corresponding source local identifiers, the partition merge manager comprising:
an append manager configured to append the data items from the plurality of source partitions to an intermediate storage structure in an order defined by the source local identifiers, the data items appended to the intermediate storage structure with corresponding metadata, the append manager including
a target identifier generator configured to generate target global identifiers and target local identifiers, including generating a target global identifier and a target local identifier for each data item of the data items in the intermediate storage structure;
a flush manager configured to flush the appended data items from the intermediate storage structure to the merged partition in an order defined by the target global identifiers, the flush manager enabling the unused storage space of the plurality of source partitions and the intermediate storage structure to be reclaimed.

3 more elements

A method in a storage device, comprising:

receiving a request to merge a plurality of source partitions into a merged partition, each source partition storing a plurality of data items having corresponding source global identifiers and corresponding source local identifiers;
appending the data items from the plurality of source partitions to an intermediate storage structure in an order defined by the source local identifiers, the data items appended to the intermediate storage structure with corresponding metadata;
generating target global identifiers and target local identifiers, said generating including generating a target global identifier and a target local identifier for each data item of the data items in the intermediate storage structure;
flushing the appended data items from the intermediate storage structure to the merged partition in an order defined by the target global identifiers;
and
reclaiming unused storage space of the plurality of source partitions and the intermediate storage structure.

3 more elements

A computer-readable storage medium comprising computer-executable instructions that, when executed by a processor, perform a method comprising:

receiving a request to merge a plurality of source partitions into a merged partition, each source partition storing a plurality of data items having corresponding source global identifiers and corresponding source local identifiers;
appending the data items from the plurality of source partitions to an intermediate storage structure in an order defined by the source local identifiers, the data items appended to the intermediate storage structure with corresponding metadata;
generating target global identifiers and target local identifiers, said generating including generating a target global identifier and a target local identifier for each data item of the data items in the intermediate storage structure;
flushing the appended data items from the intermediate storage structure to the merged partition in an order defined by the target global identifiers;
and
reclaiming unused storage space of the plurality of source partitions and the intermediate storage structure.

3 more elements

Dependencies are inferred from the claim text.