US 10,949,089 B2Granted

Reconfiguring data objects using batch processing of concatenated components

AssigneeVMware, Inc.

InventorsVarun Shah, Mansi Shah, Vishnu Rajula

Life of this patent

Estimating the term…

Loading patent…

Abstract

The disclosure herein describes reconfiguring a data object in a data store using batch portions of components of the data object. Instructions to reconfigure the data object to a target object layout are received, the data object including a concatenation layer that references a plurality of components. The components are grouped into batch portions and the batch portions are reconfigured in a series based on the received instructions. The reconfiguring for each batch portion includes allocating free storage space according to the target object layout as target components, copying the data stored in the batch portion to the target components, redirecting references in the concatenation layer from the components of the batch portion to the target components, and releasing storage space occupied by the components of the batch portion. As a result, storage space used as transient capacity during the reconfiguring is reduced to a size of the batch portions.

Claims20

Dependent claims

A system for reconfiguring a data object in a data store, the system comprising:

at least one processor;
and
at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the at least one processor to:
receive instructions to reconfigure a data object to a target object layout in the data store, wherein the data object includes a concatenation layer that has references to a plurality of storage components, wherein each storage component of the plurality of storage components is configured to occupy a storage space portion of the data store and to store a portion of data of the data object in the occupied storage space portion;
group the plurality of storage components into one or more batch portions of storage components, wherein a storage space size of each batch portion is based on one or more of the following:
a total transient capacity of the data store indicating an amount of storage capacity that is currently occupied by background processes, a value that is a percentage of total free storage space of the data store, and a background input/output (I/O) bandwidth limit of the data store;
and
reconfigure the one or more batch portions of storage components in a series based on the received instructions, wherein one of the batch portions of storage components is reconfigured at a time, wherein, during reconfiguring of each batch portion of storage components, references of the concatenation layer to the storage components of the batch portion are redirected based on the target object layout,
whereby storage space used as transient capacity during the reconfiguring is reduced to the storage space size of the batch portions.

6 more elements

A computerized method for reconfiguring a data object in a data store, the method comprising:

receiving, by a processor, instructions to reconfigure a data object to a target object layout in the data store, wherein the data object includes a concatenation layer that has references to a plurality of storage components, wherein each storage component of the plurality of storage components is configured to occupy a storage space portion of the data store and to store a portion of data of the data object in the occupied storage space portion;
grouping, by the processor, the plurality of storage components into one or more batch portions of storage components, wherein a storage space size of each batch portion is based on one or more of the following:
a total transient capacity of the data store indicating an amount of storage capacity that is currently occupied by background processes, a value that is a percentage of total free storage space of the data store, and a background input/output (I/O) bandwidth limit of the data store;
and
reconfiguring, by the processor, the one or more batch portions of storage components in a series based on the received instructions, wherein one of the batch portions of storage components is reconfigured at a time, wherein, during reconfiguring of each batch portion of storage components, references of the concatenation layer to the storage components of the batch portion are redirected based on the target object layout,
whereby storage space used as transient capacity during the reconfiguring is reduced to the storage space size of the batch portions.

3 more elements

One or more non-transitory computer storage media having computer-executable instructions for reconfiguring a data object in a data store that, upon execution by a processor, cause the processor to at least:

receive instructions to reconfigure a data object to a target object layout in the data store, wherein the data object includes a concatenation layer that has references to a plurality of storage components, wherein each storage component of the plurality of storage components is configured to occupy a storage space portion of the data store and to store a portion of data of the data object in the occupied storage space portion;
group the plurality of storage components into one or more batch portions of storage components, wherein a storage space size of each batch portion is based on one or more of the following:
a total transient capacity of the data store indicating an amount of storage capacity that is currently occupied by background processes, a value that is a percentage of total free storage space of the data store, and a background input/output (I/O) bandwidth limit of the data store;
and
reconfigure the one or more batch portions of storage components in a series based on the received instructions, wherein one of the batch portions of storage components is reconfigured at a time, wherein, during reconfiguring of each batch portion of storage components, references of the concatenation layer to the storage components of the batch portion are redirected based on the target object layout,
whereby storage space used as transient capacity during the reconfiguring is reduced to the storage space size of the batch portions.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/442,889Filed 17 Jun 2019
Published: US 2020/0393969 A117 Dec 2020
Granted: 16 Mar 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification6 codes

G06F 3/0608
Specifically adapted to achieve a particular effect: saving storage space on storage systems
G06F 3/0683
In-line storage system: plurality of storage devices
G06F 3/0629
Making use of a particular technique: configuration or reconfiguration of storage systems
G06F 3/0631
Configuration or reconfiguration of storage systems: by allocating resources to storage systems