Multi-layered storage administration for flexible placement of data

A method comprising:

• determining, at a storage administrator, that a condition has occurred requiring transformation of particular data or movement of particular data to one or more new physical locations in a data storage system of a virtualized computer system, the data storage system managing access to the particular data stored in a plurality of storage units, hosted by two or more cloud service providers, at a particular virtual location;
• wherein the particular virtual location, based on one or more object-storage unit mappings, corresponds to prior physical locations comprising a first physical storage location and a second physical storage location, and that the one or more new physical locations comprises the first physical storage location and not the second physical storage location;
• determining that the particular data, based on two or more extent-object mappings, is associated with a particular logical extent including identifying information that associates the particular logical extent to the particular virtual location;
• in response to the determination that the condition has occurred:
• storing data corresponding to the particular data at the one or more new physical locations;
• removing a mapping corresponding to the particular virtual location to indicate that the particular virtual location corresponds to the first physical location instead of the first and second physical locations without updating any extent-object mapping associating the particular logical extent to the particular virtual location;
• wherein the particular data is stored at the particular logical extent corresponding to the particular virtual location;
• updating one or more of:
• the extent-object mappings, which prior to the updating indicated that a particular virtual storage object, comprising a particular set of storage unit portions, stores information belonging to the particular logical extent, to indicate that a different virtual storage object, comprising a different set of storage unit portions corresponding to the one or more new physical locations, stores information belonging to the particular logical extent, or
• the object-storage unit mappings, which prior to the updating indicated that the particular set of storage unit portions belong to the particular virtual storage object, to instead indicate that the different set of storage unit portions, corresponding to the one or more new physical locations, belong to the particular virtual storage object, without a corresponding update to the extent-object mappings;
• wherein each storage unit portion, of the different set of storage unit portions, belongs to a different storage unit of the plurality of storage units;
• wherein the method is performed using one or more computing devices.

A non-transitory computer-readable storage medium comprising one or more sequences of instructions which when executed by one or more processors cause the one or more processors to perform:

• receiving, at a data storage system of a virtualized computer system, the data storage system managing access to data stored in a plurality of storage units hosted by two or more cloud service providers, a request for the data;
• determining that the request requires data associated with a particular logical extent, the particular logical extent including identifying information that associates the particular logical extent to a virtual location at which the data is stored;
• identifying, based on the virtual location at which the data is stored and two or more mappings of virtual locations to object administrators, an object administrator associated with physical storage of the data;
• wherein the virtual location, based on the two or more mappings, corresponds to a first object and a second object;
• removing a mapping from the two or more mappings identifying the second object as corresponding to the virtual location, without a corresponding update to identifying information associating the particular logical extent to the virtual location;
• determining, at the object administrator, based on the two or more mappings, a plurality of physical locations in the data storage system that correspond to the virtual location, the determining the plurality of physical locations comprising:
• determining, one or more objects that correspond to the virtual location in the request and are managed by the object administrator, wherein the one or more objects comprises at least the second object,
• determining, for each object of the one or more objects, a plurality of storage unit portions that belong to the object, and
• wherein each storage unit portion, of the plurality of storage unit portions, belongs to a different storage unit of the plurality of storage units;
• retrieving the data from the plurality of physical locations of the data storage system of the virtualized computer system, wherein each of the plurality of physical locations indicates a storage unit portion in the plurality of storage unit portions.

A non-transitory computer-readable storage medium comprising one or more sequences of instructions which when executed by one or more processors cause the one or more processors to perform:

• determining, at a storage administrator, that a condition has occurred requiring transformation of particular data or movement of particular data to one or more new physical locations in a data storage system of a virtualized computer system, the data storage system managing access to the particular data stored in a plurality of storage units, hosted by two or more cloud service providers, at a particular virtual location;
• wherein the particular virtual location, based on two or more object-storage unit mappings, corresponds to prior physical locations comprising a first physical storage location and a second physical storage location, and that the one or more new physical locations comprises the first physical storage location and not the second physical storage location;
• determining that the particular data, based on two or more extent-object mappings, is associated with a particular logical extent including identifying information that associates the particular logical extent to the particular virtual location;
• in response to the determination that the condition has occurred:
• storing data corresponding to the particular data at the one or more new physical locations;
• removing a mapping corresponding to the particular virtual location to indicate that the particular virtual location corresponds to the first physical location instead of the first and second physical locations without updating any extent-object mapping associating the particular logical extent to the particular virtual location;
• wherein the particular data is stored at the particular logical extent corresponding to the particular virtual location;
• updating one or more of:
• the extent-object mappings, which prior to the updating indicated that a particular virtual storage object, comprising a particular set of storage unit portions, stores information belonging to the particular logical extent, to indicate that a different virtual storage object, comprising a different set of storage unit portions corresponding to the one or more new physical locations, stores information belonging to the particular logical extent, or
• the object-storage unit mappings, which prior to the updating indicated that the particular set of storage unit portions belong to the particular virtual storage object, to instead indicate that the different set of storage unit portions, corresponding to the one or more new physical locations, belong to the particular virtual storage object, without a corresponding update to the extent-object mappings;
• wherein each storage unit portion, of the different set of storage unit portions, belongs to a different storage unit of the plurality of storage units.

A storage administrator apparatus comprising:

• one or more processors;
• an instantiator coupled to the one or more processors and configured to instantiate one or more new storage units of a storage system of a virtualized computer system, the storage system managing access to particular data stored in a plurality of storage units hosted by two or more cloud service providers;
• location information indicating, for each virtual location of a plurality of virtual locations, one or more physical locations corresponding to the virtual location, the plurality of virtual locations including a particular virtual location at which the particular data is stored;
• computer memory coupled to the one or more processors and storing one or more sequences of instructions which when executed by the one or more processors cause:
• determining that a condition requiring transformation of the particular data or movement of particular data to one or more new physical locations has occurred;
• determining that the particular data, based on two or more extent-object mappings, is associated with a particular logical extent including identifying information that associates the particular logical extent to the particular virtual location;
• wherein the particular virtual location, based on two or more object-storage unit mappings, corresponds to prior physical locations comprising a first physical storage location and a second physical storage location, and the one or more new physical locations comprises the first physical storage location and not the second physical storage location;
• in response to the determination that the condition has occurred:
• storing data corresponding to the particular data at the one or more new physical locations;
• removing a mapping corresponding to the particular virtual location to indicate that the particular virtual location corresponds to the first physical location instead of the first and second physical locations without updating any extent-object mapping associating the particular logical extent to the particular virtual location;
• wherein the particular data is stored at the particular logical extent corresponding to the particular virtual location;
• updating one or more of:
• the extent-object mappings, which prior to the updating indicated that a particular virtual storage object, comprising a particular set of storage unit portions, stores information belonging to the particular logical extent, to indicate that a different virtual storage object, comprising a different set of storage unit portions corresponding to the one or more new physical locations, stores information belonging to the particular logical extent, or
• the object-storage unit mappings, which prior to the updating indicated that the particular set of storage unit portions belong to the particular virtual storage object, to instead indicate that the different set of storage unit portions, corresponding to the one or more new physical locations, belong to the particular virtual storage object, without a corresponding update to the extent-object mappings;
• and
• wherein each storage unit portion, of the different set of storage unit portions, belongs to a different storage unit of the plurality of storage units.