Power reduction in distributed storage systems
AssigneeWestern Digital Technologies, Inc.
InventorStijn Blyweert
Life of this patent
Estimating the term…
Abstract
Techniques are described for reducing power consumption in a distributed data storage system using a hierarchy rule that is generated based on a spreading policy and a set of tolerable failures. A method may operate to distribute erasure-encoded data of a first data object across first and second portions of a distributed storage system using a hierarchy rule corresponding to a spreading policy based on a set of tolerable failures from which the first data object can be recovered. The method disables the first portion of the distributed storage system that includes a first portion of the erasure-encoded data. The first portion of the distributed storage system is determined according to the spreading policy and the hierarchy rule identifies the set of tolerable failures.
Claims18
A computer-implemented method comprising:
- determining a hierarchy rule and a spreading policy for a distributed storage system, wherein:
- the distributed storage system includes nodes comprised of a plurality of data storage devices;
- the spreading policy is based on a number of tolerable failures of data storage devices from which a data object is recoverable;
- and
- the spreading policy is configured to distribute erasure-encoded data to each node in a number that is less than the number of tolerable failures of data storage devices;
- determining a first time period for intentionally inducing a power savings by disabling at least one node, each node of the at least one node comprised of operable data storage devices of the plurality of data storage devices;
- distributing erasure-encoded data of a first data object across a first portion and a second portion of the distributed storage system using the hierarchy rule and the spreading policy;
- disabling, based on a disable signal for the at least one node and for the first time period, the first portion of the distributed storage system that includes a first portion of the erasure-encoded data of the first data object, wherein, during the first time period:
- the first portion of the distributed storage system includes the at least one node of operable data storage devices;
- the second portion of the distributed storage system includes portions of the erasure-encoded data configured to recreate the first data object;
- and
- the disabling the first portion of the distributed storage system includes suspending power to a plurality of data storage devices in the first portion of the distributed storage system;
- and
- powering on the plurality of data storage devices in the first portion of the distributed storage system for a second time period following the first time period.
A distributed storage system comprising:
- a set of non-volatile data storage devices;
- a plurality of nodes, wherein each node is comprised of a plurality of data storage devices from the set of non-volatile data storage devices;
- and
- a controller node configured to:
- determine a hierarchy rule and spreading policy for the distributed storage system, wherein:
- the spreading policy is based on a number of tolerable failures of data storage devices from which a data object is recoverable;
- and
- the spreading policy is configured to distribute erasure-encoded data to each node in a number that is less than the number of tolerable failures of data storage devices;
- determine a first time period for intentionally inducing a power savings by disabling at least one node, each node of the at least one node comprised of operable data storage devices of the plurality of data storage devices;
- distribute erasure-encoded data of a first data object across a first portion and a second portion of the distributed storage system using the hierarchy rule and the spreading policy;
- disable, based on a disable signal for the at least one node and for the first time period, the first portion of the distributed storage system that includes a first portion of the erasure-encoded data of the first data object, wherein, during the first time period:
- the first portion of the distributed storage system includes the at least one node of operable data storage devices;
- the second portion of the distributed storage system includes portions of the erasure-encoded data configured to recreate the first data object;
- and
- disabling the first portion of the distributed storage system includes suspending power to a plurality of data storage devices in the first portion of the distributed storage system;
- and
- power on the plurality of data storage devices in the first portion of the distributed storage system for a second time period following the first time period.
A distributed storage system comprising:
- a plurality of nodes, wherein each node is comprised of a plurality of data storage devices;
- means for determining a hierarchy rule and spreading policy for the distributed storage system, wherein:
- the spreading policy is based on a number of tolerable failures of data storage devices from which a data object is recoverable;
- and
- the spreading policy is configured to distribute erasure-encoded data to each node in a number that is less than the number of tolerable failures of data storage devices;
- means for determining a first time period for intentionally inducing a power savings by disabling at least one node, each node of the at least one node comprised of operable data storage devices of the plurality of data storage devices;
- means for distributing erasure-encoded data of a first data object across a first portion and a second portion of the distributed storage system using the hierarchy rule and the spreading policy;
- means for disabling, based on a disable signal for the at least one node and for the first time period, the first portion of the distributed storage system that includes a first portion of the erasure-encoded data of the first data object, wherein, during the first time period:
- the first portion of the distributed storage system includes the at least one node of operable data storage devices;
- the second portion of the distributed storage system includes portions of the erasure-encoded data configured to recreate the first data object;
- and
- the disabling the first portion of the distributed storage system includes suspending power to a plurality of data storage devices in the first portion of the distributed storage system;
- and
- means for powering on the plurality of data storage devices in the first portion of the distributed storage system for a second time period following the first time period.
Dependencies are inferred from the claim text.