US 10,095,581 B2Granted

Transmission time refinement in a storage system

AssigneeAmazon Technologies, Inc.

InventorRajesh Shanker Patel

Life of this patent

Estimating the term…

Loading patent…

Abstract

A storage manager may be used to perform a decoding operation using a transmission time refinement technique on a data object stored in a storage system, such as an object-redundant storage system. The decoding operation may include requesting groups of corresponding blocks from storage devices of the storage system. The storage manager may maintain connections to a connection group of the storage devices and may iteratively request corresponding blocks of the data object from one or more various request groups of the storage devices of the connection group. The storage manager may evaluate performance of the request groups in sending the corresponding blocks of the data object and may modify the membership of the request groups for requests for subsequent blocks of the data object based at least in part on the performance of the request groups.

Claims20

Dependent claims

A system, comprising:

a storage system comprising a plurality of storage devices, wherein the storage system is configured to store a plurality of data objects according to an encoding technique, wherein blocks of a data object can be reconstructed from a particular number of corresponding blocks of the data object from a particular number of storage devices of the storage system;
and
a storage manager implemented by one or more hardware processors and configured to:
receive a request from a client for a data object of the plurality of data objects;
request corresponding blocks of the data object from a request group of storage devices, wherein the request group is a subset of the storage devices of the storage system and includes at least the particular number of the storage devices;
collect performance metrics of the storage devices in the request group in providing the corresponding blocks of the data object;
modify, based at least in part on the collected performance metrics and one or more performance criteria, membership of the request group to form a new request group having at least the particular number of the storage devices;
and
request subsequent corresponding blocks of the data object from the new request group.

6 more elements

A method, comprising:

performing, by one or more computers:
receiving a request from a client for a data object stored at a storage system according to an encoding technique, wherein blocks of the data object can be reconstructed from a particular number of corresponding blocks from a particular number of storage devices of the storage system;
requesting corresponding blocks of the data object from a request group of storage devices, wherein the request group is a subset of the storage devices of the storage system and includes at least the particular number of the storage devices;
collecting performance metrics of the subset of the storage devices in providing the corresponding blocks of the data object;
modifying, based at least in part on the collected performance metrics and one or more performance criteria, membership of the request group to form a new request group using at least one different storage device of the storage system, wherein the new request group has at least the particular number of the storage devices;
and
requesting subsequent corresponding blocks of the data object from the new request group.

4 more elements

A non-transitory, computer-readable storage medium storing program instructions that when executed on one or more processors cause the one or more processors to:

receive a request from a client for a data object stored at the storage system according to an encoding technique, wherein blocks of the data object can be reconstructed from a particular number of corresponding blocks from a particular number of storage devices of the storage system;
request corresponding blocks of the data object from a request group of storage devices, wherein the request group is a subset of the storage devices of the storage system and includes at least the particular number of the storage devices;
collect performance metrics of the storage devices in the request group in providing the corresponding blocks of the data object
modify, based at least in part on the collected performance metrics and one or more performance criteria, membership of the request group to form a new request group using at least one different storage device of the storage system, wherein the new request group has at least the particular number of the storage devices;
and
request subsequent corresponding blocks of the data object from the new request group.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/612,572Filed 2 Jun 2017 · continuation
Priority: 22 Sep 2015
Published: US 2017/0270004 A121 Sep 2017
Granted: 9 Oct 2018
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

G06F 11/1092
Parity data used in redundant arrays of independent storages, e.g. in RAID systems: rebuilding, e.g. when physically replacing a failing disk
G06F 11/1072
In individual solid state devices: in multilevel memories
G06F 11/1076
Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's: parity data used in redundant arrays of…
G11C 29/4401
Indication or identification of errors, e.g. for repair: for self repair