# US 2015/0178015 A1 · Dynamic feedback-based throughput control for black-box storage systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0178015 A1
- Document ID: US20150178015A1
- Status: Published application
- Kind: A1
- Application number: 14/135,455
- Filed: 2013-12-19
- Published: 2015-06-25
- Earliest claimed: 2013-12-19
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Anna S. Povzner; Renu Tewari; Noah Watkins
- Web page: https://patentgrep.com/patent/US20150178015A1

## CPC

- G06F 3/0613: {in relation to throughput}
- G06F 3/0647: {Migration mechanisms}
- G06F 3/0653: {Monitoring storage devices or systems}
- G06F 3/0658: {Controller construction arrangements}
- G06F 3/0659: {Command handling arrangements, e.g. command buffers, queues, command scheduling}
- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F 3/0673: {Single storage device}
- G06F 3/0683: {Plurality of storage devices}
- G06F 13/102: {where the program performs an interfacing function, e.g. device driver (G06F13/105 takes precedence; contention policies within device drivers G06F9/4881; scheduling within device drivers G06F9/52)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments of the present invention relate to dynamic feedback-based throughput control for storage systems. In one embodiment, a method of and computer program product for storage throughput control are provided. A plurality of I/O requests is received at a rate controller. The plurality of I/O requests is sent from the rate controller to a storage system at a first rate. Throughput of the storage system is observed. The first rate is dynamically adjusted based on the variance between the observed throughput of the storage system and the first rate.

## Claims

### Claim 1

A method comprising:
receiving a plurality of I/O requests at a rate controller;
sending the plurality of I/O requests from the rate controller to a storage system at a control rate;
observing throughput of the storage system; and
dynamically adjusting the control rate based on the variance between the observed throughput of the storage system and the control rate.

### Claim 2 (depends on 1)

The method of claim 1, wherein each of the plurality of I/O requests has an associated cost and the rate controller comprises a token bucket.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
sending each of the plurality of I/O requests when the token bucket has at least a number of tokens corresponding to the cost of each I/O request;
emptying the token bucket of the number of tokens corresponding to the cost of each I/O request; and
refilling the token bucket at a fill rate corresponding to the control rate.

### Claim 4 (depends on 2)

The method of claim 2, wherein the cost of each I/O request is proportional to a size of data requested by that I/O request.

### Claim 5 (depends on 1)

The method of claim 1, wherein adjusting the control rate comprises:
determining a deviation between the observed throughput of the storage system and the control rate;
increasing the control rate if the deviation is less than a predetermined value;
decreasing the control rate if the deviation is greater than the predetermined value.

### Claim 6 (depends on 1)

The method of claim 1, wherein adjusting the control rate comprises:
determining a deviation between the observed throughput of the storage system and the control rate;
increasing the control rate if the deviation is less than a first predetermined value;
maintaining the control rate if the deviation is less than a second predetermined value but not less than the first predetermined value;
decreasing the control rate if the deviation is greater than the second predetermined value.

### Claim 7 (depends on 6)

The method of claim 6, wherein the deviation is determined by taking the absolute value of the relative error between the observed throughput of the storage system and the control rate.

### Claim 8 (depends on 7)

The method of claim 7, wherein the first predetermined value is 0.01.

### Claim 9 (depends on 7)

The method of claim 7, wherein the second predetermined value is 0.05.

### Claim 10 (depends on 6)

The method of claim 6, wherein increasing the fill rate comprises multiplying the fill rate by a first scaling factor.

### Claim 11 (depends on 10)

The method of claim 10, wherein the first scaling factor is increased after increasing the fill rate.

### Claim 12 (depends on 6)

The method of claim 6, wherein decreasing the fill rate comprises multiplying the fill rate by a second scaling factor.

### Claim 13 (depends on 3)

The method of claim 3, wherein the rate controller comprises a plurality of token buckets, the method further comprising:
selecting the token bucket from the plurality of token buckets based on a service class of the I/O request.

### Claim 14 (depends on 3)

The method of claim 3, further comprising:
decreasing a number of tokens in the token bucket when the control rate exceeds the throughput.

### Claim 15 (depends on 14)

The method of claim 14, wherein decreasing the number of tokens and adjusting the control rate occur periodically.

### Claim 16 (depends on 14)

The method of claim 14, wherein the token bucket can have a negative number of tokens, the method further comprising:
determining a number of excess tokens based on the difference between the control rate and the throughput;
determining a number of consumed tokens of the excess tokens; and
decreasing the number of tokens in the bucket based on the number of consumed tokens.

### Claim 17 (depends on 14)

The method of claim 14, wherein the token bucket further comprises an uncapped counter, the method further comprising:
increasing the uncapped counter at the fill rate;
decreasing the uncapped counter according to the cost of each I/O request; and
decreasing the number of tokens in the bucket based on a difference between the uncapped counter and the number of excess tokens.

### Claim 18

A system comprising:
a rate controller receiving a plurality of I/O requests;
a storage system, the storage system receiving the I/O request from the rate controller at a control rate;
a control loop observing throughput of the storage system and dynamically adjusting the control rate based on the variance between the observed throughput of the storage system and the control rate.

### Claim 19

A computer program product for storage throughput control, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by a processor to:
receive a plurality of I/O requests at a rate controller;
send the plurality of I/O requests from the rate controller to a storage system at a control rate;
observe throughput of the storage system; and
dynamically adjust the control rate based on the variance between the observed throughput of the storage system and the control rate.
