# US 2022/0269541 A1 · Methods for managing storage quota assignment in a distributed system and devices thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0269541 A1
- Document ID: US20220269541A1
- Status: Published application
- Kind: A1
- Application number: 17/744,056
- Filed: 2022-05-13
- Published: 2022-08-25
- Earliest claimed: 2018-12-13
- Assignees: NetApp, Inc.
- Applicants: NetApp, Inc.
- Inventors: Xin WANG; Keith Allen Bare, II; Ying-Hao Wang; Jonathan Westley Moody; Bradley Raymond Lisson; Richard Wight; David Loren Rose; Richard P. Jernigan, IV; Daniel Tennant
- Web page: https://patentgrep.com/patent/US20220269541A1

## CPC

- G06F 9/5011: {the resources being hardware resources other than CPUs, Servers and Terminals}
- G06F 9/5061: {Partitioning or combining of resources}
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06F 13/282: {Cycle stealing DMA (G06F13/30 takes precedence)}
- G06F 2209/504: Resource capping
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, non-transitory machine readable media, and computing devices that more efficiently and effectively manage storage quota enforcement are disclosed. With this technology, a quota ticket comprising a tally generation number (TGN) and a local allowed usage amount (AUA) are obtained. The local AUA comprises a portion of a global AUA associated with a quota rule. The local AUA is increased following receipt of another portion of the global AUA in a response from a cluster peer, when another TGN in the response matches the TGN and the local AUA is insufficient to execute a received storage operation associated with the quota rule. The local AUA is decreased by an amount corresponding to, and following execution of, the storage operation, when the increased local AUA is sufficient to execute the storage operation.

## Claims

### Claim 1

A method implemented by a cluster peer designated as a tally manager, the method comprising:
obtaining a first local allowed usage amount (AUA) from each of a plurality of cluster peers and an actual quota usage against a quota rule from each of a plurality of storage volumes;
distributing to each of the cluster peers a quota ticket comprising a first tally generation number (TGN) and a time-to-live (TTL),
wherein the TTL is determined based on a first comparison of a first sum of the actual quota usages to an external quota limit;
adjusting one or more of the first local AUAs and a second local AUA maintained locally by the cluster peer based on a second comparison of an internal quota limit to a second sum of the first local AUAs and the first sum,
wherein the internal quota limit is higher than the external quota limit; and
executing a received storage operation when the adjusted second local AUA is sufficient to execute the received storage operation.

### Claim 2 (depends on 1)

The method of claim 1, further comprising decreasing the second local AUA by an amount corresponding to the storage operation following the execution of the received storage operation.

### Claim 3 (depends on 1)

The method of claim 1, further comprising increasing each of the first local AUAs and the second local AUA proportionally such that the second sum equals the internal quota limit, when the second comparison indicates the second sum is less than the internal quota limit.

### Claim 4 (depends on 1)

The method of claim 1, further comprising decreasing each of the first local AUAs and the second local AUA proportionally such that the second sum equals the internal quota limit, when the second comparison indicates the second sum is greater than the internal quota limit.

### Claim 5 (depends on 1)

The method of claim 1, further comprising maintaining the one or more of the first local AUAs and the second local AUA, without adjusting the one or more of the first local AUAs and the second local AUA, when the second comparison indicates the second sum is equal to the internal quota limit.

### Claim 6 (depends on 1)

The method of claim 1, further comprising determining the TTL based on a size of the gap between the first sum and the external quota limit such that a shorter TTL is generated for a smaller size of the gap and a longer TTL is generated for a larger size of the gap.

### Claim 7 (depends on 1)

The method of claim 1, further comprising updating a second TGN maintained locally by the cluster peer after generating the quota ticket, wherein the second TGN is used to generate the first TGN and is monotonically increasing.

### Claim 8 (depends on 1)

The method of claim 1, wherein each of the first local AUAs comprises a portion of a global AUA associated with the quota rule.

### Claim 9 (depends on 1)

The method of claim 1, wherein the storage volumes are in a same volume group, the received storage operation is received from a client and comprises a write storage operation directed to one of the storage volumes, and the quota rule defines an amount of storage space within the volume group that is available to the client.

### Claim 10

A non-transitory machine readable medium having stored thereon instructions for storage quota enforcement comprising machine executable code which when executed by a cluster peer designated as a tally manager causes the cluster peer to:
distribute to each of a plurality of cluster peers a first quota ticket comprising a first time-to-live (TTL) and a first indication that storage operation execution is quiesced, when a first sum of first actual quota usages obtained from a plurality of storage volumes is greater than or equal to an external quota limit;
distribute to each of the cluster peers a second quota ticket comprising a second indication that storage operation execution is permitted, when a second sum of second actual quota usages obtained from the storage volumes after expiration of the first TTL is less than the external quota limit; and
execute one or more received storage operations after distributing the second quota tickets.

### Claim 11 (depends on 10)

The non-transitory machine readable medium of claim 10, wherein the first quota ticket further comprises a first tally generation number (TGN) and the second quota ticket further comprises a second TTL and a second TGN higher than the first TGN.

### Claim 12 (depends on 11)

The non-transitory machine readable medium of claim 11, wherein the machine executable code when executed by the cluster peer further causes the cluster peer to obtain a first local allowed usage amount (AUA) from each of the cluster peers, wherein each of the first local AUAs comprises a portion of a global AUA.

### Claim 13 (depends on 12)

The non-transitory machine readable medium of claim 12, wherein the machine executable code when executed by the cluster peer further causes the cluster peer to obtain a second local AUA from each of the cluster peers after expiration of the first TTL, wherein the second TTL is determined based on a difference between a first sum of the second actual quota usages and the external quota limit.

### Claim 14 (depends on 10)

The non-transitory machine readable medium of claim 10, wherein the storage volumes are in a same volume group, the received storage operations are received from a client and comprise write storage operations directed to one of the storage volumes, and the quota rule defines an amount of storage space within the volume group that is available to the client.

### Claim 15

A cluster peer, comprising:
a memory containing machine readable medium comprising machine executable code having stored thereon instructions for storage quota enforcement; and
a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to:
distribute to each of the cluster peers, and store in the memory, a quota ticket comprising a time-to-live (TTL) determined based on an external quota limit and actual quota usages against an amount of storage space within a volume group that is available to a client, wherein the actual quota usages are obtained from each of a plurality of storage volumes in a volume group;
adjust one or more a plurality of first local allowed usage amounts (AUAs) obtained from a plurality of cluster peers and a second local AUA maintained locally by the cluster peer based on an internal quota limit, the first local AUAs, the actual quota usages, and the external quota limit, wherein the internal quota limit is higher than the external quota limit; and
execute a storage operation received from the client and directed to one of the storage volumes, when the adjusted second local AUA is sufficient to execute the received storage operation and the quota ticket is determined to be unexpired based on the TTL.

### Claim 16 (depends on 15)

The cluster peer of claim 15, wherein the processor is further configured to execute the machine executable code to decrease the second local AUA by an amount corresponding to the storage operation following the execution of the storage operation.

### Claim 17 (depends on 15)

The cluster peer of claim 15, wherein the processor is further configured to execute the machine executable code to determine the TTL based on a size of the gap between the first sum and the external quota limit such that a shorter TTL is generated for a smaller size of the gap and a longer TTL is generated for a larger size of the gap.

### Claim 18 (depends on 15)

The cluster peer of claim 15, wherein the processor is further configured to execute the machine executable code to update a second tally generation number (TGN) maintained locally by the cluster peer after generating the quota ticket, wherein the second TGN is used to generate a first TGN of the quota ticket and is monotonically increasing.

### Claim 19 (depends on 15)

The cluster peer of claim 15, wherein each of the first local AUAs comprises a portion of a global AUA associated with the quota rule.

### Claim 20

A tally manager storage node in a cluster of peer storage nodes, the tally manager storage node comprising:
a processor coupled to a memory and configured to execute machine executable code stored in the memory to cause the tally manager storage node to:
determine a local amount of storage space available to be consumed by a client with respect to a volume group within a time period, wherein a defined storage rule limits the client to a global amount of storage space within the volume group;
distribute to each of the other storage nodes in the cluster of storage nodes, and store in the memory, the local amount of storage, wherein the local amounts of storage space collectively exceed the global amount of storage space by a bounded amount to facilitate reduced cluster communications required to manage enforcement of the storage rule;
determine that the stored local amount of storage space is sufficient to process a storage operation received from the client and directed to a storage volume in the volume group, when the global amount of storage space has not been exceeded and the time period is unexpired; and
reduce the stored local amount of storage space by an amount associated with the storage operation following execution of the storage operation.
