# US 2025/0165304 A1 · Systems and methods for providing fair allocation of shared capacity in multi-tenant resource environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165304 A1
- Document ID: US20250165304A1
- Status: Published application
- Kind: A1
- Application number: 18/517,762
- Filed: 2023-11-22
- Published: 2025-05-22
- Earliest claimed: 2023-11-22
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Anthony Christopher KARLOFF; Grace Marie BRAMLEY-SIMMONS; Fahd Ahmad KAMAL; Hemant KUMAR; Wenbin MENG
- Web page: https://patentgrep.com/patent/US20250165304A1

## CPC

- G06F 9/5072: {Grid computing}
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06F 9/5022: {Mechanisms to release resources}
- G06F 9/505: {considering the load}
- G06F 2209/5011: Pool
- G06F 2209/5014: Reservation
- G06F 2209/503: Resource availability
- G06F 2209/504: Resource capping
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods are disclosed herein for providing fair allocation of resources in a multi-tenant environment. Systems and methods are configured for identifying a plurality of tenants participating in the multi-tenant environment. For each tenant of the plurality of tenants, systems determine a tenant status as a donating tenant, a fairly borrowing tenant, or an unfairly borrowing tenant and apply a different borrowing algorithm to each tenant of the plurality of tenants based on a corresponding tenant status determined for each tenant. Different borrowing algorithms are configured to determine different resource borrowing limits from a common pool of resources for each tenant.

## Claims

### Claim 1

A method for managing shared resources in a multi-tenant environment, the method comprising:
for each tenant of a plurality of tenants, determining a fixed limit of resource capacity guaranteed to be available to each tenant;
periodically evaluating each tenant to identify unused resources and assigning the unused resources to a common pool;
calculating a fair borrowing limit of resources that each tenant is allocated to borrow from the common pool, wherein the fair borrowing limit of resources is based at least in part on a proportional analysis of a percentage of resources currently borrowed by each tenant from the common pool compared to a percentage of the fixed limit of resource capacity guaranteed to be available to each tenant relative to a sum of all fixed limits of resources corresponding to the plurality of tenants;
determining, based on the proportional analysis, which of the plurality of tenants are fairly borrowing tenants that are fairly borrowing resources from the common pool at or below the calculated fair borrowing limit of resources and which of the plurality of tenants are unfairly borrowing tenants that are unfairly borrowing resources from the common pool above the calculated fair borrowing limit of resources;
generating a new calculated borrowing limit of resources an unfairly borrowing tenant is allocated to borrow from the common pool which is less than the fair borrowing limit of resources that was previously calculated; and
rejecting a request from an unfairly borrowing tenant to borrow additional resources from the common pool upon determining the request from the unfairly borrowing tenant would cause an allocation of resources from the common pool to the unfairly borrowing tenant to exceed the new calculated borrowing limit.

### Claim 2 (depends on 1)

The method of claim 1, further comprising reserving a first minimum quantity of resources in the common pool to be reclaimed by donating tenants.

### Claim 3 (depends on 1)

The method of claim 1, further comprising reserving a second minimum quantity of resources in the common pool to be borrowed by fairly borrowing tenants.

### Claim 4 (depends on 1)

The method of claim 1, wherein calculating the fair borrowing limit of resources that each tenant is allocated to borrow from the common pool is based at least in part on a different proportional analysis of the percentage of resources currently borrowed by each tenant from the common pool compared to a different percentage of the fixed limit of resource capacity guaranteed to be available to each tenant relative to a sum of fixed limits of resources corresponding to one or more borrowing tenants of the plurality of tenants.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving a request from a donating tenant to reclaim resources from the common pool;
determining that the common pool has insufficient resources to fulfill the request from the donating tenant;
upon determining that the common pool has insufficient resources to fulfill the request from the donating tenant, forcing a return of resources from one or more borrowing tenants back to the common pool; and
fulfilling the request from the donating tenant by allocating resources from the common pool to the donating tenant.

### Claim 6 (depends on 5)

The method of claim 5, wherein the donating tenant requests to reclaim up to a fixed limit of resources corresponding to the donating tenant from the common pool for triggering a forced return of resources from the one or more borrowing tenants.

### Claim 7

A computing system for managing shared resources in a multi-tenant environment, the computing system comprising:
a processor; and
a hardware storage device storing computer-executable instructions that are executable by the processor to cause the computing system to:
for each tenant of a plurality of tenants, determine a fixed limit of resource capacity guaranteed to be available to each tenant;
periodically evaluate each tenant to identify unused resources and assign the unused resources to a common pool;
calculating a fair borrowing limit of resources that each tenant is allocated to borrow from the common pool, wherein the fair borrowing limit of resources is based at least in part on a proportional analysis of a percentage of resources currently borrowed by each tenant from the common pool compared to a percentage of the fixed limit of resource capacity guaranteed to be available to each tenant relative to a sum of all fixed limits of resources corresponding to the plurality of tenants;
determine, based on the proportional analysis, which of the plurality of tenants are fairly borrowing tenants that are fairly borrowing resources from the common pool at or below the calculated fair borrowing limit and which of the plurality of tenants are unfairly borrowing tenants that are unfairly borrowing resources from the common pool above the calculated fair borrowing limit;
generate a new calculated borrowing limit of resources an unfairly borrowing tenant is allocated to borrow from the common pool which is less than the fair borrowing limit that was previously calculated; and
reject a request from an unfairly borrowing tenant to borrow additional resources from the common pool upon determining the request from the unfairly borrowing tenant would cause an allocation of resources from the common pool to the unfairly borrowing tenant to exceed the new calculated borrowing limit.

### Claim 8 (depends on 7)

The computing system of claim 7, wherein the computing system is further caused to:
reserve a first minimum quantity of resources in the common pool to be reclaimed by donating tenants.

### Claim 9 (depends on 7)

The computing system of claim 7, wherein the computing system is further caused to:
reserve a second minimum quantity of resources in the common pool to be borrowed by fairly borrowing tenants.

### Claim 10 (depends on 7)

The computing system of claim 7, wherein calculating the fair borrowing limit of resources that each tenant is allocated to borrow from the common pool is based at least in part on a different proportional analysis of the percentage of resources currently borrowed by each tenant from the common pool compared to a different percentage of the fixed limit of resource capacity guaranteed to be available to each tenant relative to a sum of fixed limits of resources corresponding to one or more borrowing tenants of the plurality of tenants.

### Claim 11 (depends on 7)

The computing system of claim 7, wherein the computing system is further caused to:
receive a request from a fairly borrowing tenant to borrow additional resources from the common pool;
determine that the common pool has insufficient resources to fulfill the request from the fairly borrowing tenant;
force a return of resources from an unfairly borrowing tenant back to the common pool; and
fulfill the request from the fairly borrowing tenant to borrow additional resources from the common pool.

### Claim 12 (depends on 7)

The computing system of claim 7, wherein the computing system is further caused to:
identify a result being returned by a machine learning model based on utilizing a set of resources allocated to an unfairly borrowing tenant associated with the machine learning model; and
subsequent to identifying the result being returned, force a return of a portion of the set of resources allocated to the unfairly borrowing tenant back to the common pool such that the tenant that was unfairly borrowing is no longer using resources above the fair borrowing limit of resources for that tenant.

### Claim 13

A method for managing shared resources in a multi-tenant environment, the method comprising:
identifying a plurality of tenants participating in the multi-tenant environment;
for each tenant of the plurality of tenants, determining a tenant status as a donating tenant that is donating some or all of a fixed limit of resources guaranteed to be available to the particular tenant, a fairly borrowing tenant that is borrowing resources at or below a previously calculated fair borrowing limit, or an unfairly borrowing tenant that is borrowing resources above previously calculated fair borrowing limit; and
applying a different borrowing algorithm to each tenant of the plurality of tenants based on a corresponding tenant status determined for each tenant, wherein different borrowing algorithms are configured to determine new borrowing limits associated with borrowing shared resources from a common pool in the multi-tenant environment.

### Claim 14 (depends on 13)

The method of claim 13, wherein the shared resources in the multi-tenant environment are represented by tokens.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
receiving a request from a particular tenant to be processed by a large language model;
determining a maximum capacity of a system associated with the multi-tenant environment that will be needed to process the request;
determining that allocating tokens for meeting maximum capacity that will be needed to process the request does not exceed a new borrowing limit determined for the particular tenant; and
allocating a number of tokens to the particular tenant for processing the request, wherein the allocated tokens represent an amount of resources from the shared resources that the particular tenant is expected to consume in processing the request.

### Claim 16 (depends on 13)

The method of claim 13, wherein the tenant status is determined to be the fairly borrowing tenant or unfairly borrowing tenant based at least in part on a proportional analysis of a percentage of resources currently borrowed by a particular tenant from the common pool compared to a percentage of a fixed limit of resource capacity guaranteed to be available to the particular tenant relative to a sum of all fixed limits of resources corresponding to the plurality of tenants.

### Claim 17 (depends on 13)

The method of claim 13, wherein the tenant status is determined to be the fairly borrowing tenant or unfairly borrowing tenant based at least in part on a proportional analysis of a percentage of resources currently borrowed by a particular tenant from the common pool compared to a percentage of a fixed limit of resource capacity guaranteed to be available to the particular tenant relative to a sum of all fixed limits of resources corresponding to one or more borrowing tenants.

### Claim 18 (depends on 13)

The method of claim 13, wherein a first resource borrowing limit corresponding to an unfairly borrowing tenant is less than a second resource borrowing limit corresponding to a fairly borrowing tenant.

### Claim 19 (depends on 18)

The method of claim 18, wherein a third resource borrowing limit corresponding to a donating tenant is greater than the second resource borrowing limit.

### Claim 20 (depends on 13)

The method of claim 13, further comprising:
rejecting a request from an unfairly borrowing tenant to borrow additional resources from the common pool upon determining the request from the unfairly borrowing tenant would cause an amount of resources available in the common pool to drop below a minimum threshold.
