# US 2019/0356732 A1 · Optimizing dynamical resource allocations for cache-dependent workloads in disaggregated data centers

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356732 A1
- Document ID: US20190356732A1
- Status: Published application
- Kind: A1
- Application number: 15/982,612
- Filed: 2018-05-17
- Published: 2019-11-21
- Earliest claimed: 2018-05-17
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: John A. BIVENS; Eugen SCHENFELD; Valentina SALAPURA; Ruchi MAHINDRU; Min LI
- Web page: https://patentgrep.com/patent/US20190356732A1

## CPC

- H04L 41/5009: Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
- H04L 67/1001: for accessing one among a plurality of replicated servers
- G06F 9/5033: {considering data affinity}
- G06F 12/0888: using selective caching, e.g. bypass
- H04L 41/0823: characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability (for optimising operational conditions of wireless networks H04W24/02)
- H04L 41/0895: Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
- H04L 41/40: using virtualisation of network functions or resources, e.g. SDN or NFV entities
- H04L 41/5019: Ensuring fulfilment of SLA
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- H04L 67/288: Distributed intermediate devices, i.e. intermediate devices for interaction with other intermediate devices on the same level
- H04L 67/568: Storing data temporarily at an intermediate stage, e.g. caching
- H04L 67/5682: Policies or rules for updating, deleting or replacing the stored data
- G06F 12/0868: Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
- G06F 2212/1016: Performance improvement
- G06F 2212/502: using adaptive policy
- G06F 2212/601: Reconfiguration of cache memory
- H04L 43/0876: Network utilisation, e.g. volume of load or congestion level
- H04L 43/16: Threshold monitoring
- H04L 43/20: the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments for optimizing dynamic resource allocations in a disaggregated computing environment. A new workload is assigned to a subset of a plurality of processors, the subset of processors assigned a subset of a plurality of cache devices. A determination is made that the new workload is categorized as a cache-dependent workload which would be executed more efficiently were additional data elements associated with the new workload to be held in the subset of cache devices, and pursuant to determining the new workload is the cache-dependent workload, a determination is made as to whether the subset of cache devices is meeting the memory need of the new workload. Responsive to determining the subset of cache devices is not meeting the memory need of the new workload, a cache related action is performed.

## Claims

### Claim 1

A method for optimizing resource utilization in a disaggregated computing environment, by a processor device, comprising:
assigning a new workload to a subset of a plurality of processors, the subset of processors assigned a subset of a plurality of cache devices;
determining that the new workload is categorized as a cache-dependent workload which would be executed more efficiently were additional data elements associated with the new workload to be held in the subset of cache devices; and
pursuant to determining the new workload is the cache-dependent workload, determining whether the subset of cache devices is meeting the memory need of the new workload; wherein responsive to determining the subset of cache devices is not meeting the memory need of the new workload, a cache related action is performed.

### Claim 2 (depends on 1)

The method of claim 1, further including determining the new workload is the cache-dependent workload by tracking data access patterns of the data elements associated with the new workload; wherein the tracked data access patterns are assembled into a heat map, the heat map including information on a workload data scope and a most recent access pattern including a most recent access location.

### Claim 3 (depends on 2)

The method of claim 2, wherein, upon examining the data heat map, the new workload is classified as a cache-needy workload and the cache related action comprises allocating additional cache devices from the plurality of cache devices to the subset of cache devices assigned to the new workload.

### Claim 4 (depends on 3)

The method of claim 3, wherein classifying the new workload as the cache-needy workload further includes determining the data elements exhibit the data access patterns of having reoccurring access to less than a predetermined number of a set of data blocks outside a given one of the cache devices assigned to the new workload.

### Claim 5 (depends on 4)

The method of claim 4, wherein each of the processors are multicore processors and each cache device is assigned to a given one of the cores, and allocating the additional cache devices to the subset of cache devices comprises assigning additional cores to the new workload.

### Claim 6 (depends on 5)

The method of claim 5, further including identifying additional available cores in the subset of processors assigned to the workload, and assigning an available core and an associated available cache device to the new workload.

### Claim 7 (depends on 6)

The method of claim 6, further including determining that no available cores exist in the subset of processors; wherein if no available cores exist in the subset of processors, a new processor of the plurality of processors is allocated to the subset of processors.

### Claim 8 (depends on 7)

The method of claim 7, wherein the new processor is selected according to a service level agreement (SLA) of the new workload and an SLA of a previous workload assigned to the new processor.

### Claim 9

A system for optimizing resource utilization in a disaggregated computing environment, the system comprising:
a plurality of cache devices; and
a plurality of processors, wherein at least one of the plurality of processors:
assigns a new workload to a subset of the plurality of processors, the subset of processors assigned a subset of the plurality of cache devices;
determines that the new workload is categorized as a cache-dependent workload which would be executed more efficiently were additional data elements associated with the new workload to be held in the subset of cache devices; and
pursuant to determining the new workload is the cache-dependent workload, determines whether the subset of cache devices is meeting the memory need of the new workload; wherein responsive to determining the subset of cache devices is not meeting the memory need of the new workload, a cache related action is performed.

### Claim 10 (depends on 9)

The system of claim 9, wherein the at least one of the plurality of processors determines the new workload is the cache-dependent workload by tracking data access patterns of the data elements associated with the new workload; wherein the tracked data access patterns are assembled into a heat map, the heat map including information on a workload data scope and a most recent access pattern including a most recent access location.

### Claim 11 (depends on 10)

The system of claim 10, wherein, upon examining the data heat map, the new workload is classified as a cache-needy workload and the cache related action comprises allocating additional cache devices from the plurality of cache devices to the subset of cache devices assigned to the new workload.

### Claim 12 (depends on 11)

The system of claim 11, wherein classifying the new workload as the cache-needy workload further includes determining the data elements exhibit the data access patterns of having reoccurring access to less than a predetermined number of a set of data blocks outside a given one of the cache devices assigned to the new workload.

### Claim 13 (depends on 12)

The system of claim 12, wherein each of the processors are multicore processors and each cache device is assigned to a given one of the cores, and allocating the additional cache devices to the subset of cache devices comprises assigning additional cores to the new workload.

### Claim 14 (depends on 13)

The system of claim 13, wherein the at least one of the plurality of processors identifies additional available cores in the subset of processors assigned to the workload, and assigns an available core and an associated available cache device to the new workload.

### Claim 15 (depends on 14)

The system of claim 14, wherein the at least one of the plurality of processors determines that no available cores exist in the subset of processors; wherein if no available cores exist in the subset of processors, a new processor of the plurality of processors is allocated to the subset of processors.

### Claim 16 (depends on 15)

The system of claim 15, wherein the new processor is selected according to a service level agreement (SLA) of the new workload and an SLA of a previous workload assigned to the new processor.

### Claim 17

A computer program product for optimizing resource utilization in a disaggregated computing environment, by a processor device, the computer program product embodied on a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
an executable portion that assigns a new workload to a subset of a plurality of processors, the subset of processors assigned a subset of a plurality of cache devices;
an executable portion that determines that the new workload is categorized as a cache-dependent workload which would be executed more efficiently were additional data elements associated with the new workload to be held in the subset of cache devices; and
an executable portion that pursuant to determining the new workload is the cache-dependent workload, determines whether the subset of cache devices is meeting the memory need of the new workload; wherein responsive to determining the subset of cache devices is not meeting the memory need of the new workload, a cache related action is performed.

### Claim 18 (depends on 17)

The computer program product of claim 17, further including an executable portion that determines the new workload is the cache-dependent workload by tracking data access patterns of the data elements associated with the new workload; wherein the tracked data access patterns are assembled into a heat map, the heat map including information on a workload data scope and a most recent access pattern including a most recent access location.

### Claim 19 (depends on 18)

The computer program product of claim 18, wherein, upon examining the data heat map, the new workload is classified as a cache-needy workload and the cache related action comprises allocating additional cache devices from the plurality of cache devices to the subset of cache devices assigned to the new workload.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein classifying the new workload as the cache-needy workload further includes determining the data elements exhibit the data access patterns of having reoccurring access to less than a predetermined number of a set of data blocks outside a given one of the cache devices assigned to the new workload.

### Claim 21 (depends on 20)

The computer program product of claim 20, wherein each of the processors are multicore processors and each cache device is assigned to a given one of the cores, and allocating the additional cache devices to the subset of cache devices comprises assigning additional cores to the new workload.

### Claim 22 (depends on 21)

The computer program product of claim 21, further including an executable portion that identifies additional available cores in the subset of processors assigned to the workload, and assigns an available core and an associated available cache device to the new workload.

### Claim 23 (depends on 22)

The computer program product of claim 22, further including an executable portion that determines that no available cores exist in the subset of processors; wherein if no available cores exist in the subset of processors, a new processor of the plurality of processors is allocated to the subset of processors.

### Claim 24 (depends on 23)

The computer program product of claim 23, wherein the new processor is selected according to a service level agreement (SLA) of the new workload and an SLA of a previous workload assigned to the new processor.
