# US 2025/0219963 A1 · Microservice deployment in distributed computing environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0219963 A1
- Document ID: US20250219963A1
- Status: Published application
- Kind: A1
- Application number: 18/444,845
- Filed: 2024-02-19
- Published: 2025-07-03
- Earliest claimed: 2024-01-03
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Fernando Luiz Koch; Aladin Djuhera; Alecio Pedro Delazari Binotto
- Web page: https://patentgrep.com/patent/US20250219963A1

## CPC

- H04L 47/783: Distributed allocation of resources, e.g. bandwidth brokers
- G06N 3/092: Reinforcement learning
- H04L 41/5054: Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A computer implemented method of deployment and resource allocation of microservices of a distributed computing environment is disclosed. The distributed computing environment includes a microservice deployment scheduler and one or more computing nodes. The microservice deployment scheduler includes a reinforcement learning based dynamic workload orchestration module. The method includes receiving microservice constraints descriptive of a microservice computing task by the microservice deployment scheduler. The method further includes receiving node specific properties from the one or more computing nodes by the microservice deployment scheduler. The node specific properties are descriptive of a computing capacity and/or computing capabilities of the one or more computing nodes. The method further includes orchestrating operation of the one or more computing nodes by the microservice deployment scheduler by inputting the microservice constraints and the node specific properties into the reinforcement learning based dynamic workload orchestration module.

## Claims

### Claim 1

A computer implemented method of deployment and resource allocation of microservices of a distributed computing environment, the distributed computing environment including a microservice deployment scheduler and one or more computing nodes, the microservice deployment scheduler including a reinforcement learning based dynamic workload orchestration module, the method comprising:
receiving microservice constraints descriptive of a microservice computing task by the microservice deployment scheduler;
receiving node specific properties from the one or more computing nodes by the microservice deployment scheduler, wherein the node specific properties are descriptive of a computing capacity and/or computing capabilities of the one or more computing nodes; and
orchestrating operation of the one or more computing nodes by the microservice deployment scheduler by inputting the microservice constraints and the node specific properties into the reinforcement learning based dynamic workload orchestration module.

### Claim 2 (depends on 1)

The computer implemented method of claim 1, wherein:
the microservice deployment scheduler further includes a rule based dynamic workload orchestration module configured to orchestrate operation of the one or more computing nodes using a predetermined set of rules associated with the microservice constraints and the node specific properties;
the method further comprises orchestrating operation of the one or more computing nodes by the microservice deployment scheduler by inputting the microservice constraints and the node specific properties into the rule based dynamic workload orchestration module; and
orchestration of the one or more computing nodes using the reinforcement learning based dynamic workload orchestration module is performed if the predetermined set of rules is not associated with the microservice constraints and the node specific properties.

### Claim 3 (depends on 2)

The computer implemented method of claim 2, wherein the predetermined set of rules implements a multi-objective problem statement.

### Claim 4 (depends on 1)

The computer implemented method of claim 1, the method further comprising:
training the reinforcement learning based dynamic workload orchestration module during operation using a reward function, wherein the reward function includes at least one of: resource utilization of the computing nodes, response time to the microservice constraints, cost efficiency of the computing nodes, energy consumption of the computing nodes, or combinations thereof.

### Claim 5 (depends on 1)

The computer implemented method of claim 1, wherein the distributed computing environment is configured to receive microservice applications from a database of microservices for execution by the one or more computing nodes.

### Claim 6 (depends on 5)

The computer implemented method of claim 5, wherein:
the microservice deployment scheduler is executed on a dedicated computing node; and
the dedicated computing node functions as a gateway between the database of microservices and the one or more computing nodes.

### Claim 7 (depends on 1)

The computer implemented method of claim 1, wherein execution of the microservice deployment scheduler is distributed amongst the one or more computing nodes.

### Claim 8 (depends on 1)

The computer implemented method of claim 1, wherein:
the distributed computing environment includes a trained machine learning module configured to output the node specific properties in response to receiving a current node specific machine state data as input; and
the method further comprises:
collecting the current node specific machine state data from the one or more computing nodes; and
receiving the node specific properties in response to inputting the current node specific machine state data into the trained machine learning module.

### Claim 9 (depends on 8)

The computer implemented method of claim 8, wherein the trained machine learning module includes a classifier neural network.

### Claim 10 (depends on 8)

The computer implemented method of claim 8, wherein the current node specific machine state data includes at least one of: current resource utilization data, current workload data, current performance metric data, current processing power, current memory capacity, current storage capacity, current network bandwidth, current microservice resource requirements, current microservice response time objective, current microservice execution dependencies, current microservice communication patterns, current installed microservices, current response time, throughput, current energy consumption, current cost of processing, current cost of storage, or combinations thereof.

### Claim 11 (depends on 8)

The computer implemented method of claim 8, wherein:
the trained machine learning module is implemented on each of the one or more computing nodes; and
the method further comprises receiving the node specific properties in response to inputting the node specific machine state data into the trained machine learning module of the respective computing node.

### Claim 12 (depends on 8)

The computer implemented method of claim 8, wherein:
the trained machine learning module is further configured to receive historical machine state data as input when inputting the current node specific machine state data into the trained machine learning module; and
the method further comprises inputting the historical machine state data into the trained machine learning module when inputting the current node specific machine state data into the trained machine learning module to determine the node specific properties.

### Claim 13 (depends on 12)

The computer implemented method of claim 12, wherein the historical machine state data includes at least one of: historical resource utilization data, historical workload data, historical performance metric data, historical processing power, historical memory capacity, historical storage capacity, historical network bandwidth, historical microservice resource requirements, historical microservice response time objective, historical microservice execution dependencies, historical microservice communication patterns, historical installed microservices, historical response time, historical throughput, historical energy consumption, historical cost of processing, historical cost of storage, or combinations thereof.

### Claim 14 (depends on 1)

The computer implemented method of claim 1, wherein:
the distributed computing environment is a distributed edge computing environment; and
the computing nodes are edge nodes.

### Claim 15

A computer program product comprising a computer-readable storage medium having computer-readable program code embodied therewith, said computer-readable program code configured to implement a method, the method comprising:
receiving microservice constraints descriptive of a microservice computing task by the microservice deployment scheduler;
receiving node specific properties from the one or more computing nodes by the microservice deployment scheduler, wherein the node specific properties are descriptive of a computing capacity and/or computing capabilities of the one or more computing nodes; and
orchestrating operation of the one or more computing nodes by the microservice deployment scheduler by inputting the microservice constraints and the node specific properties into the reinforcement learning based dynamic workload orchestration module.

### Claim 16

A computer system comprising:
a processor configured for controlling said computer system; and
a memory storing machine executable instructions and a microservice deployment scheduler, the microservice deployment scheduler comprising a reinforcement learning based dynamic workload orchestration module, wherein execution of said instructions causes said processor to:
receive microservice constraints descriptive of a microservice computing task by the microservice deployment scheduler;
receive node specific properties from the one or more computing nodes by the microservice deployment scheduler, wherein the node specific properties are descriptive of computing capacity and computing capabilities of the one or more computing nodes; and
orchestrate operation of the one or more computing nodes by the microservice deployment scheduler by inputting the microservice constraints and the node specific properties into the reinforcement learning based dynamic workload orchestration module.

### Claim 17 (depends on 16)

The computer system of claim 16, wherein:
the microservice deployment scheduler further comprises a rule based dynamic workload orchestration module configured for orchestrating operation of the one or more computing nodes using a predetermined set of rules associated with the microservice constraints and the node specific properties;
execution of said instructions causes said processor to orchestrate operation of the one or more computing nodes by the microservice deployment scheduler by inputting the microservice constraints and the node specific properties into the rule based dynamic workload orchestration module; and
orchestration of the one or more computing nodes using the reinforcement learning based dynamic workload orchestration module is performed by said processor if the predetermined set of rules is not associated with the microservice constraints and the node specific properties.

### Claim 18 (depends on 17)

The computer system of claim 17, wherein the predetermined set of rules implements a multi-objective problem statement.

### Claim 19 (depends on 16)

The computer system of claim 16, wherein:
execution of said instructions further causes said processor to train the reinforcement learning based dynamic workload orchestration module during operation using a reward function; and
the reward function includes at least one of: resource utilization of the computing nodes, response time to the microservice constraints, cost efficiency of the computing nodes, energy consumption of the computing nodes, or combinations thereof.

### Claim 20 (depends on 16)

The computer system of claim 16, wherein:
the distributed computing environment is configured to receive microservice applications from a database of microservices for execution by the one or more computing nodes;
the microservice deployment scheduler is executed on a dedicated computing node; and
the dedicated computing node functions as a gateway between the database of microservices and the one or more computing nodes.
