US 12,001,932 B2 · Hierarchical reinforcement learning algorithm for NFV server power management

Abstract

Methods and apparatus for hierarchical reinforcement learning (RL) algorithm for network function virtualization (NFV) server power management. A first RL model at a first layer is trained by adjusting a frequency of the core of processor while performing a workload to obtain a first trained RL model. The trained RL model is operated in an inference mode while training a second RL model at a second level in the RL hierarchy by adjusting a frequency of the core and a frequency of processor circuitry external to the core to obtain a second trained RL model. Training may be performed online or offline. The first and second RL models are operated in inference modes during online operations to adjust the frequency of the core and the frequency of the circuitry external to the core while executing software on the plurality of cores of to perform a workload, such as an NFV workload.

Claims23

Dependent claims

A method implemented in one or more systems, each including a processor having a core comprising a first portion of circuitry including a plurality of cores and a second portion of circuitry external to the core, the method comprising:

while executing software on a first processor in a first system to perform a first workload,
training a first machine learning (ML) model by adjusting a frequency of the core of the first processor to obtain a first trained ML model;
and
implementing the trained ML model in an inference mode while training a second ML model by adjusting a frequency of the core and a frequency of the second portion of circuitry of the first processor to obtain a second trained ML model.

1 more element

Dependencies are inferred from the claim text.

Hierarchical reinforcement learning algorithm for NFV server power management

Life of this patent

Hierarchical reinforcement learning algorithm for NFV server power management

Life of this patent

Abstract

Claims23