US 12,632,101 B2 · Multi-timescale power control technologies

Abstract

The present disclosure is related to power control mechanisms for workload processing systems, and in particular, multi-scale power control technologies that can be used to reduce the overhead of workload processing systems. The disclosed power control mechanisms operate on multiple timescales including a slow timescale and a fast timescale. Separate control loops (or governors) are used for the slow and fast timescales where each control loop includes its own trigger mechanisms and configurable operational policies. The operational policies for slow timescale control loop can be trained separately using various machine learning techniques while the operational policies for the fast timescale control loop can be simple and reactive heuristics.

Claims24

Dependent claims

An apparatus for power management of a compute system, wherein the compute system operates according to a current operational policy, the apparatus comprising:

memory circuitry to store instructions;
and
processor circuitry connected to the memory circuitry, and the processor circuitry is to execute the instructions to:
within a first power management control loop,
monitor first conditions including traffic load conditions of the compute system over a first duration at a first timescale, and
trigger a change from the current operational policy to a first operational policy based on the monitored first conditions;
and
within a second power management control loop, trigger a change from the current operational policy to a second operational policy based on detected variations in second conditions including system load conditions of the compute system, the system load conditions including at least one of processor utilization, memory utilization, or pipeline pressure, over a second duration at a second timescale, wherein the second timescale is smaller than the first timescale.

5 more elements

A method of managing operation of a workload processing system, the method comprising:

operating a first control loop including:
monitoring a first condition including traffic load conditions of the workload processing system over a first timescale, and
triggering a change from a current operational policy of the workload processing system to a first operational policy of the workload processing system based on the monitored first condition;
and
operating a second control loop including:
detecting variations in a second condition including system load conditions of the workload processing system, the system load conditions including at least one of processor utilization, memory utilization, or pipeline pressure, over a second timescale, wherein the second timescale is smaller than the first timescale, and
triggering a change from the current operational policy of the workload processing system to a second operational policy based on the detected variations in the second condition.

4 more elements

One or more non-transitory computer readable media (NTCRM) comprising instructions for managing operation of a workload processing system, wherein execution of the instructions is to cause a compute node to:

within a first control loop,
monitor first conditions including traffic load conditions of the workload processing system over a first timescale, and
trigger a change from a current operational policy of the workload processing system to a first operational policy based on the monitored first conditions;
and
operating a second control loop including:
detecting variations in second conditions including system load conditions of the workload processing system, the system load conditions including at least one of processor utilization, memory utilization, or pipeline pressure, over a second timescale, wherein the second timescale is smaller than the first timescale, and
trigger a change from the current operational policy of the workload processing system to a second operational policy based on the detected variations in the second conditions.

4 more elements

Dependencies are inferred from the claim text.

Multi-timescale power control technologies

Life of this patent

Multi-timescale power control technologies

Life of this patent

Abstract

Claims24