Workload based graphics processing unit (GPU) performance adjustment for energy efficiency

A system for improving energy efficiency in a distributed system including a plurality of processing units comprising:

• a computer system including at least one processor and a memory, and configured to perform operations including:
• configuring an initial power limit for each processing unit in the distributed system;
• initiating processing of a workload by plurality of processing units in the distributed system, wherein the workload is associated with a target workload performance level;
• during the processing of the workload:
• identifying a peak workload performance level associated with the processing of the workload based on telemetry data received from the plurality of processing units in the distributed system;
• determining that the peak workload performance level is less than the target workload performance level;
• and
• in response to determining that the peak workload performance level is less than the target workload performance level, configuring an increased power limit for at least a portion of the processing units in the distributed system, wherein the increased power limit is greater than the initial power limit.

An article of manufacture comprising a non-transitory, computer-readable medium having computer-executable instructions thereon that are executable by a processor of a computer system to perform operations for improving energy efficiency in a distributed system including a plurality of processing units, the operations comprising:

• configuring an initial power limit for each processing unit in the distributed system;
• initiating processing of a workload by plurality of processing units in the distributed system, wherein the workload is associated with a target workload performance level;
• during the processing of the workload:
• identifying a peak workload performance level associated with the processing of the workload based on telemetry data received from the plurality of processing units in the distributed system;
• determining that the peak workload performance level is less than the target workload performance level;
• and
• in response to determining that the peak workload performance level is less than the target performance level, configuring an increased power limit for at least a portion of the processing units in the distributed system, wherein the increased power limit is greater than the initial power limit.