Thermal aware performance/power management for concurrent operation of large models
AssigneeQUALCOMM Incorporated
InventorsSiddhant GUPTA, Nikhil Kumar KANSAL
Life of this patent
Estimating the term…
Abstract
A processor-implemented method for thermal aware performance/power management for concurrent operation of large models includes monitoring a first temperature of one or more of the plurality of processors. Each of the one or more processors executes a machine learning model workload. The processor-implemented method also includes determining if the first temperature of the one or more of the plurality of processors is within one of a set of temperature zones. Power to the one or more of the plurality of processors is controlled based on the one of the set of temperature zones in which the first temperature of the one or more of the plurality of processors lies.
Claims20
An apparatus, comprising:
- at least one memory;
- and
- a plurality of processors coupled to the at least one memory, at least one processor of the plurality of processors configured to:
- monitor a first temperature of one or more of the plurality of processors, each of the one or more processors executing a machine learning model workload;
- determine if the first temperature of the one or more of the plurality of processors is within one of a set of temperature zones;
- and
- control power to the one or more of the plurality of processors based on the one of the set of temperature zones in which the first temperature of the one or more of the plurality of processors lies.
A processor-implemented method performed by at least one processor, the processor-implemented method comprising:
- monitoring a first temperature of one or more of the plurality of processors, each of the one or more processors executing a machine learning model workload;
- determining if the first temperature of the one or more of the plurality of processors is within one of a set of temperature zones;
- and
- controlling power to the one or more of the plurality of processors based on the one of the set of temperature zones in which the first temperature of the one or more of the plurality of processors lies.
An apparatus, comprising:
- means for monitoring a first temperature of one or more of the plurality of processors, each of the one or more processors executing a machine learning model workload;
- means for determining if the first temperature of the one or more of the plurality of processors is within one of a set of temperature zones;
- and
- means for control power to the one or more of the plurality of processors based on the one of the set of temperature zones in which the first temperature of the one or more of the plurality of processors lies.
Dependencies are inferred from the claim text.