# US 2024/0004444 A1 · Rest-of-chip power optimization through data fabric performance state management

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004444 A1
- Document ID: US20240004444A1
- Status: Published application
- Kind: A1
- Application number: 17/855,054
- Filed: 2022-06-30
- Published: 2024-01-04
- Earliest claimed: 2022-06-30
- Assignees: Advanced Micro Devices, Inc.; ATI Technologies ULC
- Applicants: Advanced Micro Devices, Inc.; ATI Technologies ULC
- Inventors: Karthik Rao; Indrani Paul; Dana Glenn Lewis; Brett Danier Anil Ramautarsingh; Jeffrey Ka-Chun Lui; Prasanthy Loganaathan; Jun Huang; Ho Hin Lau; Zhidong Xu
- Web page: https://patentgrep.com/patent/US20240004444A1

## CPC

- G06F 1/26: Power supply means, e.g. regulation thereof (for memories G11C)
- G06F 1/324: by lowering clock frequency
- G06F 1/3206: Monitoring of events, devices or parameters that trigger a change in power modality
- G06F 1/3243: {Power saving in microcontroller unit}
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Methods and systems are disclosed for managing performance states of a data fabric of a system on chip (SoC). Techniques disclosed include determining a performance state of the data fabric based on data fabric bandwidth utilizations of respective components of the SoC. A metric, characteristic of a workload centric to cores of the SoC, is derived from hardware counters, and, based on the metric, it is determined whether to alter the performance state.

## Claims

### Claim 1

A method for managing performance states of a data fabric of a system on chip (SoC), comprising:
determining, by a power controller of the SoC, a performance state of the data fabric;
deriving a metric characteristic of a workload executing on the cores of the SoC; and
altering, based on the metric, the performance state of the data fabric.

### Claim 2 (depends on 1)

The method of claim 1, wherein altering the performance state of the data fabric comprises setting a new performance state that utilizes lower operating frequencies.

### Claim 3 (depends on 1)

The method of claim 1, wherein altering the performance state of the data fabric comprises setting a new performance state that utilizes a lowest operating frequency out of operating frequencies of a set of performance states that the data fabric can occupy.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determining, based on the metric, whether to alter the determined performance state comprises:
classifying, based on the metric, the workload according to applications that generated the workload.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining the performance state of the data fabric is performed based on data fabric bandwidth utilizations of one or more components of the SoC.

### Claim 6 (depends on 1)

The method of claim 1, wherein the deriving of the metric comprises:
for each core of the cores:
sampling data stored in a counter, of the hardware counters, associated with the core, and
determining a core-metric, associated with the core, as a function of the samples; and
deriving the metric based on the determined core-metrics associated with the cores.

### Claim 7 (depends on 1)

The method of claim 1, wherein counters, of the hardware counters, store data representative of a rate of instructions processed by respective cores.

### Claim 8 (depends on 1)

The method of claim 1, wherein counters, of the hardware counters, store data representative of a ratio of time a respective core, of the cores, is stalling.

### Claim 9

A system for managing performance states of a data fabric of an SoC, comprising:
at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the processor to:
determine, by a power controller of the SoC, a performance state of the data fabric,
derive a metric from one or more hardware counters, and
alter, based on the metric, the performance state of the data fabric.

### Claim 10 (depends on 9)

The system of claim 9, wherein altering the performance state of the data fabric comprises setting a new performance state that utilizes lower operating frequencies.

### Claim 11 (depends on 9)

The system of claim 9, wherein altering the performance state of the data fabric comprises setting a new performance state that utilizes a lowest operating frequency out of operating frequencies of a set of performance states that the data fabric can occupy.

### Claim 12 (depends on 9)

The system of claim 9, wherein the determining, based on the metric, whether to alter the determined performance state comprises:
classifying, based on the metric, the workload according to key applications that generated the workload.

### Claim 13 (depends on 9)

The system of claim 9, wherein determining the performance state of the data fabric is performed based on data fabric bandwidth utilizations of one or more components of the SoC.

### Claim 14 (depends on 9)

The system of claim 9, wherein the deriving of the metric comprises:
for each core of the cores:
sampling data stored in a counter, of the hardware counters, associated with the core, and
determining a core-metric, associated with the core, as a function of the samples; and
deriving the metric based on the determined core-metrics associated with the cores.

### Claim 15 (depends on 9)

The system of claim 9, wherein counters, of the hardware counters, store data representative of a rate of instructions processed by respective cores.

### Claim 16 (depends on 9)

The system of claim 9, wherein counters, of the hardware counters, store data representative of a ratio of time a respective core, of the cores, is stalling.

### Claim 17

A non-transitory computer-readable medium comprising instructions executable by at least one processor to perform a method for managing performance states of a data fabric of an SoC, the method comprising:
determining, by a power controller of the SoC, a performance state of the data fabric;
deriving a metric from one or more hardware counters; and
altering, based on the metric, the performance state of the data fabric.

### Claim 18 (depends on 17)

The medium of claim 17, wherein altering the performance state of the data fabric comprises setting a new performance state that utilizes lower operating frequencies.

### Claim 19 (depends on 17)

The medium of claim 17, wherein counters, of the hardware counters, store data representative of a rate of instructions processed by respective cores.

### Claim 20 (depends on 17)

The medium of claim 17, wherein counters, of the hardware counters, store data representative of a ratio of time a respective core, of the cores, is stalling.
