# US 2023/0409392 A1 · Balanced throughput of replicated partitions in presence of inoperable computational units > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0409392 A1 - Document ID: US20230409392A1 - Status: Published application - Kind: A1 - Application number: 17/844,558 - Filed: 2022-06-20 - Published: 2023-12-21 - Earliest claimed: 2022-06-20 - Assignees: Advanced Micro Devices, Inc. - Applicants: Advanced Micro Devices, Inc. - Inventors: Ashish Jain; Sriram Sundaram; Christopher Allan Poirier; Samuel D. Naffziger - Web page: https://patentgrep.com/patent/US20230409392A1 ## CPC - G06F 1/324: by lowering clock frequency - G06F 9/4893: {taking into account power or heat criteria (power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206)} - G06F 1/206: {comprising thermal management} - G06F 1/26: Power supply means, e.g. regulation thereof (for memories G11C) - G06F 1/3296: by lowering the supply or operating voltage - G06F 9/5094: {where the allocation takes into account power or heat criteria (power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206)} - Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE ## Abstract An apparatus and method for efficiently managing balanced performance among replicated partitions of an integrated circuit despite loss of functionality due to manufacturing defects. A processing unit includes at least two replicated partitions, each assigned to operation parameters of a respective power domain. The partitions include multiple compute units. The compute units include multiple lanes of execution. Due to a variety of types of manufacturing defects, one or more of the partitions of the processing unit has less than a predetermined number of operational compute units. To balance the throughput of the multiple partitions, a power manager generates both static and dynamic scaling factors based on at least the corresponding number of operational compute units. Using these scaling factors, the power manager adjusts the operation parameters of power domains for the partitions relative to one another. ## Claims ### Claim 1 An apparatus comprising: a plurality of partitions, each comprising a plurality of replicated computational units; a power manager configured to: assign a first set of operating parameters to a first partition of the plurality of partitions, based at least in part on a number of replicated computational units in the first partition that are operational; and assign a second set of operating parameters to a second partition of the plurality of partitions, based at least in part on a number of replicated computational units in the second partition that are operational. ### Claim 2 (depends on 1) The apparatus as recited in claim 1, wherein the first partition and the second partition are configured to process tasks of a workload using the first set of operating parameters and the second set of operating parameters, respectively. ### Claim 3 (depends on 2) The apparatus as recited in claim 2, wherein based on the first set of operating parameters and the second set of operating parameters, a difference between a throughput of the first partition and a throughput of the second partition is less than a threshold. ### Claim 4 (depends on 2) The apparatus as recited in claim 2, wherein each of the plurality of partitions is configured to process the workload using a parallel data microarchitecture. ### Claim 5 (depends on 2) The apparatus as recited in claim 2, wherein in response to determining a condition has been satisfied for updating operating parameters of the plurality of partitions, the power manager is further configured to assign updated values for the first set of operating parameters and the second set of operating parameters. ### Claim 6 (depends on 5) The apparatus as recited in claim 5, wherein the updated values for the first set of operating parameters and the second set of operating parameters are based at least in part on the power manager receiving a plurality of performance metrics monitored during processing of the workload. ### Claim 7 (depends on 5) The apparatus as recited in claim 5, wherein the condition for updating power domains comprises one or more of: determining, by the power manager, a time interval has elapsed; and determining, by the power manager, that a throughput of the plurality of partitions has changed by more than a threshold amount. ### Claim 8 A method, comprising: processing tasks by a plurality of partitions, each comprising a plurality of replicated computational units; assigning, by a power manager, a first set of operating parameters to a first partition of the plurality of partitions, based at least in part on a number of replicated computational units in the first partition that are operational; and assigning, by the power manager, a second set of operating parameters to a second partition of the plurality of partitions, based at least in part on a number of replicated computational units in the second partition that are operational. ### Claim 9 (depends on 8) The method as recited in claim 8, further comprising processing tasks of a workload by the first partition and the second partition using the first set of operating parameters and the second set of operating parameters, respectively. ### Claim 10 (depends on 9) The method as recited in claim 9, wherein based on the first set of operating parameters and the second set of operating parameters, a difference between a throughput of the first partition and a throughput of the second partition is less than a threshold. ### Claim 11 (depends on 9) The method as recited in claim 9, further comprising processing the workload by each of the plurality of partitions using a parallel data microarchitecture. ### Claim 12 (depends on 9) The method as recited in claim 9, wherein in response to determining a condition has been satisfied for updating operating parameters of the plurality of partitions, the method further comprises assigning, by the power manager, updated values for the first set of operating parameters and the second set of operating parameters. ### Claim 13 (depends on 12) The method as recited in claim 12, wherein the updated values for the first set of operating parameters and the second set of operating parameters are based at least in part on the power manager receiving a plurality of performance metrics monitored during processing of the workload. ### Claim 14 (depends on 12) The method as recited in claim 12, wherein the condition for updating power domains comprises one or more of: determining, by the power manager, a time interval has elapsed; and determining, by the power manager, that a throughput of the plurality of partitions has changed by more than a threshold amount. ### Claim 15 A computing system comprising: a memory configured to store one or more applications of a workload; and a processing unit comprising: a plurality of partitions, each comprising a plurality of replicated computational units; a power manager configured to: assign a first set of operating parameters to a first partition of the plurality of partitions, based at least in part on a number of replicated computational units in the first partition that are operational; and assign a second set of operating parameters to a second partition of the plurality of partitions, based at least in part on a number of replicated computational units in the second partition that are operational. ### Claim 16 (depends on 15) The computing system as recited in claim 15, wherein the first partition and the second partition are configured to process tasks of a workload using the first set of operating parameters and the second set of operating parameters, respectively. ### Claim 17 (depends on 16) The computing system as recited in claim 16, wherein based on the first set of operating parameters and the second set of operating parameters, a difference between a throughput of the first partition and a throughput of the second partition is less than a threshold. ### Claim 18 (depends on 16) The computing system as recited in claim 16, wherein each of the plurality of partitions is configured to process the workload using a parallel data microarchitecture. ### Claim 19 (depends on 16) The computing system as recited in claim 16, wherein in response to determining a condition has been satisfied for updating operating parameters of the plurality of partitions, the power manager is further configured to assign updated values for the first set of operating parameters and the second set of operating parameters. ### Claim 20 (depends on 19) The computing system as recited in claim 19, wherein the updated values for the first set of operating parameters and the second set of operating parameters are based at least in part on the power manager receiving a plurality of performance metrics monitored during processing of the workload.