Back to results
US 10,884,485 B2Granted
Power optimization in an artificial intelligence processor
AssigneeGroq, Inc.
InventorSushma Honnavara-Prasad
Life of this patent
Estimating the term…
Loading patent…
Loading patent…
AssigneeGroq, Inc.
InventorSushma Honnavara-Prasad
Estimating the term…
In one embodiment, the present disclosure includes a method of reducing power in an artificial intelligence processor. For each cycle, over a plurality of cycles, an AI model is translated into operations executable on an artificial intelligence processor. The translating is based on power parameters that correspond to power consumption and performance of the artificial intelligence processor. The AI processor is configured with the executable operations, and input activation data sets are processed. Accordingly, result sets, power consumption data, and performance data are generated and stored over the plurality of cycles. The method further includes training an AI algorithm using the stored parameters, the power consumption data, and the performance data. A trained AI algorithm outputs a plurality of optimized parameters to reduce power consumption of the AI processor. The AI model is then translated into optimized executable operations based on the plurality of optimized parameters.
A method of reducing power in an artificial intelligence (AI) processor comprising:
An inference system comprising:
A non-transitory computer-readable storage medium having stored thereon computer executable instructions, which when executed by a compiler operating on at least one computer processor, cause the at least one computer processor to be operable for:
Dependencies are inferred from the claim text.