Chiplet based artificial intelligence accelerators and configuration methods
AssigneeMemryX Incorporated
InventorsChing-Yu KO, Chester LIU, Mohammed ZIDAN, Jacob BOTIMER, Timothy WESLEY, Zhengya ZHANG, Wei LU
Life of this patent
Estimating the term…
Abstract
A processing unit can include a plurality of chiplets coupled in a cascade topology by a plurality of interfaces. A set of the plurality of cascade coupled chiplets can be configured to execute a plurality of layers or blocks of layers of an artificial intelligence model. The set of cascade coupled chiplets can also be configured with parameter data of corresponding ones of the plurality of layers or blocks of layers of the artificial intelligence model.
Claims21
An processing unit comprising:
- a plurality of chiplets including interfaces to communicatively cascade the plurality of chiplets or subsets of the chiplets together, wherein the plurality of chiplets or the subsets of the chiplets are configurable to execute layers or blocks of layers of one or more artificial intelligence models, wherein the plurality of chiplets or the subsets of the chiplets are configurable with parameter data of the one or more artificial intelligence models.
A method of configuring a processing unit comprising:
- mapping a plurality of layers of an artificial intelligence model to a set of cascaded chiplets;
- configuring the cascaded chiplets to execute the plurality of layers of the artificial intelligence model based on the mapping;
- and
- configuring the cascaded chiplets with parameter data of corresponding ones of the plurality of layers of the artificial intelligence model.
A method of configuring a processing unit comprising:
- coupling, in a package, a plurality of artificial intelligence accelerator chiplets in a cascade topology by a plurality of interfaces;
- configuring a set of the plurality of cascade coupled chiplets to execute a plurality of layers or blocks of layers of the artificial intelligence model;
- and
- configuring the set of the plurality of cascade coupled chiplets with parameter data of corresponding ones of the plurality of layers or blocks of layers of the artificial intelligence model.
Dependencies are inferred from the claim text.