Distributing Model Data in Memories in Nodes in an Electronic Device
AssigneeAdvanced Micro Devices, Inc.
InventorsMohamed Assem Abd ElMohsen Ibrahim, Onur Kayiran, Shaizeen Aga
Life of this patent
Estimating the term…
Loading patent…
AssigneeAdvanced Micro Devices, Inc.
InventorsMohamed Assem Abd ElMohsen Ibrahim, Onur Kayiran, Shaizeen Aga
Estimating the term…
An electronic device includes a plurality of nodes, each node having a processor that performs operations for processing instances of input data through a model, a local memory that stores a separate portion of model data for the model, and a controller. The controller identifies model data that meets one or more predetermined conditions in the separate portion of the model data in the local memory in some or all of the nodes that is accessible by the processors when processing the instances of input data through the model. The controller then copies the model data that meets the one or more predetermined conditions from the separate portion of the model data in the local memory in the some or all of the nodes to local memories in other nodes. In this way, the controller distributes model data that meets the one or more predetermined conditions among the nodes, making the model data that meets the one or more predetermined conditions available to the nodes without performing remote memory accesses.
An electronic device, comprising:
A method for distributing model data for a model in an electronic device that includes a plurality of nodes, each node including a processor that performs operations for processing instances of input data through the model and a local memory that stores a separate portion of model data for the model, the method comprising:
Dependencies are inferred from the claim text.