Methods and systems for optimizing a peak memory usage of an artificial neural network graph
AssigneeAptiv Technologies AG
InventorMiguel Angel AGUILAR
Life of this patent
Estimating the term…
Loading patent…
AssigneeAptiv Technologies AG
InventorMiguel Angel AGUILAR
Estimating the term…
A computer implemented method for optimizing a memory usage of an artificial neural network graph comprising a plurality of layers and a plurality of tensors comprises the following steps: for each of the plurality of layers, determining a tensor working set, wherein the tensor working set comprises tensors that consume memory with respect to the respective layer; determining whether at least one working set of the plurality of working sets requires memory usage above a pre-determined threshold; if it is determined that at least one working set of the plurality of working sets requires memory usage above the pre-determined threshold, identifying a working set of the plurality of working sets which requires memory usage above the pre-determined threshold; identifying at least one layer responsible for the memory usage above the pre-determined threshold in the identified working set; and pruning the identified at least one layer.
A computer implemented method for optimizing memory usage of an artificial neural network graph comprising a plurality of layers and a plurality of tensors, the method-comprising the steps:
Dependencies are inferred from the claim text.