Efficient model for training a deep learning algorithm
AssigneeGM Cruise Holdings LLC
InventorBurkay Donderici
Life of this patent
Estimating the term…
Abstract
A system may provide a method of training a deep learning (DL) model, comprising: running a first version of the DL model on a first hardware platform using a first input set; running a second version of the DL model on a second hardware platform using the first input set, comprising imperfectly emulating the first hardware platform on the second hardware platform; computing an adjustment based at least in part on a difference in results between the first version of the DL model and second version of the DL model; and training the DL model on the second hardware platform using the adjustment and a plurality of input sets.
Claims20
A method of validating a deep learning (DL) model, comprising:
- running a first version of the DL model on a first hardware platform using a first input set;
- running a second version of the DL model on a second hardware platform using the first input set, comprising imperfectly emulating the first hardware platform on the second hardware platform;
- computing an adjustment based at least in part on a difference in results between the first version of the DL model and second version of the DL model;
- and
- validating the DL model on the second hardware platform using the adjustment and a plurality of input sets.
One or more non-transitory computer-readable storage media having stored thereon executable instructions to:
- receive first intermediate signal and safety data from a bitwise accurate version of a deep learning (DL) model;
- receive second intermediate signal and safety data from an efficient version of the DL model, wherein the efficient version has a fidelity that is not bitwise accurate;
- compute a correction for the efficient version based at least in part on a delta between the first intermediate signal and safety data and the second intermediate signal and safety data;
- and
- train the DL model using the efficient version and the correction.
A computing ecosystem, comprising:
- a first hardware platform comprising a first processor and memory programmed to provide a bitwise accurate version of a deep learning (DL) model;
- a training service comprising a second processor and memory programmed to provide an efficient version of the DL model, wherein the efficient version is not bitwise accurate;
- a reconciliation service comprising a third processor and memory programmed to compare first intermediate data from the bitwise accurate version to second intermediate data from the efficient version, and compute a correction for the efficient version;
- and
- a training service comprising a fourth processor and memory programmed to train the DL model on the efficient version using the correction.
Dependencies are inferred from the claim text.