Real time context dependent deep learning

An electronic device, comprising:

• an interconnect fabric;
• a general purpose graphics processing unit (GPGPU) comprising a plurality of streaming multiprocessors (SMs) communicatively coupled to the interconnect fabric and comprising a plurality of execution resources and a local cache memory, the GPGPU to:
• receive a plurality of data inputs for training a neural network executed by the plurality of SMs, wherein the data inputs comprise training data and weights inputs;
• represent the training data in a low precision form in a memory of at least one of the plurality of SMs;
• represent the weight inputs in a high precision form in the memory of at least one of the plurality of SMs, wherein the low precision form is lower relative to the high precision form;
• perform measurements of compute power and latency on the plurality of SMs of the GPGPU;
• determine a ratio of the compute power for the plurality of SMs;
• and
• assign the training data in the lower precision form and the weight inputs in the high precision form among the plurality of SMs in accordance with the ratio of the compute power and in accordance with the latency of the plurality of SMs;
• and
• a display device communicably coupled to the GPGPU.

A method comprising:

• receiving, in a general purpose graphics processing unit (GPGPU) comprising a plurality of streaming multiprocessors (SMs) communicatively coupled to an interconnect fabric and comprising a plurality of execution resources and a local cache memory, a plurality of data inputs for training a neural network executed by the plurality of SMs, wherein the data inputs comprise training data and weights inputs;
• representing the training data in a low precision form in a memory of at least one of the plurality of SMs;
• representing the weight inputs in a high precision form in the memory of at least one of the plurality of SMs, wherein the low precision form is lower relative to the high precision form;
• performing measurements of compute power and latency on the plurality of SMs of the GPGPU;
• determining a ratio of the compute power for the plurality of SMs;
• and
• assigning the training data in the lower precision form and the weight inputs in the high precision form among the plurality of SMs in accordance with the ratio of the compute power and in accordance with the latency of the plurality of SMs.

A non-transitory machine-readable storage medium having stored thereon executable computer program instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• receiving, in a general purpose graphics processing unit (GPGPU) comprising a plurality of streaming multiprocessors (SMs) communicatively coupled to an interconnect fabric and comprising a plurality of execution resources and a local cache memory, a plurality of data inputs for training a neural network executed by the plurality of SMs, wherein the data inputs comprise training data and weights inputs;
• representing the training data in a low precision form in a memory of at least one of the plurality of SMs;
• representing the weight inputs in a high precision form in the memory of at least one of the plurality of SMs, wherein the low precision form is lower relative to the high precision form;
• performing measurements of compute power and latency on the plurality of SMs of the GPGPU;
• determining a ratio of the compute power for the plurality of SMs;
• and
• assigning the training data in the lower precision form and the weight inputs in the high precision form among the plurality of SMs in accordance with the ratio of the compute power and in accordance with the latency of the plurality of SMs.