Using a runtime engine to facilitate dynamic adaptation of deep neural networks for efficient processing
AssigneeLatent AI, Inc.
InventorsSek Meng Chai, Jagadeesh Kandasamy
Life of this patent
Estimating the term…
Loading patent…
AssigneeLatent AI, Inc.
InventorsSek Meng Chai, Jagadeesh Kandasamy
Estimating the term…
The disclosed embodiments relate to a system that facilitates dynamic runtime execution of a deep neural network (DNN). During operation, the system receives a model, a set of weights and runtime metadata for the DNN. The system also obtains code to perform inference-processing operations for the DNN. Next, the system compiles code to implement a runtime engine that facilitates throttling operations during execution of the inference-processing operations, wherein the runtime engine conserves computing resources by selecting portions of the inference-processing operations to execute based on the runtime metadata.
A method for facilitating dynamic runtime execution of a deep neural network (DNN), comprising:
A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for facilitating dynamic runtime execution of a deep neural network (DNN), the method comprising:
A system that facilitates dynamic runtime execution of a deep neural network (DNN), comprising:
Dependencies are inferred from the claim text.