System and method for managing inference model performance through inference generation path restructuring
AssigneeDell Products L.P.
InventorsOFIR EZRIELEV, JEHUDA SHEMER, TOMER KUSHNIR
Life of this patent
Estimating the term…
Loading patent…
AssigneeDell Products L.P.
InventorsOFIR EZRIELEV, JEHUDA SHEMER, TOMER KUSHNIR
Estimating the term…
Methods and systems for managing execution of an inference model hosted by data processing systems are disclosed. To manage execution of the inference model hosted by the data processing systems, a system may include an inference model manager and any number of data processing systems. The inference model manager may monitor the risk of unsuccessful execution of the inference model by the data processing systems and may proactively take action to support inference generation in the event of reduced functionality of one or more of the data processing systems. The inference model manager may distribute multiple redundant instances of the inference model so that each data processing system only hosts one instance of the inference model. Inference model manager may also obtain an execution plan to respond to a failure of one or more data processing systems to ensure no inference model bottlenecks occur during re-deployment of the inference model.
A method of managing execution of an inference model hosted by data processing systems, the method comprising:
A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for managing execution of an inference model hosted by data processing systems, the operations comprising:
A data processing system, comprising:
Dependencies are inferred from the claim text.