Back to results
US 12,614,094 B2Granted
System and method for managing data processing systems hosting distributed inference models
AssigneeDell Products L.P.
InventorsOfir Ezrielev, Jehuda Shemer, Tomer Kushnir
Life of this patent
Estimating the term…
Abstract
Methods and systems for managing inference models hosted by data processing systems are disclosed. To manage the inference models, data processing systems that host the inference models may be monitored for risk of compromise. The data processing systems may be monitored by evaluating the processing results generated by the data processing systems. When a data processing system is identified as being compromised, a self-healing process or other remediation process may be initiated to reduce or eliminate the threat to successful inference generation presented by the compromised data processing system.
Claims20
A method of managing inference models hosted by data processing systems, the method comprising:
- obtaining a first processing result from a first data processing system that hosts a portion of a first distributed inference model hosted by a first portion of the data processing systems;
- obtaining a second processing result from a second data processing system that hosts a portion of a second distributed inference model hosted by a second portion of the data processing systems;
- making a determination, based at least in part on the first processing result and the second processing result, regarding whether the first data processing system is compromised;
- and
- in an instance of the determination where the first data processing system is compromised:
- initiating self-healing of the first distributed inference model using a third data processing system, that is a separate computing device from both the first data processing system and the second processing system, by at least:
- removing the first data processing system from being a member of the first portion of the data processing systems such that the portion of the first distributed inference model hosted by the first data processing system is excluded from operations of other portions of the first distributed inference model hosted by the first portion of the data processing systems;
- deploying a new instance of the portion of the first distributed inference model to the third data processing system to replace the portion of the first distributed inference model hosed by the first data processing system;
- and
- reconfiguring the other portions of the first distributed inference model hosted by the first portion of the data processing systems to use the new instance of the first distributed inference model hosted by the third data processing system.
7 more elements
A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for managing inference models hosted by data processing systems, the operations comprising:
- obtaining a first processing result from a first data processing system that hosts a portion of a first distributed inference model hosted by a first portion of the data processing systems;
- obtaining a second processing result from a second data processing system that hosts a portion of a second distributed inference model hosted by a second portion of the data processing systems;
- making a determination, based at least in part on the first processing result and the second processing result, regarding whether the first data processing system is compromised;
- and
- in an instance of the determination where the first data processing system is compromised:
- initiating self-healing of the first distributed inference model using a third data processing system, that is a separate computing device from both the first data processing system and the second processing system, by at least:
- removing the first data processing system from being a member of the first portion of the data processing systems such that the portion of the first distributed inference model hosted by the first data processing system is excluded from operations of other portions of the first distributed inference model hosted by the first portion of the data processing systems;
- deploying a new instance of the portion of the first distributed inference model to the third data processing system to replace the portion of the first distributed inference model hosed by the first data processing system;
- and
- reconfiguring the other portions of the first distributed inference model hosted by the first portion of the data processing systems to use the new instance of the first distributed inference model hosted by the third data processing system.
7 more elements
A data processing system, comprising:
- a processor;
- and
- a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations for managing a distribution of inference models hosted by data processing systems, the operations comprising:
- obtaining a first processing result from a first data processing system that hosts a portion of a first distributed inference model hosted by a first portion of the data processing systems;
- obtaining a second processing result from a second data processing system that hosts a portion of a second distributed inference model hosted by a second portion of the data processing systems;
- making a determination, based at least in part on the first processing result and the second processing result, regarding whether the first data processing system is compromised;
- and
- in an instance of the determination where the first data processing system is compromised:
- initiating self-healing of the first distributed inference model using a third data processing system, that is a separate computing device from both the first data processing system and the second processing system, by at least:
- removing the first data processing system from being a member of the first portion of the data processing systems such that the portion of the first distributed inference model hosted by the first data processing system is excluded from operations of other portions of the first distributed inference model hosted by the first portion of the data processing systems;
- deploying a new instance of the portion of the first distributed inference model to the third data processing system to replace the portion of the first distributed inference model hosed by the first data processing system;
- and
- reconfiguring the other portions of the first distributed inference model hosted by the first portion of the data processing systems to use the new instance of the first distributed inference model hosted by the third data processing system.
10 more elements
Dependencies are inferred from the claim text.