Information handling system with local model resource allocation
AssigneeDell Products L.P.
InventorsJacob Mink, Spencer Bull, Tyler Cox, Nicholas Wanner, Srikanth Kondapi
Life of this patent
Estimating the term…
Abstract
An information handling system stores a multiple machine learning (ML) models. The system receives a job request that includes input parameters and constraints for a job associated with the job request. Based on the input parameters and the constraints, the system identifies first and second ML models available to execute the job. The system also generates a first score for the first ML model and a second score for the second ML model. Based on the first score being greater than the second score, the system provides the job to a compute resource associated with the first ML model.
Claims20
An information handling system comprising:
- a memory to store a plurality of machine learning (ML) models;
- and
- a processor to communicate with the memory, the processor to:
- receive a job request including input parameters and constraints for a job associated with the job request;
- based on the input parameters and the constraints, identify first and second ML models available to execute the job;
- generate a first score for the first ML model and a second score for the second ML model;
- and
- based on the first score being greater than the second score, provide the job to a compute resource associated with the first ML model.
A method comprising:
- storing, in an information handling system, a plurality of machine learning (ML) models;
- receiving, by the information handling system, a job request including input parameters and constraints for a job associated with the job request;
- based on the input parameters and the constraints, identifying first and second ML models available to execute the job;
- generating a first score for the first ML model and a second score for the second ML model;
- and
- based on the first score being greater than the second score, providing the job to a compute resource associated with the first ML model.
A method comprising:
- receiving, by an information handling system, a first job request from a first application, wherein the first job request includes first quality of service (QoS) requirements for a first job of the first application;
- determining a first machine learning (ML) model to execute the first job;
- receiving, by the system, a second job request from a second application, wherein the second job request includes second QoS requirements for a second job of the second application;
- determining a second ML model to execute the second job;
- determining a conflict between the first QoS requirements and the second QoS requirements;
- and
- based on the conflict, allocate resources between the first ML model and the second ML model based on priority levels of the first and second applications.
Dependencies are inferred from the claim text.