Inference model selection method considering task request rate
AssigneeKorea University Research and Business Foundation
InventorsSangheon PACK, Haneul KO, Hyeonjae JEONG
Life of this patent
Estimating the term…
Abstract
Disclosed is an inference model selection method and apparatus considering a task request rate. The inference model selection method is performed by a computing device including a processor and includes monitoring computing resources of the computing device; receiving a task; selecting an inference model to perform inference for the received task; inputting the task into a queue of the selected inference model; and performing an inference operation.
Claims9
An inference model selection method performed by a computing device comprising a processor, the interference model selection method comprising:
- monitoring computing resources of the computing device;
- receiving a task;
- selecting an inference model to perform inference for the received task;
- inputting the task into a queue of the selected inference model;
- and
- performing an inference operation.
Dependencies are inferred from the claim text.