Hypertuning a machine learning model microservices configuration to optimize latency
AssigneeMaplebear, Inc.(dba Instacart)
InventorsSahil Khanna, Reza Sadri, Jacob Jensen
Life of this patent
Estimating the term…
Loading patent…
AssigneeMaplebear, Inc.(dba Instacart)
InventorsSahil Khanna, Reza Sadri, Jacob Jensen
Estimating the term…
An online system facilitates various functions using machine learning model microservices. A tuning mechanism tunes various configuration parameters for each microservice that control allocation of computing resources and other configurations of physical and/or virtual machines that implement the microservices. Tuning may be performed in part by executing tests under various configurations and evaluating an objective function associated with the different configurations. Furthermore, parameters of the objective function may be set based on a trained learning model that learns baseline parameters and weights of the objective function based on historical data.
A method comprising, at a computer system comprising a processor and a computer-readable medium:
A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform steps including:
A computer system comprising:
Dependencies are inferred from the claim text.