Large language model deployment

Abstract

An example computer system for deploying one or more large language models, the computer system comprising: one or more processors; and non-transitory computer-readable storage media encoding instructions which, when executed by the one or more processors, causes the computer system to: manage deployment of one or more machine learning models; generate model configuration files, wherein the model configuration files implement the one or more machine learning models in one or more environments and provide a specification library used to configure the one or more machine learning models; determine scores of a performance of the one or more machine learning models in the one or more environments; and store the model configuration files that are used to deploy each corresponding machine learning model.

Dependencies are inferred from the claim text.