Automated versioning and evaluation of machine learning workflows

A non-transitory, computer-readable medium having instructions stored thereon that are executable by a computing device to perform operations comprising:

• determining a set of configurations for one or more tasks of a machine learning workflow;
• for each configuration in the set of configurations,
• generating an identifier for the configuration based, at least in part, on parameters indicated in the configuration;
• executing the machine learning workflow in accordance with the configuration;
• and
• recording metrics related to the execution of the machine learning workflow in association with the identifier;
• and
• identifying an optimal configuration from the set of configurations for the machine learning workflow based, at least in part, on the metrics.

An apparatus comprising:

• a database comprising identifiers associated with executions of a first machine learning workflow;
• a model repository comprising a plurality of machine learning models;
• a processor;
• and
• a computer-readable medium having instructions stored thereon that are executable by the processor to cause the apparatus to,
• determine a first configuration for the first machine learning workflow, wherein the first configuration specifies one or more models in the model repository;
• generate a first identifier for the first configuration based, at least in part, on one or more parameters indicated in the first configuration;
• execute the first machine learning workflow in accordance with the first configuration;
• and
• store results of the execution of the first machine learning workflow in accordance with the first configuration along with the first identifier in the database.