Network-based machine learning model discovery and benchmarking

A non-transitory computer-readable storage medium storing instructions which, when executed by a processing system including at least one processor, cause the processing system to perform operations, the operations comprising:

• receiving a data processing task from a user device;
• determining a plurality of sub-tasks of the data processing task;
• determining a plurality of machine learning models for performing the plurality of sub-tasks;
• arranging the plurality of machine learning models into a plurality of candidate solutions, wherein each of the plurality of candidate solutions is capable of performing the data processing task;
• evaluating the plurality of candidate solutions using a test data set, wherein the evaluating provides measures of a plurality of performance metrics for each of the plurality of candidate solutions;
• and
• providing at least one of the plurality of candidate solutions to the user device, wherein the at least one of the plurality of candidate solutions is selected based upon the measures of the plurality of performance metrics.

A device comprising:

• a processing system including at least one processor;
• and
• a computer-readable medium storing instructions which, when executed by the processor, cause the processor to perform operations, the operations comprising:
• receiving a data processing task from a user device;
• determining a plurality of sub-tasks of the data processing task;
• determining a plurality of machine learning models for performing the plurality of sub-tasks;
• arranging the plurality of machine learning models into a plurality of candidate solutions, wherein each of the plurality of candidate solutions is capable of performing the data processing task;
• evaluating the plurality of candidate solutions using a test data set, wherein the evaluating provides measures of a plurality of performance metrics for each of the plurality of candidate solutions;
• and
• providing at least one of the plurality of candidate solutions to the user device, wherein the at least one of the plurality of candidate solutions is selected based upon the measures of the plurality of performance metrics.