US 2021/0241130 A1 · Performance Improvement Recommendations for Machine Learning Models

Abstract

Techniques are provided for generating performance improvement recommendations for machine learning models. One method comprises evaluating performance metrics for multiple implementations of a machine learning model; computing a performance score that aggregates the performance metrics for a given machine learning model implementation; and recommending a modification to the given machine learning model implementation based on the performance score by evaluating one or more performance metrics for the given implementation relative to at least one additional performance metric for the given implementation, wherein the recommended modification is based on a performance with the recommended modification for another implementation. A given performance metric may be weighted based on an expected improvement from modifying a factor related to the given performance metric. The recommended modification to the given machine learning model implementation may comprise an indication of the expected improvement for the modification.

Claims20

Dependent claims

A method comprising:

evaluating a plurality of performance metrics for each of a plurality of implementations of a machine learning model;
computing a performance score that aggregates the plurality of performance metrics for a given implementation of the machine learning model;
and
recommending at least one modification to the given implementation of the machine learning model based at least in part on the performance score by evaluating one or more of the plurality of performance metrics for the given implementation of the machine learning model relative to one or more additional ones of the plurality of performance metrics for the given implementation of the machine learning model, wherein the at least one recommended modification is based at least in part on a performance with the at least one recommended modification for at least one other implementation,
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

2 more elements

An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured to implement the following steps:
evaluating a plurality of performance metrics for each of a plurality of implementations of a machine learning model;
computing a performance score that aggregates the plurality of performance metrics for a given implementation of the machine learning model;
and
recommending at least one modification to the given implementation of the machine learning model based at least in part on the performance score by evaluating one or more of the plurality of performance metrics for the given implementation of the machine learning model relative to one or more additional ones of the plurality of performance metrics for the given implementation of the machine learning model, wherein the at least one recommended modification is based at least in part on a performance with the at least one recommended modification for at least one other implementation.

3 more elements

A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform the following steps:

evaluating a plurality of performance metrics for each of a plurality of implementations of a machine learning model;
computing a performance score that aggregates the plurality of performance metrics for a given implementation of the machine learning model;
and
recommending at least one modification to the given implementation of the machine learning model based at least in part on the performance score by evaluating one or more of the plurality of performance metrics for the given implementation of the machine learning model relative to one or more additional ones of the plurality of performance metrics for the given implementation of the machine learning model, wherein the at least one recommended modification is based at least in part on a performance with the at least one recommended modification for at least one other implementation.

1 more element

Dependencies are inferred from the claim text.

Performance Improvement Recommendations for Machine Learning Models

Life of this patent

Performance Improvement Recommendations for Machine Learning Models

Life of this patent

Abstract

Claims20