Interactive interfaces for machine learning model evaluations
AssigneeAmazon Technologies, Inc.
InventorsPolly Po Yee Lee, Nicolle M. Correa, Leo Parker Dirac, Aleksandr Mikhaylovich Ingerman
Life of this patent
Estimating the term…
Abstract
A first data set corresponding to an evaluation run of a model is generated at a machine learning service for display via an interactive interface. The data set includes a prediction quality metric. A target value of an interpretation threshold associated with the model is determined based on a detection of a particular client's interaction with the interface. An indication of a change to the prediction quality metric that results from the selection of the target value may be initiated.
Claims21
-24. (canceled)
A method, comprising:
- performing, at one or more computing devices:
- causing to be presented, via one or more graphical interfaces, an indication of a distribution of one or more values obtained from one or more machine learning models;
- obtaining an indication of a requested change to a threshold associated with the one or more values;
- and
- causing the indication of the distribution to be dynamically updated in accordance with the requested change.
A system, comprising:
- one or more computing devices;
- wherein the one or more computing devices include instructions that upon execution on or across one or more processors cause the one or more computing devices to:
- cause to be displayed, via one or more graphical interfaces, an indication of a distribution of one or more values obtained from one or more machine learning models;
- obtain an indication of a requested change to a threshold associated with the one or more values;
- and
- cause the indication of the distribution to be dynamically updated in accordance with the requested change.
One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors cause one or more computer systems to:
- cause to be displayed, via one or more graphical interfaces, an indication of a distribution of one or more values obtained from one or more machine learning models;
- obtain an indication of a requested change to a threshold associated with the one or more values;
- and
- cause the indication of the distribution to be dynamically updated in accordance with the requested change.
Dependencies are inferred from the claim text.