Automatically detecting and managing anomalies in statistical models
AssigneeLinkedIn Corporation
InventorsAjith Muralidharan, Yiming Ma, Florian Raudies, Yi Zhen
Life of this patent
Estimating the term…
Abstract
The disclosed embodiments provide a system for managing the execution of a statistical model. During operation, the system tracks a distribution of one or more metrics related to a performance of a first version of a statistical model. When a deviation in the distribution is detected, the system outputs an alert of an anomaly in the performance of the statistical model. The system also triggers a rollback to a second version of the statistical model.
Claims20
A method, comprising:
- tracking, by a computer system, a distribution of one or more metrics related to a performance of a first version of a statistical model;
- and
- determining a change in a performance of the first version of the statistical model based on a deviation in the distribution;
- responsive to determining the change in the performance of the current version, selecting a second version of the statistical model from a set of additional versions of the statistical model;
- and
- triggering a rollback to the second version of the statistical model.
An apparatus, comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the apparatus to:
- track a distribution of one or more metrics related to a performance of a first version of a statistical model;
- determine a change in a performance of the first version of the statistical model based on a deviation in the distribution;
- responsive to determining the change in the performance of the current version, selecting a second version of the statistical model from a set of additional versions of the statistical model;
- and
- triggering a rollback to a second version of the statistical model.
A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method, the method comprising:
- tracking a distribution of one or more metrics related to a performance of a first version of a statistical model;
- and
- determining a change in a performance of the first version of the statistical model based on a deviation in the distribution;
- responsive to determining the change in the performance of the current version, selecting a second version of the statistical model from a set of additional versions of the statistical model;
- and
- triggering a rollback to the second version of the statistical model.
Dependencies are inferred from the claim text.