Automated concept drift detection in live machine learning systems for machine learning model updating
AssigneeActimize Ltd.
InventorsDanny BUTVINIK, Yoav AVNEON, Elina MALIARSKY
Life of this patent
Estimating the term…
Loading patent…
AssigneeActimize Ltd.
InventorsDanny BUTVINIK, Yoav AVNEON, Elina MALIARSKY
Estimating the term…
A machine learning (ML) system and methods are provided that are configured to detect concept drift in ML models. The system includes a processor and a computer readable medium operably coupled thereto, the computer readable medium comprising a plurality of instructions stored in association therewith that are accessible to, and executable by, the processor, to perform drift detection operations which include receiving a first data set for use during online training of a first ML model, determining a change to an uncertainty bound metric associated with classifiers for features utilized by the first ML model, identifying that the first data set causes the concept drift with the online training of the first ML model, determining characterization information about a type of the concept drift, generating an ML update paradigm based on the concept drift and the characterization information, alerting an ML model updater of the ML update paradigm.
A machine learning (ML) system configured to detect concept drift in ML models during ML model operations using live data, the ML system comprising:
A method to detect concept drift in ML models during ML model operations using live data, the method comprising:
A non-transitory computer-readable medium having stored thereon computer-readable instructions executable to detect concept drift in ML models during ML model operations using live data, the computer-readable instructions executable to perform drift detection operations which comprises:
Dependencies are inferred from the claim text.