Training data effectiveness evaluation method, system, and device

A training data effectiveness evaluation method, comprising:

• acquiring a training set, wherein the training set is acquired by uniform downsampling from target data;
• acquiring a test set, wherein the test set comprises a benchmark test set and a correlated test set;
• training a probe model based on the training set;
• testing the probe model based on the test set, and recording test metrics;
• generating an observation plot based on the test metrics, wherein the generating the observation plot comprises:
• establishing a Cartesian coordinate system with a test metric of the benchmark test set as a horizontal axis and a test metric of the correlated test set as a vertical axis;
• and plotting key points in the Cartesian coordinate system based on the test metrics as follows:
• reading the test metrics corresponding to the horizontal axis and the vertical axis of an optimization stage to form coordinates, and plotting a key point;
• and traversing all optimization stages to plot other key points;
• and
• evaluating effectiveness of the target data based on the observation plot, comprising:
• fitting a curve to the key points, and evaluating by comparing positions of the curve corresponding to different target data;
• determining that, if the test metric of the correlated test set is better when smaller, a lower position of the curve indicates better training data effectiveness;
• and determining that, if the test metric of the correlated test set is better when larger, a higher position of the curve indicates better training data effectiveness.