Methods and devices for video codec performance measurement and evaluation

An apparatus for processing video data, the apparatus comprising:

• a memory storing instructions;
• and
• a processor in communication with the memory, wherein, when the processor executes the instructions, the processor is configured to cause the apparatus to:
• obtain a first plurality of anchor data points, wherein:
• each anchor data point is generated based on an anchor video bitstream,
• the anchor video bitstream is encoded by an anchor video codec based on a reference video and an anchor encoding parameter set from a first plurality of encoding parameter sets, and
• each anchor data point represents an anchor codec performance corresponding to the anchor encoding parameter set;
• obtain a second plurality of test data points, wherein:
• each test data point is generated based on a test video bitstream,
• the test video bitstream is encoded by a test video codec based on the reference video and a test encoding parameter set from a second plurality of encoding parameter sets;
• each test data point represents a test codec performance corresponding to the test encoding parameter set;
• analyze monotonicity conditions of the first plurality of anchor data points and the second plurality of test data points;
• determine a fitting algorithm based on the analyzed monotonicity conditions;
• fit the first plurality of anchor data points with the fitting algorithm to obtain an anchor curve;
• fit the second plurality of test data points with the fitting algorithm to obtain a test curve;
• and
• evaluate the test codec performance based on the anchor curve and the test curve, to obtain an evaluation result.

A non-transitory computer readable storage medium storing instructions, wherein, when the instructions are executed by a processor, the instructions are configured to cause the processor to:

• obtain a first plurality of anchor data points, wherein:
• each anchor data point is generated based on an anchor video bitstream,
• the anchor video bitstream is encoded by an anchor video codec based on a reference video and an anchor encoding parameter set from a first plurality of encoding parameter sets, and
• each anchor data point represents an anchor codec performance corresponding to the anchor encoding parameter set;
• obtain a second plurality of test data points, wherein:
• each test data point is generated based on a test video bitstream,
• the test video bitstream is encoded by a test video codec based on the reference video and a test encoding parameter set from a second plurality of encoding parameter sets;
• each test data point represents a test codec performance corresponding to the test encoding parameter set;
• analyze monotonicity conditions of the first plurality of anchor data points and the second plurality of test data points;
• determine a fitting algorithm based on the analyzed monotonicity conditions;
• fit the first plurality of anchor data points with the fitting algorithm to obtain an anchor curve;
• fit the second plurality of test data points with the fitting algorithm to obtain a test curve;
• and
• evaluate the test codec performance based on the anchor curve and the test curve, to obtain an evaluation result.