Comparing video encoders/decoders using shot-based encoding and a perceptual visual quality metric

One or more non-transitory computer readable media including instructions that, when executed by one or more processors, cause the one or more processors to compare the performance of different configured encoders by performing the steps of:

• generating a first global convex hull of video encode points based on a first configured encoder and a plurality of subsequences included in a source video sequence, wherein each video encode point is associated with a different encoded version of the source video sequence, a different bitrate, and a different quality score;
• generating a second global convex hull of video encode points based on a second configured encoder and the plurality of subsequences;
• and
• computing a first performance value for an encoding comparison metric based on the first global convex hull and the second global convex hull, wherein the first performance value estimates a difference in performance between the first configured encoder and the second configured encoder.

A system for comparing the performance of different configured encoders, the system comprising:

• one or more memories storing instructions;
• and
• one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to:
• generate a first global convex hull of video encode points based on a first configured encoder and a plurality of subsequences included in a source video sequence, wherein each video encode point is associated with a different encoded version of the source video sequence;
• generate a second global convex hull of video encode points based on a second configured encoder and the plurality of subsequences;
• and
• compute a first performance value for an encoding comparison metric based on at least a first portion of the first global convex hull and at least a second portion of the second global convex hull, wherein the first performance value estimates a difference in performance between the first configured encoder and the second configured encoder.