Quality of user experience testing for video transmissions

A method comprising:

• receiving from a camera of a testing system, by a test controller device of the testing system, a video of a display screen of a receiving device captured by the camera while the receiving device plays a video stream;
• receiving, by the test controller device, transmission metrics from at least one device engaged in the transmission of a reference video as the video stream to the receiving device;
• and
• calculating, by the test controller device, a quality of user experience (QoE) score for the video based at least in part on the reference video, the transmission metrics, and one or more QoE models.

One or more non-transitory computer-readable media having stored thereon a plurality of executable instructions, the executable instructions configured to program a test controller device of a testing system to perform operations comprising:

• automating a transmission of a reference video as a video stream from a sending device to a receiving device over at least one network emulator, including providing network impairment settings to the at least one network emulator;
• receiving from a camera of the testing system a video of a display screen of the receiving device captured by the camera while the receiving device plays the video stream;
• receiving transmission metrics from at least one device of the sending device, the receiving device, or the at least one network emulator;
• and
• calculating a quality of user experience (QoE) score for the video based at least in part on the reference video, the transmission metrics, and one or more QoE models.