Gaze based video stream processing

A computing device for processing video streams, the computing device comprising:

• a gaze detector;
• and
• a stream processor;
• wherein:
• the computing device is configured to receive a plurality of video streams for display by a display device, the plurality of video streams having respective initial image quality levels;
• the gaze detector is configured to estimate an estimated gaze location of a user of the display device;
• the stream processor is configured to process some video streams of the plurality of video streams to have a modified image quality level based on the estimated gaze location, the modified image quality level being higher than a corresponding initial image quality level;
• and
• the system is configured to display the processed video streams and remaining video streams of the plurality of video streams via the display device, the remaining video streams having the respective initial image quality levels.

A computing device for processing video streams, the computing device comprising:

• a gaze detector;
• and
• a stream processor;
• wherein:
• the computing device is configured to receive a plurality of video streams for transmission to a plurality of display devices, the plurality of video streams having respective initial image quality levels;
• the gaze detector is configured to estimate respective estimated gaze locations of users of the plurality of display devices based on images from the plurality of video streams using a neural network model;
• the stream processor is configured to:
• process some video streams of the plurality of video streams to have a modified image quality level based on the respective estimated gaze locations, the modified image quality level being less than a corresponding initial image quality level;
• generate a plurality of composite video streams, wherein each composite video stream of the plurality of composite video streams comprises processed video streams having the modified image quality level and remaining video streams of the plurality of video streams, the processed video streams being outside of a corresponding respective estimated gaze location and the remaining video streams being within the corresponding estimated gaze location;
• and
• transmit the plurality of composite video streams to the plurality of display devices.