System and method to process images of a video stream

A device configured to process images of a stream of video data, the device comprising:

• a memory configured to store an adapted network that is configured to generate a modified image based on a single input image, the adapted network trained using at least one batch of training image pairs, wherein a plurality of image pairs of the batch of training image pairs is based on a first image, wherein a first particular image pair of the batch of training image pairs includes a first particular target image and a first particular distorted image, wherein a second particular image pair of the batch of training image pairs includes a second particular target image and a second particular distorted image, wherein each of the first particular target image and the second particular target image is based on the first image, wherein the first particular distorted image is based on applying a first distortion to the first image, and wherein the second particular distorted image is based on applying a second distortion, that is distinct from the first distortion, to the first image;
• and
• a processor configured to:
• obtain, from a stream of video data, a first distorted image depicting an object;
• provide the first distorted image as input to the adapted network to generate a first modified image;
• obtain, from the stream of video data, a second distorted image depicting the object, wherein the object is distorted differently in the second distorted image than in the first distorted image;
• provide the second distorted image as input to the adapted network to generate a second modified image;
• and
• generate a video output including the first modified image and the second modified image without visible artifacts due to distortion differences between the first distorted image and the second distorted image.

A method of processing images of a stream of video data, the method comprising:

• obtaining, from a stream of video data, first image data representing a first distorted image depicting an object, the first image data corresponding to multiple channels;
• providing the first image data as input to an adapted network to generate first modified image data, the first modified image data corresponding to fewer channels than the first image data;
• generating first output image data based at least in part on the first modified image data;
• and
• generating a video output based on the first output image data.