Method, device, and medium for generating super-resolution video

A device, comprising:

• a processor;
• and
• a memory storing instructions which, when executed by the processor, cause the device to generate a super-resolution version of a compressed video stream by:
• obtaining at least a portion of the compressed video stream comprising a plurality of frame encodings representative of a temporal sequence of frames, the plurality of frame encodings comprising:
• an intra-coded frame (I-frame) encoding representative of an I-frame;
• and
• a first inter frame encoding representative of a first inter frame subsequent to the I-frame in the temporal sequence, comprising:
• motion information of the first inter frame relative to the I-frame;
• and
• residual information of the first inter frame relative to the I-frame;
• decoding the I-frame encoding to generate the I-frame;
• decoding the first inter frame encoding to generate:
• the first inter frame;
• the motion information of the first inter frame;
• and
• the residual information of the first inter frame;
• processing the I-frame to generate a super-resolution version of the I-frame;
• and
• generating a super-resolution version of the first inter frame by processing:
• the first inter frame;
• the motion information of the first inter frame;
• the residual information of the first inter frame;
• the I-frame;
• and
• the super-resolution version of the I-frame,
• wherein the plurality of frame encodings further comprises a second inter frame encoding representative of a second inter frame subsequent to the first inter frame in the temporal sequence, comprising:
• motion information of the second inter frame relative to the first inter frame;
• and
• residual information of the second inter frame relative to the first inter frame;
• and
• the instructions, when executed by the processor, further cause the device to:
• decode the second inter frame encoding to extract:
• the second inter frame;
• the motion information of the second inter frame;
• and
• the residual information of the second inter frame;
• and
• generate a super-resolution version of the second inter frame by processing:
• the second inter frame;
• the motion information of the second inter frame;
• the residual information of the second inter frame;
• the first inter frame;
• and
• the super-resolution version of the first inter frame,
• wherein processing the I-frame to generate a super-resolution version of the I-frame comprises:
• generating a super-resolution version of the I-frame by processing:
• the I-frame;
• the first inter frame;
• and
• an additional frame decoded from the compressed video stream, the additional frame being prior to the temporal sequence of frames.

A method for generating a super-resolution version of a first inter frame of a compressed video stream, the method comprising:

• obtaining:
• an intra-coded frame (I-frame),
• the first inter frame,
• motion information of the first inter frame, and
• residual information of the first inter frame;
• decoded from at least a portion of the compressed video stream;
• obtaining a super-resolution version of the I-frame;
• processing the I-frame, the first inter frame, the motion information of the first inter frame, and the residual information of the first inter frame to generate a refined motion map;
• and
• processing the refined motion map, the super-resolution version of the I-frame, and the residual information of the first inter frame to generate the super-resolution version of the first inter frame.