Method and apparatus for generating and processing video data
AssigneeTelefonaktiebolaget LM Ericsson (publ)
InventorsSelim Ickin, David Lindero, Gunnar Heikkilä
Life of this patent
Estimating the term…
Abstract
Embodiments disclosed herein relate to methods and apparatus for generating video frames when there is a change in the rate of received video data. In one embodiment there is provided a method of processing video data which comprises generating a video frame using received video data, encoding said video frame into a latent vector using an encoder part of a generative model, modifying the latent vector and decoding the modified latent vector using a decoder part of the generative model to generate a new video frame in response to determining a reduction in generating the video frames using the received video data.
Claims25
A method of processing video data, the method comprising:
- generating a video frame using received video data;
- encoding said video frame into a latent vector using an encoder part of a generative model in response to determining a reduction in the generation of video frames using the received video data, wherein the reduction is due to insufficient received video data to generate the video frames, wherein determining the reduction comprises detecting or predicting an inter-time gap between frames displayed on a display being above a threshold using an inter-frame delay prediction model;
- modifying the latent vector to represent a temporally subsequent new video frame;
- and
- decoding the modified latent vector using a decoder part of the generative model to generate the new video frame.
A method of processing video data, the method comprising:
- receiving a video frame from a first device and encoding the video frame into a latent vector using an encoder part of a first generative model in response to the first device determining a reduction in generating video frames using received video data, wherein the reduction is due to insufficient received video data to generate the video frames, wherein determining the reduction comprises detecting or predicting an inter-time gap between frames displayed on a display being above a threshold using an inter-frame delay prediction model;
- modifying the latent vector to represent a temporally subsequent new video frame;
- decoding the modified latent vector using a decoder part of the first generative model to generate the new video frame;
- and
- forwarding the new video frame to the first device.
An apparatus for processing video data, the apparatus comprising a processor and memory said memory containing instructions executable by said processor whereby said apparatus is operative to:
- generate a video frame using received video data;
- encode the video frame into a latent vector using an encoder part of a generative model in response to determining a reduction in the generation of video frames using the received video data, wherein the reduction is due to insufficient received video data to generate the video frames, wherein determining the reduction comprises detecting or predicting an inter-time gap between frames displayed on a display being above a threshold using an inter-frame delay prediction model;
- modify the latent vector to represent a temporally subsequent new video frame;
- and
- decode the modified latent vector using a decoder part of the generative model to generate the new video frame.
An apparatus for processing video data, the apparatus comprising a processor and memory, said memory containing instructions executable by said processor whereby said apparatus is operative to:
- receive a video frame from a first device and encode the video frame into a latent vector using an encoder part of a first generative model in response to the first device determining a reduction in generating video frames using received video data, wherein the reduction is due to insufficient received video data to generate the video frames, wherein determining the reduction comprises detecting or predicting an inter-time gap between frames displayed on a display being above a threshold using an inter-frame delay prediction model;
- modify the latent vector to represent a temporally subsequent new video frame;
- decode the modified latent vector using a decoder part of the first generative model to generate the new video frame;
- and
- forward the new video frame to the first device.
Dependencies are inferred from the claim text.