Back to results
US 12,749,150 B2Granted
Upsampling an image using one or more neural networks
AssigneeNVIDIA Corporation
InventorsShiqiu Liu, Robert Pottorff, Guilin Liu, Karan Sapra, Jon Barker, David Tarjan, Pekka Janis, Edvard Fagerholm, Lei Yang, Kevin Jonathan Shih, Marco Salvi, Timo Roman, Andrew Tao, Bryan Catanzaro
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights.
Claims21
A method, comprising:
- obtaining lower resolution (LR) images;
- generating, with a first neural network, one or more neural network parameters based, at least in part, on image data associated with the LR images at a first frame rate;
- providing the one or more neural network parameters to a second neural network different from the first neural network;
- and
- generating, with the second neural network at a different second frame rate, high resolution (HR) images using a jitter-aware upsampling process based, at least in part, on the LR images.
2 more elements
A system for image processing, comprising:
- at least one processor;
- and
- at least one memory communicatively coupled to the at least one processor and storing a video sequence of low resolution (LR) images, the at least one processor being configured to operate by:
- generating higher resolution (HR) images comprising inputting image data of the LR images into a second neural network;
- generating, with a first neural network different from the second neural network, one or more neural network parameters based, at least in part on image data associated with the LR images at a first frame rate;
- and
- providing the one or more neural network parameters to the second neural network to be used to generate the HR images using a jitter-aware upsampling process at a second different frame rate.
4 more elements
A non-transitory computer-readable medium comprising instructions that, when performed by at least one processor of a computing device, cause the computing device to at least:
- cause a first neural network to generate one or more neural network parameters based on a video sequence of low resolution (LR) images at a first frame rate;
- provide the one or more neural network parameters to a second neural network different from the first neural network, the second neural network to perform high resolution (HR) image generation;
- and
- cause the second neural network to generate HR images using a jitter-aware upsampling process, based on the LR images, at a second different frame rate.
1 more element
Dependencies are inferred from the claim text.