Augmented reality object rendering based on camera quality
AssigneeSnap Inc.
InventorsSergey Demyanov, Yunqing Hu, Istvan Marton, Daniil Ostashev, Aleksei Podkin
Life of this patent
Estimating the term…
Abstract
Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.
Claims20
A method comprising:
- accessing an image from a computing device;
- generating a set of blur parameters for the image using a blur estimation neural network, the blur estimation neural network trained based on a first dataset of clear images and a second dataset of blurry images, the blur estimation neural network trained to estimate a blur of a blurry image and generate a modified clear image by applying the estimated blur to a clear image;
- identifying an augmented reality object associated with the image;
- modifying the augmented reality object using the generated set of blur parameters;
- and
- causing display, on a graphical user interface of the computing device, of the modified augmented reality object within the image.
A system comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
- accessing an image from a computing device;
- generating a set of blur parameters for the image using a blur estimation neural network, the blur estimation neural network trained based on a first dataset of clear images and a second dataset of blurry images, the blur estimation neural network trained to estimate a blur of a blurry image and generate a modified clear image by applying the estimated blur to a clear image;
- identifying an augmented reality object associated with the image;
- modifying the augmented reality object using the generated set of blur parameters;
- and
- causing display, on a graphical user interface of the computer device, of the modified augmented reality object within the image.
A non-transitory computer-readable storage medium comprising instructions that, when executed by a computing system, cause the computing system to perform operations comprising:
- accessing an image from a computing device;
- generating a set of blur parameters for the image using a blur estimation neural network, the blur estimation neural network trained based on a first dataset of clear images and a second dataset of blurry images, the blur estimation neural network trained to estimate a blur of a blurry image and generate a modified clear image by applying the estimated blur to a clear image;
- identifying an augmented reality object associated with the image;
- modifying the augmented reality object using the generated set of blur parameters;
- and
- causing display, on a graphical user interface of the computer device, of the modified augmented reality object within the image.
Dependencies are inferred from the claim text.