Back to results
US 12,240,515 B2Granted
Augmented reality object rendering based on camera quality
AssigneeSnap Inc.
InventorsSergey Demyanov, Yunqing Hu, Istvan Marton, Daniil Ostashev, Aleksei Podkin
Life of this patent
Estimating the term…
Abstract
Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.
Claims20
A method comprising:
- accessing an image from a computing device;
- generating a set of noise parameters using a noise estimation neural network trained to:
- receive a first dataset of clear images and a second dataset of noisy images;
- for each clear image in the first dataset of clear images and for each noisy image in the second dataset of noisy images:
- estimate random gaussian noise of the noisy image;
- generate a modified clear image, the modified clear image generated by applying the estimated random gaussian noise to the clear image;
- and
- compare the modified clear image with the noisy image using a noise discriminator network;
- generating a set of blur parameters for the image;
- identifying an augmented reality object associated with the image;
- receiving a first selection of a first selectable user interface element corresponding to the generated set of noise parameters;
- receiving a second selection of a second selectable user interface element corresponding to the generated set of blur parameters;
- in response to the first selection and the second selection, modifying the augmented reality object using the generated set of noise parameters and the generated set of blur parameters;
- and
- causing display, on a graphical user interface of the computer device, of the modified augmented reality object within the image.
12 more elements
A computing system comprising:
- a processor;
- and
- a memory storing instructions that, when executed by the processor, configure the system to perform operations comprising:
- accessing an image from a computing device;
- generating a set of noise parameters using a noise estimation neural network trained to:
- receive a first dataset of clear images and a second dataset of noisy images;
- for each clear image in the first dataset of clear images and for each noisy image in the second dataset of noisy images:
- estimate random gaussian noise of the noisy image;
- generate a modified clear image, the modified clear image generated by applying the estimated random gaussian noise to the clear image;
- and
- compare the modified clear image with the noisy image using a noise discriminator network;
- generating a set of blur parameters for the image;
- identifying an augmented reality object associated with the image;
- receiving a first selection of a first selectable user interface element corresponding to the generated set of noise parameters;
- receiving a second selection of a second selectable user interface element corresponding to the generated set of blur parameters;
- in response to the first selection and the second selection, modifying the augmented reality object using the generated set of noise parameters and the generated set of blur parameters;
- and
- causing display, on a graphical user interface of the computer device, of the modified augmented reality object within the image.
15 more elements
A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
- accessing an image from a computing device;
- generating a set of noise parameters using a noise estimation neural network trained to:
- receive a first dataset of clear images and a second dataset of noisy images;
- for each clear image in the first dataset of clear images and for each noisy image in the second dataset of noisy images:
- estimate random gaussian noise of the noisy image;
- generate a modified clear image, the modified clear image generated by applying the estimated random gaussian noise to the clear image;
- and
- compare the modified clear image with the noisy image using a noise discriminator network;
- generating a set of blur parameters for the image;
- identifying an augmented reality object associated with the image;
- receiving a first selection of a first selectable user interface element corresponding to the generated set of noise parameters;
- receiving a second selection of a second selectable user interface element corresponding to the generated set of blur parameters;
- in response to the first selection and the second selection, modifying the augmented reality object using the generated set of noise parameters and the generated set of blur parameters;
- and
- causing display, on a graphical user interface of the computer device, of the modified augmented reality object within the image.
12 more elements
Dependencies are inferred from the claim text.