Platform for Enabling Multiple Users to Generate and Use Neural Radiance Field Models
AssigneeGoogle Inc.
InventorsArash Sadr, Igor Bonaci
Life of this patent
Estimating the term…
Abstract
Systems and methods for enabling users to generate and utilize neural radiance field models can include obtaining user image data and training one or more neural radiance field models based on the user image data. The systems and methods can include obtaining user images based on a determination that the user images depicted objects of a particular object type. The trained neural radiance field models can then be utilized for view synthesis image generation of the particular user objects.
Claims20
A computing system, the system comprising:
- one or more processors;
- and
- one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
- obtaining user image data and request data, wherein the user image data is descriptive of one or more images comprising one or more user objects, wherein the one or more images were generated with a user computing device;
- training one or more neural radiance field models based on the user image data, wherein the one or more neural radiance field models are trained to generate a view synthesis of the one or more objects;
- and
- generating one or more view synthesis images with the one or more neural radiance field models based on the request data, and wherein the one or more view synthesis images comprise one or more renderings of the one or more objects.
A computer-implemented method for virtual closet generation, the method comprising:
- obtaining, by a computing system comprising one or more processors, a plurality of user images, wherein each of the plurality of user images comprise one or more articles of clothing, wherein the plurality of user images are associated with a plurality of different articles of clothing;
- training, by the computing system, a respective neural radiance field model for each respective article of clothing of the plurality of different articles of clothing, wherein each respective neural radiance field model is trained to generate one or more view synthesis renderings of a particular respective article of clothing;
- storing, by the computing system, each respective neural radiance field model in a collection database;
- and
- providing, by the computing system, a virtual closet interface, wherein the virtual closet interface provides a plurality of clothing view synthesis renderings for display based on the plurality of respective neural radiance field models, wherein the plurality of clothing view synthesis renderings are associated with at least a subset of the plurality of different articles of clothing.
One or more non-transitory computer-readable media that collectively store instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations, the operations comprising:
- obtaining a plurality of user image datasets, wherein each user image dataset of the plurality of user image datasets is descriptive of one or more images comprising one or more objects, wherein the one or more images were generated with a user computing device;
- processing the plurality of user image datasets with one or more classification models to determine a subset of the plurality of user image datasets that comprises features descriptive of one or more particular object types;
- training a plurality of neural radiance field models based on the subset of the plurality of user image datasets, wherein each respective neural radiance field model is trained to generate a view synthesis of one or more particular objects of a respective user image dataset of the subset of the plurality of user image datasets;
- generating a plurality of view synthesis renderings with the plurality of neural radiance field models, wherein the plurality of view synthesis renderings are descriptive of a plurality of different objects of the particular object type;
- and
- providing a user interface for viewing the plurality of view synthesis renderings.
Dependencies are inferred from the claim text.