Machine-learning material data generation
AssigneeAdobe Inc.
InventorsXiaohe Ma, Yiwei Hu, Valentin Mathieu Deschaintre, Miloš Hašan, Fujun Luan
Life of this patent
Estimating the term…
Abstract
Techniques for machine-learning material data generation are described. In an example, a processing device is operable to receive a digital image depicting a material and generate a set of video frames depicting physically-based rendering properties of the material. The set of video frames is generated based on the digital image using a video generative machine-learning model. The processing device is operable to output material data based on the physically-based rendering properties of the material depicted by the set of video frames.
Claims20
A method comprising:
- receiving, by a processing device, a digital image depicting a material;
- generating, by the processing device, a set of video frames depicting physically-based rendering properties of the material, the generating performed using a video generative machine-learning model based on the digital image;
- and
- outputting, by the processing device, material data based on the physically-based rendering properties of the material depicted by the set of video frames.
A system comprising:
- a memory component;
- and
- a processing device coupled to the memory component that cause a video generative machine-learning model to perform operations including:
- generating a set of video frames that depict physically-based rendering properties of a material depicted in a digital image;
- and
- outputting material data based on the physically-based rendering properties of the material as depicted by the set of video frames.
A non-transitory computer readable storage medium comprising instructions that, when executed, configure at least one processing device to perform operations including:
- training a video generative machine-learning model to generate sets of video frames depicting physically-based rendering properties of materials depicted in digital images and described by input text of the materials;
- executing the video generative machine-learning model to generate, based on a digital image depicting a material and a text input describing the material, a set of video frames depicting physically-based rendering properties of the material;
- and
- outputting material data based on the physically-based rendering properties of the material as depicted by the set of video frames.
Dependencies are inferred from the claim text.