Relightable scene reconstructions using radiance guided material extraction

A method comprising:

• receiving, by a processing device, a plurality of digital images that depict a scene from multiple perspectives;
• generating, by the processing device, a Laplacian pyramid environment map structure that encodes lighting conditions of the scene;
• determining, by the processing device, a radiance of the scene based on the lighting conditions encoded within the Laplacian pyramid environment map structure;
• generating, by the processing device, a synthesized image having a reconstruction of the scene using the radiance;
• and
• outputting, by the processing device, the synthesized image.

A system comprising:

• a memory component;
• and
• a processing device coupled to the memory component to perform operations including:
• determining a view-independent radiance of a scene from a plurality of digital images that depict the scene from multiple perspectives;
• supervising a diffuse radiance output for a reconstruction of the scene using the view-independent radiance;
• determining a view-dependent radiance of the scene based on the plurality of digital images;
• supervising a specular radiance output for the reconstruction using the view-independent radiance;
• and
• generating a synthesized image from the reconstruction using the diffuse radiance and the specular radiance.