Dynamic lighting capture and reconstruction

A computer-implemented method, comprising:

• receiving a stream of one or more images of a physical environment;
• generating one or more light maps based on the one or more images;
• compressing the one or more light maps to produce one or more compressed light maps, the one or more compressed light maps including a plurality of coefficients associated with the one or more light maps;
• comparing the plurality of coefficients with stored coefficients generated for one or more previous light maps to identify one or more coefficients of the plurality of coefficients that have changed as compared with the stored coefficients of the one or more previous light maps, wherein a number of coefficients in the identified one or more coefficients is less than a number of coefficients in the plurality of coefficients;
• and
• transmitting only the identified one or more coefficients of the plurality of coefficients for reconstructing the lighting of the physical environment.

A system, comprising:

• a memory storing a plurality of instructions;
• and
• one or more processors to:
• receive a stream of one or more images of a physical environment;
• generate one or more light maps based on the one or more images, wherein the one or more light maps include a plurality of light intensity values indicating lighting of the physical environment;
• determine a plurality of coefficients representing the plurality of light intensity values of the one or more light maps;
• generate one or more compressed light maps, the one or more compressed light maps including the plurality of coefficients representing the plurality of light intensity values of the one or more light maps;
• compare the plurality of coefficients with stored coefficients generated for one or more previous light maps to identify one or more coefficients of the plurality of coefficients that have changed as compared with the stored coefficients of the one or more previous light maps, wherein a number of coefficients in the identified one or more coefficients is less than a number of coefficients in the plurality of coefficients;
• and
• transmit, to a rendering device, only the identified one or more coefficients of the plurality of coefficient for reconstructing the lighting of the physical environment, the reconstructed lighting being usable by the rendering device to render a computer-generated environment with the lighting of the physical environment.

A computer-readable memory storing a plurality of instructions executable by one or more processors, the plurality of instructions comprising:

• instructions that cause the one or more processors to receive a stream of one or more images of a physical environment;
• instructions that cause the one or more processors to generate one or more light maps based on the one or more images, wherein the one or more light maps include a plurality of light intensity values indicating lighting of the physical environment;
• instructions that cause the one or more processors to determine a plurality of coefficients representing the plurality of light intensity values of the one or more light maps;
• instructions that cause the one or more processors to generate one or more compressed light maps including the plurality of coefficients representing the plurality of light intensity values of the one or more light maps;
• instructions that cause the one or more processors to compare the plurality of coefficients with stored coefficients generated for one or more previous light maps to identify one or more coefficients of the plurality of coefficients that have changed as compared with the stored coefficients of the one or more previous light maps, wherein a number of coefficients in the identified one or more coefficients is less than a number of coefficients in the plurality of coefficients;
• and
• instructions that cause the one or more processors to transmit, to a rendering device, only the identified one or more coefficients of the plurality of coefficients have changed for reconstructing the lighting of the physical environment, the reconstructed lighting being usable by the rendering device to render a computer-generated environment with the lighting of the physical environment.