Light normalization in combined 3D user representations

A device comprising:

• a non-transitory computer-readable storage medium;
• and
• one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the one or more processors to perform operations comprising:
• obtaining a first user representation of at least a first portion of a user, wherein the first user representation is generated via a first technique based on first image data obtained via a first set of sensors in a first physical environment and the first user representation represents the user in a first lighting condition;
• obtaining a second user representation of at least a second portion of the user, wherein the second user representation was generated by:
• generating an initial user representation of the user based on second image data obtained via a second set of sensors in a second physical environment having a second lighting condition;
• delighting the initial user representation based on a lighting representation of the second physical environment;
• and
• producing the second user representation by relighting the delighted initial user representation based on the first lighting condition;
• and
• generating a combined user representation based on the first user representation and the second user representation.

A non-transitory computer-readable storage medium, storing program instructions executable on a device to perform operations comprising:

• obtaining a first user representation of at least a first portion of a user, wherein the first user representation is generated via a first technique based on first image data obtained via a first set of sensors in a first physical environment and the first user representation represents the user in a first lighting condition;
• obtaining a second user representation of at least a second portion of the user, wherein the second user representation was generated by:
• generating an initial user representation of the user based on second image data obtained via a second set of sensors in a second physical environment having a second lighting condition;
• delighting the initial user representation based on a lighting representation of the second physical environment;
• and
• producing the second user representation by relighting the delighted initial user representation based on the first lighting condition;
• and
• generating a combined user representation based on the first user representation and the second user representation.