Image-based detection of surfaces that provide specular reflections and reflection modification

A system comprising:

• a processor and a computer-readable storage medium comprising instructions that upon execution by the processor cause the system to perform operations, the operations comprising:
• obtaining a first image of a physical environment, the first image comprising a specular reflection of a portion of an object;
• obtaining a second image of the physical environment, the second image comprising a direct view of the portion of the object;
• detecting the specular reflection in the first image based on matching the specular reflection of the portion of the object in the first image with the direct view of the portion of the object in the second image;
• and
• determining a location of a surface in the physical environment that provided the specular reflection based on the specular reflection.

A method comprising:

• at a processor:
• producing an identifier via a light source at a device;
• obtaining an image of a physical environment;
• determining that the image comprises a specular reflection of the device based on detecting content corresponding to the identifier in the image and determining that the identifier uniquely corresponds to the device;
• and
• determining a location of a surface in the physical environment that provided the specular reflection, the location determined based on the specular reflection in the image.