Correlation-Based Object Anti-Spoofing for Dual-Pixel Cameras

A system comprising:

• a processor;
• and
• a non-transitory computer-readable medium having stored thereon instructions that, when executed by the processor, cause the processor to perform operations comprising:
• obtaining dual-pixel image data that represents an object and comprises a first sub-image and a second sub-image;
• generating (i) a first feature map based on the first sub-image and (ii) a second feature map based on the second sub-image;
• generating a correlation volume by determining, for each respective offset of a plurality of offsets between the first feature map and the second feature map, pixel-wise similarities between (i) the first feature map and (ii) the second feature map offset from the first feature map by the respective offset;
• and
• determining, by an anti-spoofing model and based on the correlation volume, a spoofing value indicative of a likelihood that the object represented by the dual-pixel image data is being spoofed.

A non-transitory computer-readable medium having stored thereon instructions that, when executed by a computing device, cause the computing device to perform operations comprising:

• obtaining dual-pixel image data that represents an object and comprises a first sub-image and a second sub-image;
• generating (i) a first feature map based on the first sub-image and (ii) a second feature map based on the second sub-image;
• generating a correlation volume by determining, for each respective offset of a plurality of offsets between the first feature map and the second feature map, pixel-wise similarities between (i) the first feature map and (ii) the second feature map offset from the first feature map by the respective offset;
• and
• determining, by an anti-spoofing model and based on the correlation volume, a spoofing value indicative of a likelihood that the object represented by the dual-pixel image data is being spoofed.