Systems, methods, and media for eulerian single-photon computer vision

A method for facilitating single-photon computer vision tasks, the method comprising:

• causing an image sensor to generate a sequence of images representing a scene, each of the images comprising a plurality of pixels,
• wherein the image sensor comprises a plurality of detectors configured to detect arrival of individual photons, the plurality of detectors arranged in an array;
• performing, for each of a plurality of three dimensional filters, a convolution between the three dimensional filter and a plurality of frames,
• wherein each of the plurality of frames is based on one or more of the images of the sequence of images;
• generating, for each of the plurality of frames, a plurality of filter bank responses each corresponding to a three dimensional filter of the plurality of three dimensional filters;
• and
• performing a computer vision process based on the plurality of filter responses.

A non-transitory computer readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for facilitating single-photon computer vision tasks, the method comprising:

• causing an image sensor to generate a sequence of images representing a scene, each of the images comprising a plurality of pixels,
• wherein the image sensor comprises a plurality of detectors configured to detect arrival of individual photons, the plurality of detectors arranged in an array;
• performing, for each of a plurality of three dimensional filters, a convolution between the three dimensional filter and a plurality of frames,
• wherein each of the plurality of frames is based on one or more of the images of the sequence of images;
• generating, for each of the plurality of frames, a plurality of filter bank responses each corresponding to a three dimensional filter of the plurality of three dimensional filters;
• and
• performing a computer vision process based on the plurality of filter responses.