Systems, methods, and media for motion adaptive imaging using single-photon image sensor data

A method for generating digital images, comprising:

• receiving, from an image sensor comprising a plurality of detectors configured to detect arrival of photons, a series of images, each image in the series of images comprising a plurality of pixels representing brightness of a portion of a scene, each of the plurality of pixels associated with a pixel location (x,y);
• identifying, for each of the plurality of pixel locations using the series of images, one or more changepoints at which a transition in brightness associated with a pixel between different steady state brightness values occurs;
• determining, based on the one or more changepoints associated with the plurality of pixel locations, a first point in the series of images at which at least a threshold portion of plurality of pixel locations have included at least one changepoint;
• generating a first image based on brightness associated with each pixel location at the first point in the series of images;
• determine, based on changepoints associated with the plurality of pixel locations, a second point in the series of images at which at least the threshold portion of the plurality of pixel locations have included at least one changepoint that occurred after the first point in the series of images;
• and
• generate a second image based on brightness associated with each pixel location at the second point in the series of images.

A system for generating digital images, comprising:

• an image sensor comprising a plurality of single-photon detectors configured to detect arrival of photons, the plurality of single-photon detectors arranged in an array;
• at least one processor that is programmed to:
• receive a sequence of photon frames, each photon frame comprising a plurality of pixels having a value indicative of whether a photon was received during an associated frame period, wherein each of the plurality of pixels corresponds to a pixel location of a plurality of pixel locations;
• identify, for each of the plurality of pixel locations, a plurality of changepoints, each of the plurality of changepoints is indicative of a change in scene brightness;
• identify a photon frame in the sequence of photon frames at which at least a threshold change in brightness has occurred based on the changepoints associated with each of the plurality of pixel locations;
• and
• generate a series of changepoint frames, wherein each changepoint frame is based on estimated brightness associated with each pixel location at a point in the sequence of photon frames.