Real-time image generation in moving scenes

A method comprising:

• receiving a high frame rate video stream of a scene, wherein said scene comprises at least one object in motion relative to an imaging device acquiring said video stream;
• continuously dividing, in real time, said video stream into consecutive sequences of n frames each;
• with respect to each current sequence:
• estimating motion for each pixel between adjacent pairs of frames in said current sequence,
• (ii) calculating a motion vector field for each of said pixels in said current sequence,
• (iii) generating a representative frame which co-locates each of said pixels to a respective pixel positions, based on said calculated motion vector fields, and
• (iv) aggregating, for each of said respective pixel positions, pixel values associated with its corresponding co-located pixel from all frames in said current sequence;
• and
• outputting, in real time, a stream of said representative frames, wherein said stream has a lower frame rate than said high frame rate.

A computer program product comprising a non-transitory computer-readable storage medium having program code embodied therewith, the program code executable by at least one hardware processor to:

• receive a high frame rate video stream of a scene, wherein said scene comprises at least one object in motion relative to an imaging device acquiring said video stream;
• continuously divide, in real time, said video stream into consecutive sequences of n frames each;
• with respect to each current sequence:
• (i) estimate motion for each pixel between adjacent pairs of frames in said current sequence,
• (ii) calculate a motion vector field for each of said pixels in said current sequence,
• (iii) generate a representative frame which co-locates each all of said pixels to a respective pixel positions, based on said calculated motion vector fields, and
• (iv) aggregate, for each of said respective pixel positions, pixel values associated with its corresponding co-located pixel from all frames in said sequence;
• and
• output, in real time, a stream of said representative frames, wherein said stream has a lower frame rate than said high frame rate.