Device motion aware temporal denoising

A method for device motion aware temporal denoising, comprising:

• receiving video data comprising a sequence of video frames that includes a current frame and one or more preceding frames captured by a video capture device that functions as a camera of a portable electronic device;
• determining one or more camera motion compensation adjustments to apply to the one or more preceding frames of the sequence based on one or more non-imaging device motion sensor measurements for the video capture device;
• generating a sequence of camera-motion compensated preceding frames by applying the one or more camera motion compensation adjustments to the preceding frames of the sequence;
• and
• applying a first denoising process comprising video temporal denoising and/or video spatial denoising to first portions of the current frame which have an overlapping temporal history with the corresponding preceding frames and applying a second denoising process comprising video spatial denoising, rather than temporal denoising, to second portions of the current frame which do not have an overlapping temporal history with the corresponding preceding frames.

A program product comprising a non-transitory computer readable storage medium that stores code executable by a processor, the executable code comprising code to:

• receive video data comprising a sequence of video frames that includes a current frame and one or more preceding frames captured by a video capture device that functions as a camera of a portable electronic device;
• determine one or more camera motion compensation adjustments to apply to the one or more preceding frames of the sequence based on one or more non-imaging device motion sensor measurements for the video capture device;
• generate a sequence of camera-motion compensated preceding frames by applying the one or more camera motion compensation adjustments to the preceding frames of the sequence;
• temporally denoise first portions of the current frame by applying a predetermined video denoising process to one or more of the camera-motion compensated preceding frames which have an overlapping temporal history with the first portions of the current frame;
• and
• spatially denoise second portions of the current frame which do not have one or more preceding frames with an overlapping temporal history with the current frame.