Robust spatiotemporal combining system and method for video enhancement

A spatiotemporal combining method for video enhancement, comprising:

• computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in the video sequence;
• computing an error value, for each sub-block of pixels within a block of pixels in a current video frame, between pixel values within the sub-block in the current video frame and corresponding motion compensated pixel values in a temporally neighboring video frame of the current video frame;
• computing a temporal weighting factor for each sub-block of pixels as a function of the error value and the standard deviation estimate;
• repeating the steps of computing the error value and computing the temporal weighting factor for each sub-block of pixels with respect to one or more additional temporally neighboring video frames;
• and
• combining the block of pixels in the current video frame and their corresponding motion compensated pixel values in the temporally neighboring video frames using the computed temporal weighting factors of each sub-block of pixels in the block of pixels.

A spatiotemporal combining method for video enhancement, comprising:

• computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in the video sequence;
• computing an error value between a pixel value in a current video frame and corresponding motion compensated pixel value in a temporally neighboring video frame of the current video frame;
• computing a temporal weighting factor for each pixel as a function of the error value and the standard deviation estimate;
• and
• combining the pixel value in the current video frame and its corresponding motion compensated pixel value in the temporally neighboring video frame using the computed temporal weighting factor.

An article comprising a computer readable storage medium having instructions thereon which when executed by a computing platform result in execution of a spatiotemporal combining method for video enhancement in each of the components of a video sequence, comprising:

• computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in the video sequence;
• computing an error value, for each sub-block of pixels within a block of pixels in a current video frame, between pixel values within the sub-block in the current video frame and corresponding motion compensated pixel values in a temporally neighboring video frame of the current video frame;
• computing a temporal weighting factor for each sub-block of pixels as a function of the error value and the standard deviation estimate;
• and
• combining the block of pixels in the current video frame and their corresponding motion compensated pixel values in the temporally neighboring video frame using the computed temporal weighting factor of each sub-block of pixels in the block of pixels.

An article comprising a computer readable storage medium having instructions thereon which when executed by a computing platform result in execution of a spatiotemporal combining method for video enhancement, comprising:

• computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in the video sequence;
• computing an error value, for each sub-block of pixels within a block of pixels in a current video frame, between pixel values within the sub-block in the current video frame and corresponding motion compensated pixel values in a temporally neighboring video frame of the current video frame;
• computing a temporal weighting factor for each sub-block of pixels as a function of the error value and the standard deviation estimate;
• repeating the steps of computing the error value and computing the temporal weighting factor for each sub-block of pixels with respect to one or more additional temporally neighboring video frames;
• and
• combining the block of pixels in the current video frame and their corresponding motion compensated pixel values in the temporally neighboring video frames using the computed temporal weighting factors of each sub-block of pixels in the block of pixels.

An article comprising a computer readable storage medium having instructions thereon which when executed by a computing platform result in execution of a spatiotemporal combining method for video enhancement, comprising:

• computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in the video sequence;
• computing an error value between a pixel value in a current video frame and corresponding motion compensated pixel value in a temporally neighboring video frame of the current video frame;
• computing a temporal weighting factor for each pixel as a function of the error value and the standard deviation estimate;
• and
• combining the pixel value in the current video frame and its corresponding motion compensated pixel value in the temporally neighboring video frame using the computed temporal weighting factor.

A video encoder, comprising:

• a video encoding module;
• and
• a spatiotemporal combining module coupled to the video encoding module, wherein the spatiotemporal combining module comprises:
• a motion compensated temporal filtering module to compute a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in the video sequence, wherein the motion compensated temporal filtering module computes an error value, for each sub-block of pixels within a block of pixels in a current video frame, between pixel values within the sub-block in the current video frame and corresponding motion compensated pixel values in a temporally neighboring video frame of the current video frame, wherein the motion compensated temporal filtering module computes a temporal weighting factor for each sub-block of pixels as a function of the error value and the standard deviation estimate, and wherein the motion compensated temporal filtering module combines the block of pixels in the current video frame and their corresponding motion compensated pixel values in the temporally neighboring video frame using the computed temporal weighting factor of each sub-block of pixels in the block of pixels.