Method for processing I-blocks used with motion compensated temporal filtering

A method for processing video frames using a processor, comprising:

• providing, by the processor, a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining, by the processor, a connection state of each pixel in frame B relative to the pixels of frame A, said connection state being a connected state or an unconnected state;
• classifying, by the processor, each block in frame B as being either unconnected or uni-connected;
• after said classifying, reclassifying, by the processor, uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing, by the processor, each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating, by the processor, values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating, by the processor, a residual error block for each I-block in frame B,
• wherein said classifying comprises:
• determining, by the processor, a matched block in frame A for each uni-connected block in frame B;
• and
• reclassifying, by the processor, a uni-connected block in frame B as being unconnected if the mean-squared displaced frame difference (DFD) between the uni-connected block in frame B and its matched block in frame A exceeds fVMIN, said VMIN being the minimum of V1 and V2, said V1 and V2 being respectively the pixel variance of the uni-connected block in frame B and the pixel variance of its matched block in frame A, said f being in a range of 0.40 to 1.00.

A method for processing video frames using a processor, comprising:

• providing, by the processor, a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining, by the processor, a connection state of each pixel in frame B relative to the pixels of frame A, said connection state being a connected state or an unconnected state;
• classifying, by the processor, each block in frame B as being either unconnected or uni-connected;
• after said classifying, reclassifying, by the processor, uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing, by the processor, each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating, by the processor, values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating, by the processor, a residual error block for each I-block in frame B,
• wherein said categorizing comprises:
• categorizing, by the processor, as being an I-block an unconnected block in frame B having a residual interpolation error (SRES) that is less than its minimum motion compensated error (SMC-MIN);
• and
• categorizing, by the processor, as being a P-block an unconnected block in frame B having a residual interpolation error (SRES) that is not less than its minimum motion compensated error (SMC-MIN).

A system for processing a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B, said system comprising;

• means for determining a connection state of each pixel in frame B relative to the pixels of frame A, wherein said determining means eliminates multiple connections between the pixels in frame B and the pixels in frame A such that said connection state is a uni-connected state or an unconnected state;
• means for classifying each block in frame B as being either unconnected or uni-connected after said determining means determines said connection state;
• means for reclassifying uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• means for categorizing each unconnected block in frame B as a P-block or an I-block;
• means for calculating values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• means for generating a residual error block for each I-block in frame B.

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code comprising an algorithm adapted to implement a method for processing video frames, said method comprising:

• providing a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining a connection state of each pixel in frame B relative to the pixels of frame A, wherein said determining comprises eliminating multiple connections between the pixels in frame B and the pixels in frame A such that said connection state is a uni-connected state or an unconnected state;
• after said determining, classifying each block in frame B as being either unconnected or uni-connected;
• after said classifying, reclassifying uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating a residual error block for each I-block in frame B.

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code comprising an algorithm adapted to implement a method for processing video frames, said method comprising:

• providing a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining a connection state of each pixel in frame B relative to the pixels of frame A, said connection state being a connected state or an unconnected state;
• classifying each block in frame B as being either unconnected or uni-connected;
• after said classifying, reclassifying uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating a residual error block for each I-block in frame B,
• wherein said reclassifying comprises:
• determining a matched block in frame A for each uni-connected block in frame B;
• and
• reclassifying a uni-connected block in frame B as being unconnected if the mean-squared displaced frame difference (DFD) between the uni-connected block in frame B and its matched block in frame A exceeds fVMIN, said VMIN being the minimum of V1 and V2, said V1 and V2 being respectively the pixel variance of the uni-connected block in frame B and the pixel variance of its matched block in frame A, said f being in a range of 0.40 to 1.00.

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code comprising an algorithm adapted to implement a method for processing video frames, said method comprising:

• providing a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining a connection state of each pixel in frame B relative to the pixels of frame A, said connection state being a connected state or an unconnected state;
• classifying each block in frame B as being either unconnected or uni-connected;
• after said classifying, reclassifying uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating a residual error block for each I-block in frame B,
• wherein said categorizing comprises:
• categorizing as being an I-block an unconnected block in frame B having a residual interpolation error (SRES) that is less than its minimum motion compensated error (SMC-MIN);
• and
• categorizing as being a P-block an unconnected block in frame B having a residual interpolation error (SRES) that is not less than its minimum motion compensated error (SMC-MIN).

A computer system comprising a processor and a computer readable memory unit coupled to the processor, said memory unit containing instructions that when executed by the processor implement a method for processing video frames, said method comprising:

• providing a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining a connection state of each pixel in frame B relative to the pixels of frame A, wherein said determining comprises eliminating multiple connections between the pixels in frame B and the pixels in frame A such that said connection state is a uni-connected state or an unconnected state;
• after said determining, classifying each block in frame B as being either unconnected or uni-connected;
• after said classifying, reclassifying uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating a residual error block for each I-block in frame B.

A computer system comprising a processor and a computer readable memory unit coupled to the processor, said memory unit containing instructions that when executed by the processor implement a method for processing video frames, said method comprising:

• providing a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining a connection state of each pixel in frame B relative to the pixels of frame A, said connection state being a connected state or an unconnected state;
• classifying each block in frame B as being either unconnected or uni-connected;
• after said classifying, reclassifying uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating a residual error block for each I-block in frame B,
• wherein said reclassifying comprises:
• determining a matched block in frame A for each uni-connected block in frame B;
• and
• reclassifying a uni-connected block in frame B as being unconnected if the mean-squared displaced frame difference (DFD) between the uni-connected block in frame B and its matched block in frame A exceeds fVMIN, said VMiN being the minimum of VI and V2, said V1 and V2 being respectively the pixel variance of the uni-connected block in frame B and the pixel variance of its matched block in frame A, said f being in a range of 0.40 to 1.00.

A computer system comprising a processor and a computer readable memory unit coupled to the processor, said memory unit containing instructions that when executed by the processor implement a method for processing video frames, said method comprising:

• providing a pair of successive video frames, each pair of frames consisting of frame A and frame B, said frames A and B each comprising blocks of pixels, said frame A being earlier in time than said frame B;
• determining a connection state of each pixel in frame B relative to the pixels of frame A, said connection state being a connected state or an unconnected state;
• classifying each block in frame B as being either unconnected or uni-connected:
• after said classifying, reclassifying uni-connected blocks in frame B as being unconnected for those uni-connected blocks in frame B satisfying a reclassification criteria;
• after said reclassifying, categorizing each unconnected block in frame B as a P-block or an I-block;
• after said categorizing, calculating values for the pixels of each I-block in frame B by spatial interpolation based on values of nearest available neighbor pixels relative to each I-block;
• and
• after said calculating, generating a residual error block for each I-block in frame B,
• wherein said categorizing comprises:
• categorizing as being an I-block an unconnected block in frame B having a residual interpolation error (SRES) that is less than its minimum motion compensated error (SMC-MIN);
• and
• categorizing as being a P-block an unconnected block in frame B having a residual interpolation error (SRES) that is not less than its minimum motion compensated error (SMC-MIN).