Method, apparatus and computer program product for generating interpolation frame

A method for generating an interpolation frame between a first reference frame and a second reference frame, comprising:

• dividing the first reference frame into several first reference areas each constituted of several pixels;
• detecting second reference areas which have the same size and shape as the first reference areas and most correlated therewith in the second reference frame,
• obtaining motion vectors of the detected second reference areas and the first reference areas;
• determining whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area;
• giving the motion vector to the motion vector detected area, the motion vector detected area being determined to be the high-correlated area;
• determining a motion vector of the motion vector undetected area by motion estimation using the motion vector undetected area and a third reference frame, the third reference frame being in a direction temporally opposite to the second reference frame with the first reference frame as a reference, and the motion vector undetected area being determined to be the low-correlated area and being in the first reference area;
• and
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

A method for generating an interpolation frame between a first reference frame and a second reference frame, comprising:

• dividing the interpolation frame into several interpolation areas each constituted of several pixels;
• detecting a most correlated combination from combinations between first reference areas and second reference areas for each of the interpolation areas, the first reference areas being in the first reference frame and having the same size and shape as the interpolation areas, the second reference areas being in the second reference frame and having the same size and shape as the interpolation areas, the each of the interpolation frames, the first reference area of each of the several combinations and the second reference area of the each of the several combinations being arranged straight time-wise;
• obtaining a motion vector from the first reference area and the second reference area included in a detected combination;
• determining whether the first reference area and the second reference area are in a high-correlated area or a low-correlated area;
• giving the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first reference area and the second reference area;
• giving the motion vector undetected area corresponding to the interpolation area which is determined to be the low-correlated area in the first reference area and the second reference area;
• and
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector given to the motion vector undetected area.

A method for generating an interpolation frame between a first reference frame and a second reference frame, comprising:

• dividing the first reference frame into several first reference areas each constituted of several pixels;
• detecting second reference areas having the same size and shape as the first reference areas and being the most correlated to the first reference areas in the second reference frame,
• obtaining motion vectors of the detected second reference areas and the first reference areas;
• determining whether the first reference area and the second reference area are in a high-correlated area or a low-correlated area;
• giving the motion vector to the motion vector detected area, the motion vector detected area being determined to be the high-correlated area in the first reference area;
• giving the motion vector given to the motion vector detected area arranged around the motion vector undetected area to the motion vector undetected area to the motion vector undetected area, the motion vector undetected area being determined to be the low-correlated area in the first reference area;
• and
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector given to the motion vector undetected area.

A computer program product having a computer readable medium including programmed instructions for generating an interpolation frame between a first reference frame and a second reference frame, wherein the instructions, when executed by a computer, cause the computer to perform:

• dividing the interpolation frame into several interpolation areas containing several pixels;
• detecting a most correlated combination from several combinations between first reference areas and second reference areas for each of the interpolation areas, the first reference areas being in the first reference frame and having the same size and shape as the interpolation areas, the second reference areas being in the second reference frame and having the same size and shape as the interpolation areas, the each of the interpolation areas, the first reference area of each of the several combinations and the second reference area of the each of the several combinations being arranged straight time-wise;
• obtaining a motion vector from the first reference area and the second reference area included in a detected combination;
• determining whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area;
• giving the motion vector to the motion vector detected area, the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first reference area and the second reference area;
• determining a motion vector to be given to the motion vector undetected area by motion estimation using the motion vector undetected area, a first area, a third reference frame, a second area, and a fourth reference frame, the first area being in the first reference frame and being determined as the low correlated area, the third reference frame being in a direction temporally identical to the first reference frame with the interpolation frame as a reference, the second area being in the second reference frame and is determined as the low-correlated area;
• and the fourth reference frame being in a direction temporally identical to the second reference frame with the interpolation frame as a reference, the motion vector undetected area corresponding to the interpolation area which is determined to be the low-correlated area in the first reference area and the second reference area;
• and
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

A computer program product having a computer readable medium including programmed instructions for generating an interpolation frame between a first reference frame and a second reference frame, wherein the instructions, when executed by a computer, cause the computer to perform:

• dividing the first reference frame into several first reference areas each constituted of several pixels;
• detecting second reference areas which have the same size and shape as the first reference areas and most correlated therewith in the second reference frame,
• obtaining motion vectors of the detected second reference areas and the first reference areas;
• determining whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area;
• giving the motion vector to the motion vector detected area, the motion vector detected area being determined to be the high-correlated area;
• determining a motion vector of the motion vector undetected area by motion estimation using the motion vector undetected area and a third reference frame, the third reference frame being in a direction temporally opposite to the second reference frame with the first reference frame as a reference, and the motion vector undetected area being determined to be the low-correlated area and being in the first reference area;
• and
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

A computer program product having a computer readable medium including programmed instructions for generating an interpolation frame between a first reference frame and a second reference frame, wherein the instructions, when executed by a computer, cause the computer to perform:

• dividing the interpolation frame into several interpolation areas each constituted of several pixels;
• detecting a most correlated combination from combinations between first reference areas and second reference areas for each of the interpolation areas, the first reference areas being in the first reference frame and having the same size and shape as the interpolation areas, the second reference areas being in the second reference frame and having the same size and shape as the interpolation areas, the each of the interpolation frames, the first reference area of each of the several combinations and the second reference area of the each of the several combinations being arranged straight time-wise;
• determining whether the first reference area and the second reference area are in a high-correlated area or a low-correlated area;
• giving the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first reference area and the second reference area;
• giving the motion vector undetected area corresponding to the interpolation area which is determined to be the low-correlated area in the first reference area and the second reference area;
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector given to the motion vector undetected area;
• dividing the interpolation frame into several interpolation areas each constituted of several pixels;
• detecting a most correlated combination from combinations between first reference areas and second reference areas for each of the interpolation areas, the first reference areas being in the first reference frame and having the same size and shape as the interpolation areas, the second reference areas being in the second reference frame and having the same size and shape as the interpolation areas, the each of the interpolation frames, the first reference area of each of the several combinations and the second reference area of the each of the several combinations being arranged straight time-wise;
• obtaining a motion vector from the first reference area and the second reference area included in a detected combination;
• determining whether the first reference area and the second reference area are in a high-correlated area or a low-correlated area;
• giving the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first reference area and the second reference area;
• giving the motion vector undetected area corresponding to the interpolation area which is determined to be the low-correlated area in the first reference area and the second reference area;
• and
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector given to the motion vector undetected area.

A computer program product having a computer readable medium including programmed instructions for generating an interpolation frame between a first reference frame and a second reference frame, wherein the instructions, when executed by a computer, cause the computer to perform:

• dividing the first reference frame into several first reference areas each constituted of several pixels;
• detecting second reference areas having the same size and shape as the first reference areas and being the most correlated to the first reference areas in the second reference frame;
• obtaining motion vectors of the detected second reference areas and the first reference areas;
• determining whether the first reference area and the second reference area are in a high-correlated area or a low-correlated area;
• giving the motion vector to the motion vector detected area, the motion vector detected area being-determined to be the high-correlated area in the first reference area;
• giving the motion vector given to the motion vector detected area arranged around the motion vector undetected area to the motion vector undetected area to the motion vector undetected area, the motion vector undetected area being determined to be the low-correlated area in the first reference area;
• and
• generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector given to the motion vector undetected area.

An apparatus for generating an interpolation frame between a first reference frame and a second reference frame, comprising:

• an interpolation dividing unit that divides the interpolation frame into several interpolation areas containing several pixels;
• a combination detecting unit that detects a most correlated combination from several combinations between first reference areas and second reference areas for each of the interpolation areas, the first reference areas being in the first reference frame and having the same size and shape as the interpolation areas, the second reference areas being in the second reference frame and having the same size and shape as the interpolation areas, the each of the interpolation areas, the first reference area of each of the several combinations and the second reference area of the each of the several combinations being arranged straight time-wise;
• a motion estimating unit that obtains a motion vector from the first reference area and the second reference area included in a detected combination;
• a correlation determining unit that determines whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area;
• a giving unit that gives the motion vector to the motion vector detected area, the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first reference area and the second reference area;
• a motion vector determining unit that determines a motion vector to be given to the motion vector undetected area by motion estimation using the motion vector undetected area, a first area, a third reference frame, a second area, and a fourth reference frame, the first area being in the first reference frame and being determined as the low correlated area, the third reference frame being in a direction temporally identical to the first reference frame with the interpolation frame as a reference, the second area being in the second reference frame and is determined as the low-correlated area;
• and the fourth reference frame being in a direction temporally identical to the second reference frame with the interpolation frame as a reference, the motion vector undetected area corresponding to the interpolation area which is determined to be the low-correlated area in the first reference area and the second reference area;
• and
• a motion compensation unit that generates the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

An apparatus for generating an interpolation frame between a first reference frame and a second reference frame, comprising:

• an area generating unit that divides the first reference frame into several first reference areas each constituted of several pixels;
• a second reference detecting unit that detects second reference areas which have the same size and shape as the first reference areas and most correlated therewith in the second reference frame,
• a motion estimating unit that obtains motion vectors of the detected second reference areas and the first reference areas;
• a correlation determining unit that determines whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area;
• a motion vector giving unit that gives the motion vector to the motion vector detected area, the motion vector detected area being determined to be the high-correlated area;
• a motion vector determining unit that determines a motion vector of the motion vector undetected area by motion estimation using the motion vector undetected area and a third reference frame, the third reference frame being in a direction temporally opposite to the second reference frame with the first reference frame as a reference, and the motion vector undetected area being determined to be the low-correlated area and being in the first reference area;
• and
• a motion vector compensating unit that generates the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

An apparatus for generating an interpolation frame between a first reference frame and a second reference frame, comprising:

• an area generating unit that divides the interpolation frame into several interpolation areas each constituted of several pixels;
• a combination detecting unit that detects a most correlated combination from combinations between first reference areas and second reference areas for each of the interpolation areas, the first reference areas being in the first reference frame and having the same size and shape as the interpolation areas, the second reference areas being in the second reference frame and having the same size and shape as the interpolation areas, the each of the interpolation frames, the first reference area of each of the several combinations and the second reference area of the each of the several combinations being arranged straight time-wise;
• a motion estimating unit that obtains a motion vector from the first reference area and the second reference area included in a detected combination;
• a correlation determining unit that determines whether the first reference area and the second reference area are in a high-correlated area or a low-correlated area;
• a first motion vector giving unit that gives the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first reference area and the second reference area;
• a second motion vector giving unit that gives the motion vector undetected area corresponding to the interpolation area which is determined to be the low-correlated area in the first reference area and the second reference area;
• and
• a motion compensation unit that generates the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector given to the motion vector undetected area.

An apparatus for generating an interpolation frame between a first reference frame and a second reference frame, comprising:

• an area generating unit that divides the first reference frame into several first reference areas each constituted of several pixels;
• a second reference area detecting unit that detects second reference areas having the same size and shape as the first reference areas and being the most correlated to the first reference areas in the second reference frame,
• a motion estimating unit that obtains motion vectors of the detected second reference areas and the first reference areas;
• a correlation determining unit that determines whether the first reference area and the second reference area are in a high-correlated area or a low-correlated area;
• a first motion vector giving unit that gives the motion vector to the motion vector detected area, the motion vector detected area being determined to be the high-correlated area in the first reference area;
• a second motion vector giving unit that gives the motion vector given to the motion vector detected area arranged around the motion vector undetected area to the motion vector undetected area to the motion vector undetected area, the motion vector undetected area being determined to be the low-correlated area in the first reference area;
• and
• a motion compensating unit that generates the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector given to the motion vector undetected area.