Image processing apparatus, image processing method, and program

An image processing method, comprising the steps of:

• receiving first video data containing a plurality of frames and second video data having a spatial resolution higher than the frames contained in the first video data and a temporal resolution lower than the frames contained in the first video data;
• magnifying the frames of the first video data to generate a plurality of magnified frames;
• detecting a motion vector between each sequential frame pair of the magnified frames;
• and
• performing, based on the second video data received in the receiving step and the motion vector detected in the motion prediction step, motion compensation in sequential order from one of the magnified frames associated with a time that corresponds to a time associated with the second video data, and sequentially generating motion compensated image data corresponding to the first video data based on the motion compensated frame and the motion vector,
• wherein the motion compensated image data is sequentially generated by combining, at a predetermined ratio, a reference block of a first frame of the second video data specified by a respective motion vector, and a corresponding reference block of a second frame of the plurality of magnified frames that is immediately subsequent in time to the first frame of the second video data and belonging to a corresponding respective frame pair of the magnified frames used to generate the respective motion vector, to thereby generate an intermediate created picture,
• wherein the predetermined ratio is based upon a difference amount between the reference block of the first frame of the second video data and the corresponding reference block of the second frame of the plurality of magnified frames.

A tangible, non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method, comprising:

• receiving first video data containing a plurality of frames and second video data having a spatial resolution higher than the frames contained in the first video data and a temporal resolution lower than the frames contained in the first video data;
• magnifying the frames of the first video data to generate a plurality of magnified frames;
• detecting a motion vector between each sequential frame pair of the magnified frames;
• and
• performing, based on the second video data received by the receiving unit and the motion vector detected by the motion prediction unit, motion compensation in sequential order from one of the magnified frames associated with a time that corresponds to a time associated with the second video data, and sequentially generating motion compensated image data corresponding to the first video data based on the motion compensated frame and the motion vector,
• wherein the motion compensated image data is sequentially generated by combining, at a predetermined ratio, a reference block of a first frame of the second video data specified by a respective motion vector, and a corresponding reference block of a second frame of the plurality of magnified frames that is immediately subsequent in time to the first frame of the second video data and belonging to a corresponding respective frame pair of the magnified frames used to generate the respective motion vector, to thereby generate an intermediate created picture,
• wherein the predetermined ratio is based upon a difference amount between the reference block of the first frame of the second video data and the corresponding reference block of the second frame of the plurality of magnified frames.