Image processing apparatus, image processing method, and medium
AssigneeCanon Kabushiki Kaisha
InventorYosuke Sato
Life of this patent
Estimating the term…
Abstract
When first input image and second input image are input to generate an interpolated image, based on search basis position of the interpolated image, correlation between a block based on the first image as reference and a block based on the second input image as reference is acquired to calculate a motion vector.
Claims8
An image processing apparatus capable of calculating a motion vector for generating interpolated image data between input image data and delayed image data at a third time based on input image data received at a first time and delayed image data received at a second time that is earlier than the first time by a predetermined frame time, the third time being earlier than the first time by a time shorter than the predetermined frame time, the image processing apparatus comprising:
- a first acquisition unit configured to acquire a first block from the input image data and a second block from the delayed image data wherein, based on a reference position in the input image data corresponding to a reference position defined in the interpolated image data, the first block is at a position determined by multiplying a first time ratio by a first variable, the first time ratio being a value generated by dividing a first difference value by the predetermined frame time, the first difference value being a value generated by subtracting the third time from the first time, the first variable indicating a space deviation amount and wherein, based on a reference position in the delayed image data corresponding to the reference position defined in the interpolated image data, the second block is at a position determined by multiplying a second time ratio by the first variable, the second time ratio being a value generated by dividing a second difference value by the predetermined frame time, the second difference value being a value generated by subtracting the second time from the third time;
- a first calculation unit configured to calculate a correlation between the first block and the second block acquired by the first acquisition unit;
- and
- a second calculation unit configured to calculate a motion vector in the interpolated image data based on the first variable determined when the first block and the second block, whose correlation calculated by the first calculation unit satisfies a predetermined condition, are acquired.
An image processing method performed by an image processing apparatus capable of calculating a motion vector for generating interpolated image data between input image data and delayed image data at a third time based on input image data received at a first time and delayed image data received at a second time that is earlier than the first time by a predetermined frame time, the third time being earlier than the first time by a time shorter than the predetermined frame time, the image processing method comprising:
- acquiring a first block from the input image data and a second block from the delayed image data wherein, based on a reference position in the input image data corresponding to a reference position defined in the interpolated image data, the first block is at a position determined by multiplying a first time ratio by a first variable, the first time ratio being a value generated by dividing a first difference value by the predetermined frame time, the first difference value being a value generated by subtracting the third time from the first time, the first variable indicating a space deviation amount and wherein, based on a reference position in the delayed image data corresponding to the reference position defined in the interpolated image data, the second block is at a position determined by multiplying a second time ratio by the first variable, the second time ratio being a value generated by dividing a second difference value by the predetermined frame time, the second difference value being a value generated by subtracting the second time from the third time;
- performing a first calculation to calculate a correlation between the first block and the second block acquired by the first acquisition unit;
- and
- performing a second calculation to calculate a motion vector in the interpolated image data based on the first variable determined when the first block and the second block, whose correlation calculated by the first calculation unit satisfies a predetermined condition, are acquired.
A non-transitory storage medium storing a program causing a computer to execute an image processing method performed by an image processing apparatus capable of calculating a motion vector for generating interpolated image data between input image data and delayed image data at a third time based on input image data received at a first time and delayed image data received at a second time that is earlier than the first time by a predetermined frame time, the third time being earlier than the first time by a time shorter than the predetermined frame time, the method comprising:
- acquiring a first block from the input image data and a second block from the delayed image data wherein, based on a reference position in the input image data corresponding to a reference position defined in the interpolated image data, the first block is at a position determined by multiplying a first time ratio by a first variable, the first time ratio being a value generated by dividing a first difference value by the predetermined frame time, the first difference value being a value generated by subtracting the third time from the first time, the first variable indicating a space deviation amount and wherein, based on a reference position in the delayed image data corresponding to the reference position defined in the interpolated image data, the second block is at a position determined by multiplying a second time ratio by the first variable, the second time ratio being a value generated by dividing a second difference value by the predetermined frame time, the second difference value being a value generated by subtracting the second time from the third time;
- performing a first calculation to calculate a correlation between the first block and the second block acquired by the first acquisition unit;
- and
- performing a second calculation to calculate a motion vector in the interpolated image data based on the first variable determined when the first block and the second block, whose correlation calculated by the first calculation unit satisfies a predetermined condition, are acquired.
Dependencies are inferred from the claim text.