Frame rate conversion processing apparatus, frame rate conversion processing method, and storage medium

A frame rate conversion processing apparatus that converts an input image signal having a first frame rate into a frame rate converted image signal having a second frame rate, in which the second frame rate is lower than the first frame rate, and then generates an output image signal having the second frame rate based on the frame rate converted image signal, the frame rate conversion processing apparatus comprising:

• a first acquisition unit configured to acquire an evaluation value for the input image signal, which can be calculated based on a frequency that represents temporal changes in luminance of the input image signal and visual perceptual response characteristics;
• a second acquisition unit configured to acquire an evaluation value for the frame rate converted image signal, which can be calculated based on a frequency that represents temporal changes in luminance of the frame rate converted image signal and the visual perceptual response characteristics;
• a third acquisition unit configured to acquire a frequency that represents temporal changes in luminance, which can be obtained by filtering the frequency that represents temporal changes in luminance of the input image signal using the visual perceptual response characteristics;
• a comparison unit configured to compare a difference between the evaluation value acquired by the first acquisition unit and the evaluation value acquired by the second acquisition unit with a predetermined value;
• and
• a generation unit configured to generate the output image signal by correcting the frame rate converted image signal using the filtered frequency that represents temporal changes in luminance acquired by the third acquisition unit, as a correction target value of the frequency that represents temporal changes in luminance, if the comparison unit determines that the difference exceeds the predetermined value.

A frame rate conversion processing apparatus that converts an input image signal having a first frame rate into an output image signal having a second frame rate, in which the second frame rate is lower than the first frame rate, the frame rate conversion processing apparatus comprising:

• a filtering unit configured to filter a frequency that represents temporal changes in luminance of the input image signal using visual perceptual response characteristics;
• a correction unit configured to correct the luminance of the input image signal using the frequency that represents temporal changes in luminance, which can be obtained through the filtering performed by the filtering unit to filter the frequency that represents temporal changes in luminance of the input image signal, as a correction target value of the frequency that represents temporal changes in luminance;
• and
• a conversion unit configured to convert the input image signal corrected by the correction unit into the output image signal having the second frame rate.

A frame rate conversion processing method for converting an input image signal having a first frame rate into a frame rate converted image signal having a second frame rate, in which the second frame rate is lower than the first frame rate, and then generating an output image signal having the second frame rate based on the frame rate converted image signal,

• causing a first acquisition unit to acquire an evaluation value for the input image signal, which can be calculated based on a frequency that represents temporal changes in luminance of the input image signal and visual perceptual response characteristics;
• causing a second acquisition unit to acquire an evaluation value for the frame rate converted image signal, which can be calculated based on a frequency that represents temporal changes in luminance of the frame rate converted image signal and the visual perceptual response characteristics;
• causing a third acquisition unit to acquire a frequency that represents temporal changes in luminance, which can be obtained by filtering the frequency that represents temporal changes in luminance of the input image signal using the visual perceptual response characteristics;
• causing a comparison unit to compare a difference between the evaluation value acquired by the first acquisition unit and the evaluation value acquired by the second acquisition unit with a predetermined value;
• and
• causing a correction unit to generate the output image signal by correcting the frame rate converted image signal using the filtered frequency that represents temporal changes in luminance acquired by the third acquisition unit, as a correction target value of the frequency that represents temporal changes in luminance, if it is determined that the difference exceeds the predetermined value.

A frame rate conversion processing method for converting an input image signal having a first frame rate into an output image signal having a second frame rate, in which the second frame rate is lower than the first frame rate, the method comprising:

• causing a filtering unit to filter a frequency that represents temporal changes in luminance of the input image signal using visual perceptual response characteristics;
• causing a correction unit to correct the input image signal using the frequency that represents temporal changes in luminance, which can be obtained through the filtering performed by the filtering unit to filter the frequency that represents temporal changes in luminance of the input image signal, as a correction target value of the frequency that represents temporal changes in luminance;
• and
• causing a conversion unit to convert the input image signal corrected by the correction unit into the output image signal having the second frame rate.

A non-transitory computer readable storage medium storing a program that causes a computer to convert an input image signal having a first frame rate into an output image signal having a second frame rate, in which the second frame rate is lower than the first frame rate, the program comprising:

• computer-executable instructions for acquiring a frequency that represents temporal changes in luminance of the input image signal;
• computer-executable instructions for detecting temporal changes in luminance of the input image signal;
• and
• computer-executable instructions for generating the output image signal based on the input image signal so that the output image signal does not include the temporal changes in luminance that can be perceived by human eyes and corresponding to the temporal changes detected by the detection unit, if the temporal changes of a frequency that exceeds a predetermined frequency that represents temporal changes in luminance that can be perceived by human eyes is detected.

A non-transitory computer readable storage medium storing a program that causes a computer to convert an input image signal having a first frame rate into a frame rate converted image signal having a second frame rate, in which the second frame rate is lower than the first frame rate, and then generate an output image signal having the second frame rate based on the frame rate converted image signal, the program comprising:

• computer-executable instructions for acquiring a first evaluation value for the input image signal that can be calculated based on a frequency that represents temporal changes in luminance of the input image signal and visual perceptual response characteristics;
• computer-executable instructions for acquiring a second evaluation value for the frame rate converted image signal, which can be calculated based on a frequency that represents temporal changes in luminance of the frame rate converted image signal and the visual perceptual response characteristics;
• computer-executable instructions for acquiring a frequency that represents temporal changes in luminance, which can be obtained by filtering the frequency that represents temporal changes in luminance of the input image signal using the visual perceptual response characteristics;
• computer-executable instructions for comparing a difference between the first evaluation value and the second evaluation value with predetermined value;
• and
• computer-executable instructions for generating the output image signal by correcting the frame rate converted image signal using the frequency that represents temporal changes in luminance obtained through the filtering as a correction target value of the frequency that represents temporal changes in luminance, if it is determined that the difference exceeds the predetermined value.