Moving image generating apparatus, moving image shooting apparatus, moving image generating method, and program

A moving image generating apparatus comprising:

• an obtaining device which obtains image data for respective three primary colors in turn at a same frame rate and at different timings;
• a characteristic point extracting device which extracts characteristic points in image data of an attention frame from among the image data obtained by the obtaining device;
• a corresponding point extracting device which extracts corresponding points in image data for a color that is the same as the color of the image data of the attention frame, the image data being obtained at a timing closest to the timing of the obtainment of the image data of the attention frame, the corresponding points corresponding to the characteristic points in the image data of the attention frame extracted by the characteristic point extracting device;
• an estimating device which estimates corresponding points in image data for colors that are different from the color of the image data of the attention frame, the image data being adjacent to the image data of the attention frame, based on the distances between the characteristic points extracted by the characteristic point extracting device and the corresponding points extracted by the corresponding point extracting device, and the timings of the obtainment of the image data by the obtaining device;
• a first generating device which generates image data for a time that is the same as the time of the obtainment of the image data of the attention frame and for colors that are different from the color of the image data of the attention frame, by modifying the image data for colors that are different from the color of the image data of the attention frame, the image data being adjacent to the image data of the attention frame, based on the characteristic points extracted by the characteristic point extracting device and the corresponding points estimated by the estimating device;
• and
• a second generating device which generates image data including three primary colors for image data for the attention frame, by combining the image data of the attention frame, and the image data for a time that is the same as the time of the obtainment of the image data of the attention frame and for colors that are different from the color of the image data of the attention frame, which have been generated by the first generating device.

A moving image generating apparatus comprising:

• an obtaining device which obtains image data for respective three primary colors in turn at a same frame rate and at different timings;
• a characteristic point extracting device which extracts a characteristic point in image data for a color that is different from the color of image data of an attention frame from among the image data obtained by the obtaining device, the image data being obtained at a timing closest to the timing of the obtainment of the image data of the attention frame;
• a corresponding point extracting device which extracts a corresponding point in image data for a color that is the same as the color of the image data whose characteristic point has been extracted, which is obtained at a timing closest to the obtainment of the image data whose characteristic point has been extracted, with the timing of the obtainment of the attention frame between the timing of the obtainment of the image data whose characteristic point has been extracted and the timing of the obtainment of the image data, the corresponding point corresponding to the characteristic point extracted by the characteristic point extracting device;
• an estimating device which estimates corresponding points in image data for a time that is the same as the time of the obtainment of the attention frame and for colors that are different from the color of the attention frame, based on the distance between the characteristic point extracted by the characteristic point extracting device and the corresponding point extracted by the corresponding point extracting device, and the timings of the obtainment of the image data by the obtaining device;
• a first generating device which generates the image data for a time that is the same as the time of the obtainment of the image data of the attention frame and for colors that are different from the color of the image data of the attention frame, by modifying the image data whose characteristic point has been extracted by the characteristic point extracting device, based on the characteristic point extracted by the characteristic point extracting device and the corresponding points estimated by the estimating device, or modifying the image data whose corresponding point has been extracted by the corresponding point extracting device, based on the corresponding point extracted by the corresponding point extracting device and the corresponding points estimated by the estimating device;
• and
• a second generating device which generates image data including three primary colors for image data for the attention frame, by combining the image data of the attention frame and the image data for a time that is the same as the time of the obtainment of the image data of the attention frame and for colors that are different from the color of the image data of the attention frame, which have been generated by the first generating device.

A moving image generating method comprising the steps of:

• (a) obtaining a series of image data in which high-resolution first image data obtained at a predetermined frame rate and low-resolution second image data obtained at times that are different from the times of the obtainment of the first image data are arranged in a given order;
• (b) extracting a characteristic point in the first image data;
• (c) detecting a corresponding point in the second image data, the corresponding point corresponding to a characteristic point in first image data obtained immediately before the second image data;
• (d) generating high-resolution image data having a content that is the same as that of the second image data by modifying the first image data based on the extracted characteristic point and the detected corresponding point;
• and
• (e) performing steps (b) to (d) for all the second image data obtained at step (a).

A moving image generating method comprising the steps of:

• (a) obtaining image data for respective three primary colors obtained in turn at a same frame rate and at different timings;
• (b) extracting a characteristic point in image data of an attention frame from among the obtained image data;
• (c) extracting a corresponding point in image data for a color that is the same as the color of the image data of the attention frame, the image data being obtained at a timing closest to the timing of the obtainment of the image data of the attention frame, the corresponding point corresponding to the extracted characteristic point in the image data of the attention frame;
• (d) estimating corresponding points in image data for colors that are different from the color of the image data of the attention frame, the image data being adjacent to the image data of the attention frame, based on the distance between the characteristic point in the image data of the attention frame, which has been extracted at step (B), and the corresponding point in the image data for a color that is the same as the color of the image data of the attention frame, the image data being obtained at a timing closest to the timing of the obtainment of the image data of the attention frame, which has been extracted at step (c), and the timings of the obtainment of the image data at step (a);
• (e) generating image data for a time that is the same as the time of the obtainment of the attention frame and for colors that are different from the color of the attention frame, by modifying the image data adjacent to the image data of the attention frame based on the obtained characteristic point and the estimated corresponding point;
• (f) generating image data including three primary colors for image data for the attention frame, by combining the image data of the attention frame, and the generated image data for a time that is the same as the time of the obtainment of the attention frame and for colors that are different from the color of the attention frame;
• and
• (g) performing steps (b) to (f) for all the image data obtained at step (a).