Image processing apparatus, image processing method, and electronic device

An image processing method, comprising:

• in an image processing apparatus that includes a preprocessing section, a memory section, a region determining section, an image cutting-out section, and a post processing section:
• executing, by the preprocessing section, a first signal process on a plurality of pixel signals at a first frame rate higher than an output frame rate of the image processing apparatus;
• generating, by the preprocessing section, reduced pixel signals from the plurality of pixel signals based on the executed first signal process,
• wherein the plurality of pixel signals corresponds to an image output from an imaging element, and
• the reduced pixel signals are associated with a plurality of frames;
• transmitting, by the preprocessing section, the reduced pixel signals to the memory section;
• storing, in the memory section, the reduced pixel signals transmitted by the preprocessing section;
• calculating, by the region determining section, motion information of the imaging element based on information associated with the stored reduced pixel signals;
• determining, by the region determining section, a cutout region of the image based on the stored reduced pixel signals, the calculated motion information of the imaging element, and synchronization of a first time point and a second time point, wherein
• the first time point corresponds to a time of the generation of the reduced pixel signals, and
• the second time point corresponds to a time of the calculation of the motion information of the imaging element;
• cutting out, by the image cutting-out section, an effective pixel region of the image based on the determined cutout region, wherein a set of reduced pixel signals of the reduced pixel signals corresponds to the effective pixel region;
• storing, in the memory section, the set of reduced pixel signals after the cutout of the effective pixel region;
• reading out, by the post processing section, the stored set of reduced pixel signals;
• and
• executing, by the post processing section, a second signal process, at a second frame rate slower than the first frame rate, for the effective pixel region based on the reading out of the stored set of reduced pixel signals,
• wherein the first signal process is different from the second signal process.

A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

• executing a first signal process on a plurality of pixel signals at a first frame rate;
• generating reduced pixel signals from the plurality of pixel signals based on the executed first signal process, wherein
• the plurality of pixel signals corresponds to an image output from an imaging element, and
• the reduced pixel signals are associated with a plurality of frames;
• transmitting the reduced pixel signals to a memory section;
• storing the transmitted reduced pixel signals in the memory section;
• calculating motion information of the imaging element based on information associated with the stored reduced pixel signals;
• determining a cutout region of the image based on the stored reduced pixel signals, the calculated motion information of the imaging element, and synchronization of a first time point and a second time point, wherein
• the first time point corresponds to a time of the generation of the reduced pixel signals, and
• the second time point corresponds to a time of the calculation of the motion information of the imaging element;
• cutting out an effective pixel region of the image based on the determined cutout region, wherein a set of reduced pixel signals of the reduced pixel signals corresponds to the effective pixel region;
• storing, in the memory section, the set of reduced pixel signals after the cutout of the effective pixel region;
• reading out the stored set of reduced pixel signals;
• and
• executing a second signal process, at a second frame rate slower than the first frame rate, for the effective pixel region based on the reading out of the stored set of reduced pixel signals, wherein the first signal process is different from the second signal process.

An electronic device, comprising:

• an image processing apparatus that comprises:
• a memory section;
• a preprocessing section configured to:
• execute a first signal process on a plurality of pixel signals at a first frame rate higher than an output frame rate of the image processing apparatus;
• generate reduced pixel signals from the plurality of pixel signals based on the executed first signal process, wherein
• the plurality of pixel signals corresponds to an image output from an imaging element, and
• the reduced pixel signals are associated with a plurality of frames;
• and
• transmit the reduced pixel signals to the memory section,
• wherein the memory section is configured to store the reduced pixel signals transmitted by the preprocessing section;
• a region determining section configured to:
• calculate motion information of the imaging element based on information associated with the stored reduced pixel signals;
• and
• determine a cutout region of the image based on the stored reduced pixel signals, the calculated motion information of the imaging element, and synchronization of a first time point and a second time point, wherein
• the first time point corresponds to a time of the generation of the reduced pixel signals, and
• the second time point corresponds to a time of the calculation of the motion information of the imaging element;
• an image cutting-out section configured to cut out an effective pixel region of the image based on the determined cutout region, wherein
• a set of reduced pixel signals of the reduced pixel signals corresponds to the effective pixel region, and
• the memory section is further configured to store the set of reduced pixel signals after the cutout of the effective pixel region;
• and
• a post processing section configured to:
• read out the stored set of reduced pixel signals;
• and
• execute a second signal process, at a second frame rate slower than the first frame rate, for the effective pixel region based on the read out of the stored set of reduced pixel signals, wherein the first signal process is different from the second signal process.