Image processing device, imaging device, image processing method, and image processing program

An image processing device comprising:

• an image processing unit including means of generating pixel data for a predetermined color in an intermediate mode implemented based on pixel data obtained from a predetermined pixel region in a light receiving element when an object is captured in a state where infrared light is projected, and means of generating the pixel data for the predetermined color in a night-vision mode implemented based on pixel data obtained from a wider pixel region than the predetermined pixel region in the light receiving element when the object is captured in the state where the infrared light is projected;
• and
• a mode switching unit configured to switch, depending on a condition, between a state where an image output unit outputs an image signal generated in the intermediate mode and a state where the image output unit outputs an image signal generated in the night-vision mode,
• wherein:
• the intermediate mode is configured to generate pixel data for red based on pixel data obtained from a first pixel region in the light receiving element when the object is captured in a state where a first infrared light is projected, pixel data obtained from the first pixel region in the light receiving element when the object is captured in a state where a second infrared light is projected and pixel data obtained from the first pixel region in the light receiving element when the object is captured in a state where a third infrared light is projected, generate pixel data for green based on pixel data obtained from a second pixel region in the light receiving element when the object is captured in the state where the first infrared light is projected, pixel data obtained from the second pixel region in the light receiving element when the object is captured in the state where the second infrared light is projected and pixel data obtained from the second pixel region in the light receiving element when the object is captured in the state where the third infrared light is projected, and generate pixel data for blue based on pixel data obtained from a third pixel region in the light receiving element when the object is captured in the state where the first infrared light is projected, pixel data obtained from the third pixel region in the light receiving element when the object is captured in the state where the second infrared light is projected and pixel data obtained from the third pixel region in the light receiving element when the object is captured in the state where the third infrared light is projected;
• the night-vision mode is configured to generate pixel data for red based on pixel data obtained from a fourth pixel region in the light receiving element when the object is captured in the state where the first infrared light is projected, pixel data obtained from the fourth pixel region in the light receiving element when the object is captured in the state where the second infrared light is projected and pixel data obtained from the fourth pixel region in the light receiving element when the object is captured in the state where the third infrared light is projected, generate pixel data for green based on pixel data obtained from a fifth pixel region in the light receiving element when the object is captured in the state where the first infrared light is projected, pixel data obtained from the fifth pixel region in the light receiving element when the object is captured in the state where the second infrared light is projected and pixel data obtained from the fifth pixel region in the light receiving element when the object is captured in the state where the third infrared light is projected, and generate pixel data for blue based on pixel data obtained from a sixth pixel region in the light receiving element when the object is captured in the state where the first infrared light is projected, pixel data obtained from the sixth pixel region in the light receiving element when the object is captured in the state where the second infrared light is projected and pixel data obtained from the sixth pixel region in the light receiving element when the object is captured in the state where the third infrared light is projected,
• wherein:
• the fourth pixel region is wider than the first pixel region;
• the fifth pixel region is wider than the second pixel region;
• and
• the sixth pixel region is wider than the third pixel region.

An image processing device comprising:

• an image processing unit including means of generating pixel data for a predetermined color in an intermediate mode implemented based on pixel data obtained from a predetermined pixel region in a light receiving element when an object is captured in a state where infrared light is projected, and means of generating the pixel data for the predetermined color in a night-vision mode implemented based on pixel data obtained from a wider pixel region than the predetermined pixel region in the light receiving element when the object is captured in the state where the infrared light is projected;
• and
• a mode switching unit configured to switch, depending on a condition, between a state where an image output unit outputs an image signal generated in the intermediate mode and a state where the image output unit outputs an image signal generated in the night-vision mode,
• wherein:
• the intermediate mode is configured to generate pixel data for red based on pixel data obtained from a first pixel region in the light receiving element when the object is captured in a state where a first infrared light is projected, generate pixel data for green based on pixel data obtained from a second pixel region in the light receiving element when the object is captured in a state where a second infrared light is projected, and generate pixel data for blue based on pixel data obtained from a third pixel region in the light receiving element when the object is captured in a state where a third infrared light is projected;
• the night-vision mode is configured to generate pixel data for red based on pixel data obtained from a fourth pixel region in the light receiving element when the object is captured in a state where the first infrared light is projected;
• generate pixel data for green based on pixel data obtained from a fifth pixel region in the light receiving element when the object is captured in a state where the second infrared light is projected, and generate pixel data for blue based on pixel data obtained from a sixth pixel region in the light receiving element when the object is captured in a state where the third infrared light is projected,
• wherein:
• the fourth pixel region is wider than the first pixel region;
• the fifth pixel region is wider than the second pixel region;
• and
• the sixth pixel region is wider than the third pixel region.

An image processing method comprising the steps of:

• generating pixel data for a predetermined color in an intermediate mode implemented based on pixel data obtained from a predetermined pixel region in a light receiving element when an object is captured in a state where infrared light is projected;
• generating the pixel data for the predetermined color in a night-vision mode implemented based on pixel data obtained from a wider pixel region than the predetermined pixel region in the light receiving element when the object is captured in the state where the infrared light is projected;
• and
• switching, depending on a condition, between a state where an image output unit outputs an image signal generated in the intermediate mode and a state where the image output unit outputs an image signal generated in the night-vision mode,
• wherein:
• the intermediate mode is configured to:
• generate pixel data for red based on pixel data obtained from a first pixel region in the light receiving element when the object is captured in a state where the infrared light is projected;
• generate pixel data for green based on pixel data obtained from a second pixel region in the light receiving element when the object is captured in a state where the infrared light is projected;
• and
• generate pixel data for blue based on pixel data obtained from a third pixel region in the light receiving element when the object is captured in a state where the infrared light is projected;
• in the night-vision mode, generating pixel data for red based on pixel data obtained from a fourth pixel region in the light receiving element when the object is captured in a state where the infrared light is projected;
• generating pixel data for green based on pixel data obtained from a fifth pixel region in the light receiving element when the object is captured in a state where the infrared light is projected, and generating pixel data for blue based on pixel data obtained from a sixth pixel region in the light receiving element when the object is captured in a state where the infrared light is projected,
• wherein:
• the fourth pixel region is wider than the first pixel region;
• the fifth pixel region is wider than the second pixel region;
• and
• the sixth pixel region is wider than the third pixel region.