# US 11,310,435 B2 · Image pickup apparatus having auto day-night function, control method therefor, and storage medium storing control program therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,435 B2 - Document ID: US11310435B2 - Status: Granted - Kind: B2 - Application number: 17/105,803 - Filed: 2020-11-27 - Published: 2021-03-18 - Granted: 2022-04-19 - Earliest claimed: 2018-05-24 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Ryo Kawasaki - Web page: https://patentgrep.com/patent/US11310435B2 ## CPC - H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes - H04N 23/72: Combination of two or more compensation controls - G02B 5/208: {for use with infrared or ultraviolet radiation, e.g. for separating visible light from infrared and/or ultraviolet radiation} - H04N 23/11: for generating image signals from visible and infrared light wavelengths - H04N 23/20: for generating image signals from infrared radiation only - H04N 23/71: Circuitry for evaluating the brightness variation - G02B 7/006: {Filter holders} - H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof - H04N 23/74: by influencing the scene brightness using illuminating means - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract An image pickup apparatus that is capable of preventing hunching certainly at low cost and of switching between the day mode and the night mode at an optimal timing. An image sensor outputs an image signal depending on an optical image formed through an image pickup optical system. A mode setting unit sets a photographing mode for photographing using the image sensor from among a day mode and a night mode in which sensitivity for a wavelength range corresponding to infrared light is higher than that in the day mode. An obtaining unit obtains ratio information about the ratios of the infrared light and visible light based on the image signal in the night mode. A condition setting unit sets a determination condition that is used for switching the photographing mode to the day mode from the night mode based on the ratio information. ## Claims ### Claim 1 An image pickup apparatus comprising: an image sensor that outputs an image signal depending on an optical image formed through an image pickup optical system; and at least one processor that executes a set of instructions to: set a photographing mode for photographing using the image sensor from among a day mode and a night mode in which sensitivity for a wavelength range corresponding to infrared light is higher than that in the day mode; obtain an object luminance and a visible light level from the image signal in the night mode; determine whether infrared light or visible light is dominant in the night mode based on the object luminance and the visible light level; and set a first threshold for the object luminance and a second threshold for the visible light level based on the determination result, the first threshold and the second threshold being used for switching the photographing mode to the day mode from the night mode; wherein in a case where visible light is dominant in the night mode, the first threshold and the second threshold are set such that the first threshold is higher than the object luminance and the second threshold is equal to or lower than the visible light level. ### Claim 2 (depends on 1) The image pickup apparatus according to claim 1, further comprising an infrared cut filter provided with an attenuation area that reduces intensity of light in a wavelength range corresponding to infrared light in the object light that enters into the image sensor, wherein the night mode is a photographing mode in which an object is photographed in a state where the attenuation area of the infrared cut filter is extracted from an optical path of the image pickup optical system, wherein the day mode is a photographing mode in which an object is photographed in a state where the attenuation area of the infrared cut filter is inserted into the optical path of the image pickup optical system, and wherein the at least one processor executes instructions to set the first threshold for the object luminance and a second threshold for the visible light level that are used for inserting the attenuation area of the infrared cut filter into the optical path of the image pickup optical system from the state where the attenuation area of the infrared cut filter is extracted from the optical path of the image pickup optical system. ### Claim 3 (depends on 1) The image pickup apparatus according to claim 1, wherein in a case where infrared light is dominant in the night mode, the first threshold and the second threshold are set such that the first threshold is equal to or lower than the object luminance and the second threshold is higher than the visible light level. ### Claim 4 (depends on 1) The image forming apparatus according to claim 1, wherein the at least one processor executes instructions to perform a first setting process to set the first threshold by multiplying a first hysteresis coefficient to the object luminance and to set the second threshold based on the visible light level in a case where the visible light is dominant in the night mode. ### Claim 5 (depends on 3) The image forming apparatus according to claim 3, wherein the at least one processor executes instructions to perform a second setting process to set the first threshold based on the object luminance and to set the second threshold by multiplying a second hysteresis coefficient to the visible light level in a case where the infrared light is dominant in the night mode. ### Claim 6 (depends on 2) The image forming apparatus according to claim 2, wherein the at least one processor executes instructions to determine that the attenuation area of the infrared cut filter should be inserted into the optical path in a case where the object luminance exceeds the first threshold and the visible light level exceeds the second threshold. ### Claim 7 (depends on 1) The image forming apparatus according to claim 1, wherein the at least one processor executes instructions to invalidate infrared information showing that there is much infrared light and set the first threshold by multiplying a first hysteresis coefficient to the object luminance in a case where the visible light is dominant in the night mode. ### Claim 8 (depends on 7) The image forming apparatus according to claim 7, wherein the at least one processor executes instructions to validate the infrared information and set the second threshold by multiplying a second hysteresis coefficient to the visible light level in a case where the infrared light is dominant in the night mode. ### Claim 9 (depends on 8) The image forming apparatus according to claim 8, wherein the at least one processor executes instructions to: determine that the attenuation area of the infrared cut filter should be inserted into the optical path in a case where the infrared information is invalid and the object luminance exceeds the first threshold in the first comparison result, and determine that the attenuation area of the infrared cut filter should be inserted into the optical path in a case where the infrared information is valid and the visible light level exceeds the second threshold in the second comparison result. ### Claim 10 (depends on 5) The image forming apparatus according to claim 5, wherein the at least one processor executes instructions to perform the first setting process and the second setting process under infrared light illumination in a case where a user selects to illuminate an object with infrared light at a time of photographing. ### Claim 11 (depends on 10) The image forming apparatus according to claim 10, wherein the at least one processor executes instructions to determine that the attenuation area of the infrared cut filter should be inserted into the optical path and determine to turn off the infrared light illumination in a case where the object luminance exceeds the first threshold in the first comparison result and the visible light level exceeds the second threshold in the second comparison result. ### Claim 12 (depends on 1) The image forming apparatus according to claim 1, wherein the at least one processor executes instructions to set the first threshold by multiplying a first hysteresis coefficient to the object luminance in a case where a user does not select to illuminate an object with infrared light at a time of photographing. ### Claim 13 (depends on 12) The image forming apparatus according to claim 12, wherein the at least one processor executes instructions to determine that the attenuation area of the infrared cut filter should be inserted into the optical path in a case where the object luminance exceeds the first threshold. ### Claim 14 (depends on 1) The image pickup apparatus according to claim 1, wherein the at least one processor executes instructions to: obtain image data by applying a predetermined image process to the image signal; output the image data as monochrome image data in the night mode; and output the image data as color image data in the day mode. ### Claim 15 A control method for an image pickup apparatus provided with an image sensor that outputs an image signal depending on an optical image formed through an image pickup optical system, the control method comprising: setting a photographing mode for photographing using the image sensor from among a day mode and a night mode in which sensitivity for a wavelength range corresponding to infrared light is higher than that in the day mode; obtaining an object luminance and a visible light level from the image signal in the night mode; determining whether infrared light or visible light is dominant in the night mode based on the object luminance and the visible light level; and setting a first threshold for the object luminance and a second threshold for the visible light level based on the determination result, the first threshold and the second threshold being used for switching the photographing mode to the day mode from the night mode, wherein in a case where visible light is dominant in the night mode, the first threshold and the second threshold are set such that the first threshold is higher than the object luminance and the second threshold is equal to or lower than the visible light level. ### Claim 16 A non-transitory computer-readable storage medium storing a control program causing a computer to execute a control method for an image pickup apparatus provided with an image sensor that outputs an image signal depending on an optical image formed through an image pickup optical system, the control method comprising: setting a photographing mode for photographing using the image sensor from among a day mode and a night mode in which sensitivity for a wavelength range corresponding to infrared light is higher than that in the day mode; obtaining an object luminance and a visible light level from the image signal in the night mode; determining whether infrared light or visible light is dominant in the night mode based on the object luminance and the visible light level; and setting a first threshold for the object luminance and a second threshold for the visible light level based on the determination result, the first threshold and the second threshold being used for switching the photographing mode to the day mode from the night mode, wherein in a case where visible light is dominant in the night mode, the first threshold and the second threshold are set such that the first threshold is higher than the object luminance and the second threshold is equal to or lower than the visible light level.