# US 12,120,438 B2 · IR-cut filter switch control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,120,438 B2
- Document ID: US12120438B2
- Status: Granted
- Kind: B2
- Application number: 18/153,465
- Filed: 2023-01-12
- Published: 2023-08-10
- Granted: 2024-10-15
- Earliest claimed: 2022-02-08
- Assignees: Axis AB
- Applicants: Axis AB
- Inventors: Axel Thuresson; Ola Synnergren
- Web page: https://patentgrep.com/patent/US12120438B2

## CPC

- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 25/131: including elements passing infrared wavelengths
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- H04N 23/60: Control of cameras or camera modules
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 23/75: by influencing optical camera components
- G02B 5/208: {for use with infrared or ultraviolet radiation, e.g. for separating visible light from infrared and/or ultraviolet radiation}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A method of performing better controlled switching between day mode and night mode imaging in a camera, where those illuminants contributing to the ambient light in day mode are considered when determining the visible light during night mode. Characteristic values of those illuminants are mixed with several levels of IR light to simulate the presence of an IR illuminator, and these characteristic values are compared to corresponding values derived from the color components of the ambient light in night mode in order to determine the IR proportion, and from that the amount of visible light.

## Claims

### Claim 1

A method, performed in a video camera, of controlling an infrared cut (IR-cut) filter of the video camera, to switch between day mode and night mode, wherein the camera comprises an image sensor having a color filter array configured to allow the sensor to sense different color components at different regions of the sensor, the method comprising:
measuring, by the image sensor, an amount of ambient light received by the image sensor and color components of the ambient light received by the image sensor, wherein the color components are determined by calculating the sum or integrated amount of ambient light received by the image sensor within the specific wavelength intervals corresponding to the color components,
when the video camera is in day mode,
determining a set of illuminants present in the scene and contributing to the ambient light intensity, by comparing the color components of ambient light received by the image sensor to a first set of characteristic values in the form of color components contributions associated with different illuminants,
when the amount of ambient light received by the image sensor is lower than a first threshold, switching to night mode, and
when the camera is in night mode,
obtaining a second set of characteristic values by mixing a wavelength spectrum of each illuminant in the determined set of illuminants with spectrums of several different levels of added IR light, such that the second set of characteristic values contains a plurality of characteristic values per illuminant, wherein the proportion of IR light per characteristic value in the second set comprises both IR light from the spectrum of the illuminant and from the spectrum of the added level of IR light,
determining an IR light proportion of the ambient light received by the image sensor, by comparing the color components of ambient light received by the image sensor to the second set of characteristic values in the form of color component contributions associated with different IR light proportions,
determining a visible light intensity based on the determined IR light proportion and the amount of ambient light received by the image sensor,
when the visible light intensity is higher than a second threshold, switching to day mode.

### Claim 2 (depends on 1)

The method of claim 1, wherein the IR-cut filter blocks IR light from reaching the image sensor in day mode and allows IR light to reach the image sensor in night mode.

### Claim 3 (depends on 1)

The method of claim 1, wherein the color filter array is configured to allow the sensor to measure three different color components.

### Claim 4 (depends on 3)

The method of claim 3, wherein the three color components are red, blue and green.

### Claim 5 (depends on 1)

The method of claim 1, wherein the comparison of the color components to characteristic values comprises
obtaining a first ratio of a first color component to a third color component or to a sum of the first, a second and the third color component and a second ratio of a second color component to the third color component or to a sum of the first, the second and the third color component, and comparing the obtained ratios to corresponding characteristic values of ratios.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the set of illuminants comprises accessing a first chart containing the first set of characteristic values associated with different illuminants.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the IR light proportion comprises accessing a second chart containing the second set of characteristic values associated with different IR light proportions.

### Claim 8 (depends on 1)

The method of claim 1, wherein the method is repeatedly performed at predetermined time intervals.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first threshold is lower than the second threshold.

### Claim 10 (depends on 1)

The method of claim 1, wherein the spectrums of the several different levels of IR light contains at least three different levels.

### Claim 11 (depends on 1)

The method of claim 1, wherein the spectrums of the several different levels of IR light i correspond to wavelength spectrums of an IR LED illumination unit mounted in the vicinity of the camera.

### Claim 12

A video camera comprising:
an image sensor having a color filter array configured to allow the sensor to sense different color components at different regions of the sensor, wherein the image sensor is configured to measure an amount of ambient light received by the image sensor and color components of the ambient light received by the sensor, wherein the color components are determined by calculating the sum or integrated amount of ambient light received by the sensor within specific wavelength intervals corresponding to the color components, and
an infrared cut (IR-cut) filter which is configured to be controlled by the camera to switch between day mode and night mode,
wherein the camera is configured to,
when the camera is in day mode,
determine a set of illuminants present in the scene and contributing to the ambient light intensity, by comparing the color components of ambient light received by the image sensor to a first set of characteristic values in the form of color components contributions associated with different illuminants,
when the amount of ambient light intensity is lower than a first threshold, switch to night mode,
when the camera is in night mode,
obtain a second set of characteristic values by mixing a wavelength spectrum of each illuminant in the determined set of illuminants with spectrums of several different levels of added IR light, such that the second set of characteristic values contains a plurality of characteristic values per illuminant, wherein the proportion of IR light per characteristic value in the second set comprises both IR light from the spectrum of the illuminant and the spectrum of the added level of IR light,
determine an IR light proportion of the ambient light received by the image sensor, by comparing the color components of ambient light received by the image sensor to a second set of characteristic values in the form of color component contributions associated with different IR light proportions,
determine a visible light intensity based on the determined IR light proportion and the amount of ambient light received by the image sensor,
when the visible light intensity is higher than a second threshold, switch to day mode.

### Claim 13 (depends on 12)

The video camera of claim 12, further comprising an IR LED illumination unit, wherein the several different levels of IR light correspond to wavelength spectrums of the IR LED illumination unit.

### Claim 14

A non-transitory computer readable storage medium having stored thereon instructions for implementing a method, when executed on a device having processing capabilities, the method, performed in a video camera, of controlling an infrared cut (IR-cut) filter of the video camera, to switch between day mode and night mode, wherein the camera comprises an image sensor having a color filter array configured to allow the sensor to sense different color components at different regions of the sensor, the method comprising:
measuring, by the image sensor, an amount of ambient light received by the image sensor and color components of the ambient light received by the image sensor, wherein the color components are determined by calculating the sum or integrated amount of ambient light received by the image sensor within specific wavelength intervals corresponding to the color components,
when the camera is in day mode,
determining a set of illuminants present in the scene and contributing to the ambient light intensity, by comparing the color components of ambient light received by the image sensor to a first set of characteristic values in the form of color components contributions associated with different illuminants,
when the amount of ambient light received by the image sensor is lower than a first threshold, switching to night mode, and
when the camera is in night mode,
obtaining a second set of characteristic values by mixing a wavelength spectrum of each illuminant in the determined set of illuminants with spectrums of several different levels of added IR light, such that the second set of characteristic values contains a plurality of characteristic values per illuminant, wherein the proportion of IR light per characteristic value in the second set comprises both IR light from the spectrum of the illuminant and from the spectrum of the added level of IR light,
determining an IR light proportion of the ambient light received by the image sensor, by comparing the color components of ambient light received by the image sensor to the second set of characteristic values in the form of color component contributions associated with different IR light proportions,
determining a visible light intensity based on the determined IR light proportion and the amount of ambient light received by the image sensor,
when the visible light intensity is higher than a second threshold, switching to day mode.
