# US 2013/0155275 A1 · Image capturing apparatus, image capturing method, and computer-readable recording medium storing image capturing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155275 A1
- Document ID: US20130155275A1
- Status: Published application
- Kind: A1
- Application number: 13/677,643
- Filed: 2012-11-15
- Published: 2013-06-20
- Earliest claimed: 2011-12-15
- Assignees: Fujitsu Limited
- Inventors: Masayoshi Shimizu; Satoshi Nakashima; Nobuyuki Kanto
- Web page: https://patentgrep.com/patent/US20130155275A1

## CPC

- H04N 23/56: provided with illuminating means
- H04N 5/2226: {Determination of depth image, e.g. for foreground/background separation (determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10)}
- H04N 23/65: Control of camera operation in relation to power supply
- H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control
- H04N 25/134: {based on three different wavelength filter elements}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image capturing apparatus includes: an image capturing device in which a plurality of pixels having sensitivity to visible light and illuminating light in a certain wavelength range are arranged and that captures a moving image having a plurality of frames; a radiation device that radiates the illuminating light onto an image capturing region of the image capturing device; and a processor that executes a procedure, the procedure comprising: selecting, from among a plurality of frames captured by the image capturing device, a frame captured during an OFF period of the radiation device, and outputting the selected frame as a frame representing a visible image of the image capturing region.

## Claims

### Claim 1

An image capturing apparatus comprising:
an image capturing device in which a plurality of pixels having sensitivity to visible light and illuminating light in a certain wavelength range are arranged and that captures a moving image having a plurality of frames;
a radiation device that radiates the illuminating light onto an image capturing region of the image capturing device; and
a processor that executes a procedure, the procedure comprising:
selecting, from among a plurality of frames captured by the image capturing device, a frame captured during an OFF period of the radiation device, and
outputting the selected frame as a frame representing a visible image of the image capturing region.

### Claim 2 (depends on 1)

The image capturing apparatus according to claim 1, the procedure further comprising:
executing a measurement process using another frame captured during an ON period of the radiation device.

### Claim 3 (depends on 1)

The image capturing apparatus according to claim 1, wherein the radiation device radiates the illuminating light mainly composed of infrared light.

### Claim 4 (depends on 3)

The image capturing apparatus according to claim 3, the procedure further comprising:
correcting color deterioration of the selected frame due to an effect of infrared light radiated from a light source different from the radiation device, and
wherein the outputting outputs the corrected frame.

### Claim 5 (depends on 1)

The image capturing apparatus according to claim 1, the procedure further comprising:
generating, on the basis of the frame captured during the OFF period of the radiation device, another frame representing a visible image in an ON period of the radiation device, and
outputting the other frame as a visible image in the ON period.

### Claim 6 (depends on 5)

The image capturing apparatus according to claim 5, wherein the generating of the other frame generates the other frame by copying a last frame captured during an OFF period immediately before the ON period or a first frame captured during an OFF period immediately after the ON period.

### Claim 7 (depends on 5)

The image capturing apparatus according to claim 5, wherein the generating of the other frame generates the other frame on the basis of a frame interpolation process performed on a last frame captured during an OFF period immediately before the ON period and a first frame captured during an OFF period immediately after the ON period.

### Claim 8 (depends on 1)

The image capturing apparatus according to claim 1, the procedure further comprising:
executing control in which intervals at which the image capture device captures the moving image are switched between first intervals and second intervals, which are shorter than the first intervals,
executing, in a period in which the image capturing device captures the moving image at the first intervals, control such that the radiation device is turned off,
executing, in a period in which the image capturing device captures the moving image at the second intervals, control such that the radiation device is turned on, and
outputting the frame captured during the OFF period of the radiation device as the frame representing the visible image.

### Claim 9 (depends on 1)

The image capturing apparatus according to claim 1, the procedure further comprising:
comparing a first frame captured during an ON period of the radiation device and a second frame captured during an OFF period of the radiation device, and
calculating, on the basis of a result of the comparison, a value indicating a magnitude of an effect of the illuminating light upon color of the first frame, and
wherein the selecting selects a frame captured during an ON period of the radiation device from among the plurality of frames and the frame captured during the OFF period, when the value is smaller than or equal to a threshold.

### Claim 10 (depends on 9)

The image capturing apparatus according to claim 9, wherein the comparing divides the first frame into a plurality of regions, divides the second frame into a plurality of regions, and compares each of the plurality of regions of the first frame with each of the plurality of regions of the second frame.

### Claim 11 (depends on 9)

The image capturing apparatus according to claim 9, the procedure further comprising:
instructing, when the value is larger than the threshold, the radiation device to turn on at a timing for a certain ON period and to turn off in periods other than the ON period.

### Claim 12 (depends on 9)

The image capturing apparatus according to claim 9, the procedure further comprising:
executing, when the value is smaller than or equal to the threshold, control such that the radiation device remains turned on while the image capturing device captures the moving image.

### Claim 13

An image capturing method executed by a computer, the image capturing method comprising:
sequentially obtaining a plurality of frames from an image capturing device in which a plurality of pixels having sensitivity to visible light and illuminating light in a certain wavelength range are arranged and that captures a moving image having a plurality of frames;
controlling a radiation device that radiates the illuminating light onto an image capturing region of the image capturing device;
selecting, from among a plurality of frames captured by the image capturing device, a frame captured during an OFF period of the radiation device; and
outputting the selected frame as a frame representing a visible image of the image capturing region.

### Claim 14 (depends on 13)

The image capturing method according to claim 13, further comprising:
executing a measurement process using another frame captured during an ON period of the radiation device.

### Claim 15 (depends on 13)

The image capturing method according to claim 13, further comprising:
correcting color deterioration of the selected frame due to an effect of infrared light radiated from a light source different from the radiation device, and
wherein the outputting outputs the corrected frame.

### Claim 16 (depends on 13)

The image capturing method according to claim 13, further comprising:
generating, on the basis of the frame captured during the OFF period of the radiation device, another frame representing a visible image in an ON period of the radiation device; and
outputting the other frame as a visible image in the ON period.

### Claim 17

A computer-readable recording medium storing an image capturing program for causing a computer to execute a process, the process comprising:
sequentially obtaining a plurality of frames from an image capturing device in which a plurality of pixels having sensitivity to visible light and illuminating light in a certain wavelength range are arranged and that captures a moving image having a plurality of frames;
controlling a radiation device that radiates the illuminating light onto an image capturing region of the image capturing device;
selecting, from among a plurality of frames captured by the image capturing device, a frame captured during an OFF period of the radiation device; and
outputting the selected frame as a frame representing a visible image of the image capturing region.

### Claim 18 (depends on 17)

The computer-readable recording medium according to claim 17, the process further comprising:
executing a measurement process using another frame captured during an ON period of the radiation device.

### Claim 19 (depends on 17)

The computer-readable recording medium according to claim 17, the process further comprising:
correcting color deterioration of the selected frame due to an effect of infrared light radiated from a light source different from the radiation device, and
wherein the outputting outputs the corrected frame.

### Claim 20 (depends on 17)

The computer-readable recording medium according to claim 17, the process further comprising:
generating, on the basis of the frame captured during the OFF period of the radiation device, another frame representing a visible image in an ON period of the radiation device; and
outputting the other frame as a visible image in the ON period.
