# US 2022/0286650 A1 · Image detecting device and image detecting method using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286650 A1
- Document ID: US20220286650A1
- Status: Published application
- Kind: A1
- Application number: 17/827,108
- Filed: 2022-05-27
- Published: 2022-09-08
- Earliest claimed: 2016-06-16
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Kwanghyuk BAE; Chaesung KIM
- Web page: https://patentgrep.com/patent/US20220286650A1

## CPC

- G01S 17/02: Systems using the reflection of electromagnetic waves other than radio waves (G01S17/66 takes precedence)
- G01S 17/08: for measuring distance only (indirect measurement G01S17/46; active triangulation systems G01S17/48)
- G01S 17/46: Indirect determination of position data
- G01S 17/89: for mapping or imaging
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- G06V 40/18: Eye characteristics, e.g. of the iris
- H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- H04N 23/13: with multiple sensors
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/56: provided with illuminating means
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/73: by influencing the exposure time
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 25/131: including elements passing infrared wavelengths
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image detecting device includes a color image sensor configured to sense visible light and to output color image data based on the sensed visible light; a first infrared lighting source configured to provide first infrared rays to a subject; a second infrared lighting source configured to provide second infrared rays to the subject; a mono image sensor configured to sense a first infrared light or a second infrared light reflected from the subject and output infrared image data; and an image signal processor configured to, measure an illuminance value based on the color image data, measure a distance value of the subject based on a portion of the infrared image data corresponding to the first infrared light, and obtain an identification image of the subject based on the illuminance value, the distance value, and a portion of the infrared image data corresponding to the second infrared light.

## Claims

### Claim 1

A smartphone comprising:
an image detecting device comprising:
a first infrared lighting unit configured to provide first infrared rays to a subject;
a second infrared lighting unit configured to provide second infrared rays to the subject; and
a first sensor configured to sense a first infrared light reflected from the subject based on the first infrared rays, and
an image signal processor configured to
process a facial recognition based on the first infrared light reflected from the subject,
receive infrared image data from the first sensor based on a second infrared light reflected from the subject and a third infrared light reflected from the subject when the first and second lighting units are not operating, the infrared image data including first infrared image data received from the second infrared light and second infrared image data received from the third infrared light,
crop the infrared image data to generate mono thumbnail data, and
process a distance measurement between the subject and the first sensor according to an equation
dd
∝
(
RC
Ion
-
Ioff
)
0.5
,
where dd is the distance measurement, Ion is the first infrared image data, Ioff is the second infrared image data, and RC is an amplitude ratio of light incident to the subject and light reflected from the subject,
wherein a distance between the second infrared lighting unit and the first sensor is shorter than a distance between the first infrared lighting unit and the first sensor.

### Claim 2 (depends on 1)

The smartphone of claim 1, further comprising a second sensor configured to sense visible light and to output color image data based on the sensed visible light.

### Claim 3 (depends on 2)

The smartphone of claim 2, further comprising an application processor configured to control the first sensor and the second sensor, and
wherein the application processor is separated from the first sensor and the second sensor.

### Claim 4 (depends on 1)

The smartphone of claim 1, wherein the first infrared light unit comprise a first infrared lighting unit driver and a first infrared lighting unit source, and
wherein the first infrared lighting unit driver is configured to control driving of the first infrared lighting unit source.

### Claim 5 (depends on 1)

The smartphone of claim 1, wherein the second infrared light unit comprise a second infrared lighting unit driver and a second infrared lighting unit source, and
wherein the second infrared lighting unit driver is configured to control driving of the second infrared lighting unit source.

### Claim 6 (depends on 1)

The smartphone of claim 1, wherein the first infrared lighting unit is configured to provide the first infrared rays with a first level of power and the second infrared lighting unit is configured to provide the second infrared rays with a second level of power lower than the first level of power.

### Claim 7 (depends on 1)

The smartphone of claim 1, further comprising a timing controller configured to control an operation of the first sensor and to drive the first infrared lighting unit.

### Claim 8 (depends on 7)

The smartphone of claim 7, wherein the timing controller is configured to synchronize a sense time of the first sensor with a time during which the first infrared lighting unit provides the first infrared rays.

### Claim 9 (depends on 7)

The smartphone of claim 7, wherein the timing controller is configured to drive both the first infrared lighting unit and the second infrared lighting unit.

### Claim 10

A smartphone comprising:
an image detecting device comprising:
a first infrared lighting unit configured to provide first infrared rays to a subject;
a second infrared lighting unit configured to provide second infrared rays to the subject; and
a first sensor configured to sense a first infrared light reflected from the subject based on the first infrared rays, and
an image signal processor configured to
process a three-dimensional recognition of the subject based on the first infrared light reflected from the subject,
receive infrared image data from the first sensor based on a second infrared light reflected from the subject and a third infrared light reflected from the subject when the first and second lighting units are not operating, the infrared image data including first infrared image data received from the second infrared light and second infrared image data received from the third infrared light,
crop the infrared image data to generate mono thumbnail data, and
process a distance measurement between the subject and the sensor according to an equation
dd
∝
(
RC
Ion
-
Ioff
)
0.5
,
where dd is the distance measurement, Ion is the first infrared image data, Ioff is the second infrared image data, and RC is an amplitude ratio of light incident to the subject and light reflected from the subject,
wherein a distance between the second infrared lighting unit and the first sensor is shorter than a distance between the first infrared lighting unit and the first sensor.

### Claim 11 (depends on 10)

The smartphone of claim 10, further comprising a second sensor configured to sense visible light and to output color image data based on the sensed visible light.

### Claim 12 (depends on 11)

The smartphone of claim 11, further comprising an application processor configured to control the first sensor and the second sensor, and
wherein the application processor is separated from the first sensor and the second sensor.

### Claim 13 (depends on 10)

The smartphone of claim 10, wherein the first infrared light unit comprise a first infrared lighting unit driver and a first infrared lighting unit source, and
wherein the first infrared lighting unit driver is configured to control driving of the first infrared lighting unit source.

### Claim 14 (depends on 10)

The smartphone of claim 10, wherein the second infrared light unit comprise a second infrared lighting unit drive and a second infrared lighting unit source, and
wherein the second infrared lighting unit drive is configured to control driving of the second infrared lighting unit source.

### Claim 15 (depends on 10)

The smartphone of claim 10, wherein the first infrared lighting unit is configured to provide the first infrared rays with a first level of power and the second infrared lighting unit is configured to provide the second infrared rays with a second level of power lower than the first level of power.

### Claim 16 (depends on 10)

The smartphone of claim 10, further comprising a timing controller configured to control an operation of the first sensor and to drive the first infrared lighting unit.

### Claim 17 (depends on 16)

The smartphone of claim 16, wherein the timing controller is configured to synchronize a sense time of the first sensor with a time during which the first infrared lighting unit provides the first infrared rays.

### Claim 18 (depends on 16)

The smartphone of claim 16, wherein the timing controller is configured to drive both the first infrared lighting unit and the second infrared lighting unit.
