# US 11,122,186 B2 · Image pickup device and electronic system including the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,122,186 B2
- Document ID: US11122186B2
- Status: Granted
- Kind: B2
- Application number: 16/677,718
- Filed: 2019-11-08
- Published: 2020-03-05
- Granted: 2021-09-14
- Earliest claimed: 2016-07-26
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Duck-Soo Kim
- Web page: https://patentgrep.com/patent/US11122186B2

## CPC

- H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56)
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 23/13: with multiple sensors
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/662: {by using camera arrangements where one camera controls another camera to affect the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image}
- H04N 23/67: Focus control based on electronic image sensor signals
- H04N 23/675: {comprising setting of focusing regions}
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/73: by influencing the exposure time
- H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image pickup device includes a first camera, a second camera, a first image signal processor (ISP) and a second ISP. The first camera obtains a first image of an object. The second camera obtains a second image of the object. The first ISP performs a first auto focusing (AF), a first auto white balancing (AWB) and a first auto exposing (AE) for the first camera based on a first region-of-interest (ROI) in the first image, and obtains a first distance between the object and the first camera based on a result of the first AF. The second ISP calculates first disparity information associated with the first and second images based on the first distance, moves a second ROI in the second image based on the first disparity information, and performs a second AF, a second AWB and a second AE for the second camera based on the moved second ROI.

## Claims

### Claim 1

An image signal processor comprising:
a first image processor configured to receive a first image from a first camera, to determine a first region-of-interest (ROI) in the first image, to determine a distance between an object in the first image and the first camera and to perform at least one of a first auto-focusing, a first auto-exposure and a first-auto white balancing for the first camera based on the first ROI; and
a second image processor configured to receive a second image from a second camera different from the first camera, to determine disparity information associated with the first image and the second image based on the distance determined by the first image processor, move a second ROI in the second image based on the disparity information, and perform at least one of a second auto-focusing, a second auto-exposure and a second auto-white balancing for the second camera based on the moved second ROI in the second image,
wherein the first camera is a master camera and the second camera is a slave camera, and
wherein determination of the first camera and the second camera as the master camera and the slave camera is based on a user setting signal or an internal parameter.

### Claim 2 (depends on 1)

The image signal processor of claim 1, wherein the at least one of the first auto-focusing, the first auto-exposure and the first auto-white balancing is synchronized with the at least one of the second auto-focusing, the second auto-exposure and the second auto-white balancing.

### Claim 3 (depends on 2)

The image signal processor of claim 2, wherein the at least one of the first auto-focusing, the first auto-exposure and the first auto-white balancing is synchronized with the at least one of the second auto-focusing, the second auto-exposure and the second auto-white balancing based on the at least one of the first auto-focusing, the first auto-exposure and the first auto-white balancing.

### Claim 4 (depends on 1)

The image signal processor of claim 1, wherein the first ROI and the second ROI are a face of the object.

### Claim 5 (depends on 4)

The image signal processor of claim 4, wherein the first ROI and the second ROI are automatically set based on predetermined rules.

### Claim 6 (depends on 5)

The image signal processor of claim 5, wherein the first image processor comprises a first auto-focus controller configured to generate a first auto-focusing control signal for the first auto-focusing.

### Claim 7 (depends on 6)

The image signal processor of claim 6, wherein the second image processor comprises a second auto-focus controller configured to generate a second auto-focusing control signal for the second auto-focusing.

### Claim 8 (depends on 7)

The image signal processor of claim 7, wherein the second image processor further comprises a second auto-exposure controller configured to perform the second auto-exposure for the second camera, and a second auto-white balancing controller configured to perform the second -auto white balancing for the second camera.

### Claim 9 (depends on 6)

The image signal processor of claim 6, wherein the first image processor further comprises a first auto-exposure controller configured to perform the first auto-exposure for the first camera, and a first auto-white balancing controller configured to perform the first-auto white balancing for the first camera.

### Claim 10

An electronic system comprising:
a first camera configured to obtain a first image of an object;
a second camera configured to obtain a second image of the object;
a first image processor configured to receive the first image from the first camera, to determine a first region-of-interest (ROI) in the first image, to determine a distance between the object in the first image and the first camera and to perform at least one of a first auto-focusing, a first auto-exposure and a first auto-white balancing for the first camera based on the first ROI; and
a second image processor configured to receive the second image from the second camera which is different from the first camera, to determine disparity information associated with the first image and the second image based on the distance determined by the first image processor, move a second ROI in the second image based on the disparity information, and to perform at least one of a second auto-focusing, a second auto-exposure and a second auto-white balancing for the second camera based on the moved second ROI,
wherein the first camera is a master camera and the second camera is a slave camera, and
wherein determination of the first camera and the second camera as the master camera and the slave camera is based on a user setting signal or an internal parameter.

### Claim 11 (depends on 10)

The electronic system of claim 10, wherein the first image processor is configured to output a first output image and the second image processor is configured to output a second output image, and
wherein the electronic system is configured to generate a composite image by combining the first output image and the second output image.

### Claim 12 (depends on 11)

The electronic system of claim 11, wherein the first camera comprises a first lens driver and a first lens, and
wherein the first lens driver is configured to move the first lens in response to a first control signal received from the first image processor.

### Claim 13 (depends on 12)

The electronic system of claim 12, wherein the at least one of the first auto-focusing, the first auto-exposure and the first auto-white balancing is synchronized with the at least one of the second auto-focusing, the second auto-exposure and the second auto-white balancing.

### Claim 14 (depends on 11)

The electronic system of claim 11, wherein the first ROI and the second ROI are a face of the object.

### Claim 15 (depends on 14)

The electronic system of claim 14, wherein the first ROI and the second ROI are automatically set based on predetermined rules.

### Claim 16 (depends on 12)

The electronic system of claim 12, further comprising:
a third camera configured to generate a third image, and
wherein the first camera, the second camera and the third camera are sequentially arranged along a same direction.

### Claim 17 (depends on 16)

The electronic system of claim 16, wherein the second camera comprises a second lens driver and a second lens, and
wherein the second lens driver is configured to move the second lens in response to a second control signal received from the second image processor.

### Claim 18 (depends on 11)

The electronic system of claim 11, wherein the second camera comprises a second lens driver and a second lens, and
wherein the second lens driver is configured to move the second lens in response to a second control signal received from the second image processor.
