# US 12,015,845 B2 · Object depth estimation and camera focusing techniques for multiple-camera systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,015,845 B2
- Document ID: US12015845B2
- Status: Granted
- Kind: B2
- Application number: 17/479,584
- Filed: 2021-09-20
- Published: 2023-03-16
- Granted: 2024-06-18
- Earliest claimed: 2021-09-13
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Abhishek Dhanda; Gregory Guyomarc'h; Mark N. Gamadia
- Web page: https://patentgrep.com/patent/US12015845B2

## CPC

- H04N 23/675: {comprising setting of focusing regions}
- G02B 5/287: {comprising at least one layer of organic material}
- G02B 7/285: {including two or more different focus detection devices, e.g. both an active and a passive focus detecting device}
- G02B 7/40: using time delay of the reflected waves, e.g. of ultrasonic waves
- G03B 13/36: Autofocus systems
- G03B 19/22: Double cameras
- G03B 30/00: Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
- H04N 23/51: Housings
- H04N 23/662: {by using camera arrangements where one camera controls another camera to affect the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image}
- H04N 23/67: Focus control based on electronic image sensor signals
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 23/959: by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

Various embodiments disclosed herein include techniques for operating a multiple camera system. In some embodiments, a primary camera may be selected from a plurality of cameras using object distance estimates, distance error information, and minimum object distances for some or all of the plurality of cameras. In other embodiments, a camera may be configured to use defocus information to obtain an object distance estimate to a target object closer than a minimum object distance of the camera. This object distance estimate may be used to assist in focusing another camera of the multi-camera system.

## Claims

### Claim 1

A device comprising:
a multi-camera system including:
a first camera configured with autofocus capabilities and having a first minimum object distance; and
a second camera configured with autofocus capabilities and having a second minimum object distance; and
a focus control logic configured to:
cause the second camera to measure defocus information for a target object at a predetermined focus position, the target object being closer than the second minimum object distance;
determine an extrapolated focus position using the defocus information; and
cause the first camera to focus on the target object based at least in part on the extrapolated focus position.

### Claim 2 (depends on 1)

The device of claim 1, wherein the predetermined focus position corresponds to the minimum object distance of the second camera.

### Claim 3 (depends on 1)

The device of claim 1, wherein the focus control logic causes the first camera to lock to the predetermined focus position when one or more predetermined locking criteria is met.

### Claim 4 (depends on 3)

The device of claim 3, wherein the multi-camera system further comprises a depth sensor, and wherein the one or more predetermined criteria comprises an object distance estimate for the target object being less than a threshold locking distance.

### Claim 5 (depends on 1)

The device of claim 1, wherein the first minimum object distance is less than the second minimum object distance.

### Claim 6 (depends on 1)

The device of claim 1, further comprising a camera selection logic configured to select either the first camera or the second camera as a primary camera, and wherein the focus control logic is further configured cause the second camera to measure the defocus information for the target object at the predetermined focus position when first camera is selected as the primary camera.

### Claim 7 (depends on 1)

The device of claim 1, wherein causing the first camera to focus on the target object based at least in part on the extrapolated focus position comprises setting a target focus position for the first camera based on a predetermined relationship between the extrapolated focus position when confidence information associated with the extrapolated focus position meets a first predetermined criteria.

### Claim 8

A method for focusing a first camera of a multi-camera system using a second camera of the multi-camera system comprising:
measuring defocus information for a target object using the second camera at a predetermined focus position, the target object being closer than a second minimum object distance of the second camera,
determining an extrapolated focus position using the defocus information, and
causing the first camera to focus on the target object based at least in part on the extrapolated focus position.

### Claim 9 (depends on 8)

The method of claim 8, wherein the predetermined focus position corresponds to a minimum object distance of the second camera.

### Claim 10 (depends on 8)

The method of claim 8, further comprising locking the first camera to the predetermined focus position when one or more predetermined locking criteria is met.

### Claim 11 (depends on 10)

The method of claim 10, further comprising calculating an object distance estimate for the target object using a depth sensor of the multi-camera system, and comparing the object distance estimate to a threshold locking distance, wherein the predetermined locking criteria is met when the object distance estimate is less than the threshold locking distance.

### Claim 12 (depends on 8)

The method of claim 8 wherein measuring defocus information for the target object using the first camera at the predetermined focus position comprises measuring defocus information while the first camera is selected as a primary camera.

### Claim 13 (depends on 8)

The method of claim 8, wherein causing the first camera to focus on the target object based at least in part on the extrapolated focus position comprises setting a target focus position for the first camera based on a predetermined relationship between the extrapolated focus position when confidence information associated with the extrapolated focus position meets a first predetermined criteria.

### Claim 14 (depends on 13)

The method of claim 13, wherein causing the first camera to focus on the target object based at least in part on the extrapolated focus position comprises performing a partial scan based on the extrapolated focus position when confidence information associated with the extrapolated focus position does not meet a first predetermined criteria.

### Claim 15

A method of calculating an object distance estimate to a target object using a multi-camera system comprising a first camera and a second camera comprising:
determining whether the second camera is being maintained at a predetermined focus position;
measuring, in response to determining that the second camera is being maintained at the predetermined focus position, defocus information for the target object while the second camera is maintained at the predetermined focus position and the target object is closer than a second minimum object distance of the second camera; and
calculating the object distance estimate using the defocus information and the predetermined focus position.

### Claim 16 (depends on 15)

The method of claim 15, wherein determining whether the second camera is being maintained at the predetermined focus position comprises determining that the second camera is locked to the predetermined focus position.

### Claim 17 (depends on 15)

The method of claim 15, wherein the predetermined focus position is a macro focus position for the second camera, and wherein determining whether the second camera is being maintained at a predetermined focus position comprises determining that the target object is closer than a minimum object distance of the second camera.

### Claim 18 (depends on 15)

The method of claim 15, further comprising calculating an extrapolated focus position for the second camera using the object distance estimate.

### Claim 19 (depends on 18)

The method of claim 18, further comprising focusing the first camera based at least in part on the extrapolated focus position for the second camera.

### Claim 20 (depends on 19)

The method of claim 19, wherein focusing the first camera based at least in part on the extrapolated focus position comprises selecting a target focus position for the first camera based on a predefined relationship between focus positions of the second camera and focus positions of the first camera.