# US 2026/0129292 A1 · Hybrid Auto-Focus System with Robust Macro Object Priority Focusing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0129292 A1
- Document ID: US20260129292A1
- Status: Published application
- Kind: A1
- Application number: 19/118,061
- Filed: 2023-10-02
- Published: 2026-05-07
- Earliest claimed: 2022-10-06
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Mark Gamadia; Minchieh Wang; Jae Soo Kim; Yang Yang; Ying Chen Lou
- Web page: https://patentgrep.com/patent/US20260129292A1

## CPC

- H04N 23/67: Focus control based on electronic image sensor signals
- H04N 23/671: {in combination with active ranging signals, e.g. using light or sound signals emitted toward objects}
- G02B 7/282: {Autofocusing of zoom lenses}
- G02B 7/285: {including two or more different focus detection devices, e.g. both an active and a passive focus detecting device}
- G02B 7/40: using time delay of the reflected waves, e.g. of ultrasonic waves
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/672: {based on the phase difference signals}
- H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/959: by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
- G02B 7/34: using different areas in a pupil plane
- G02B 7/36: using image sharpness techniques {, e.g. image processing techniques for generating autofocus signals (image data processing per se G06T; in cameras having a solid state image sensor H04N23/67)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

An example method includes displaying a zoomed preview of a scene captured by a camera system. The method includes determining a phase-detect auto-focus (PDAF) depth estimate and a time-of-flight (ToF) depth estimate for the scene. The method includes, based on a comparison of the PDAF and ToF depth estimates, determining whether a foreground object in the zoomed preview is in-focus for a ToF based AF mode. The method includes, based on a determination that the foreground object in the zoomed preview is in-focus for the ToF based AF mode, bypassing a PDAF mode and activating the ToF based AF mode to focus on the foreground object. The method includes displaying, based on the ToF based AF mode, the focused foreground object as part of the zoomed preview of the scene.

## Claims

### Claim 1

A computer-implemented method, comprising:
displaying, by a display screen of a camera system, a zoomed preview of a scene captured by the camera system;
determining a phase-detect autofocus (PDAF) depth estimate and a time-of-flight (ToF) depth estimate for the scene;
based on a comparison of the PDAF depth estimate and the ToF depth estimate, determining whether a foreground object in the zoomed preview is in-focus for a ToF based AF mode of the camera system;
based on a determination that the foreground object in the zoomed preview is in-focus for the ToF based AF mode, bypassing a PDAF mode and activating the ToF based AF mode to focus on the foreground object, wherein the PDAF mode comprises focusing of the camera system based on the PDAF depth estimate, and wherein the ToF based AF mode comprises focusing of the camera system based on the ToF depth estimate; and
displaying, by the display screen and based on the ToF based AF mode, the focused foreground object as part of the zoomed preview of the scene.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
based on a second comparison of a second PDAF depth estimate and a second ToF depth estimate, determining that a second foreground object in a second zoomed preview of the scene is not in-focus for the ToF based AF mode; and
based on the determination that the second foreground object in the second zoomed preview of the scene is not in-focus for the ToF based AF mode, maintaining the PDAF mode and not activating the ToF based AF mode, and
wherein the displaying comprises displaying the second zoomed preview based on the PDAF mode.

### Claim 3 (depends on 1)

The method of claim 1, wherein the comparison of the PDAF depth estimate and the ToF depth estimate comprises:
determining whether a delta depth estimate based on a difference between the PDAF depth estimate and the ToF depth estimate exceeds a depth threshold, and
wherein the determination that the foreground object in the zoomed preview is in-focus for the ToF based AF mode is based on a determination that the delta depth estimate exceeds the depth threshold.

### Claim 4 (depends on 1)

The method of claim 1, wherein the receiving of the PDAF depth estimate further comprises:
determining whether the PDAF depth estimate exceeds a PDAF confidence threshold, and
wherein the bypassing of the PDAF mode is based on the determination whether the PDAF depth estimate exceeds the PDAF confidence threshold.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
receiving a second PDAF depth estimate based on a second zoomed preview of the scene;
determining that the second PDAF depth estimate does not exceed the PDAF confidence threshold; and
maintaining the PDAF mode and not activating the ToF based AF mode, and
wherein the displaying comprises displaying the second zoomed preview based on the PDAF mode.

### Claim 6 (depends on 1)

The method of claim 1, wherein the receiving of the ToF depth estimate further comprises:
determining whether the ToF depth estimate exceeds a ToF confidence threshold, and
wherein the focusing of the camera system in the ToF based AF mode is based on the determination whether the ToF depth estimate exceeds the ToF confidence threshold.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
determining that the ToF depth estimate exceeds the ToF confidence threshold, and
wherein the focusing of the camera system in the ToF based AF mode is based on a distance-to-position mapping for the foreground object based on the ToF depth estimate.

### Claim 8 (depends on 6)

The method of claim 6, further comprising:
determining that the ToF depth estimate does not exceed the ToF confidence threshold, and
wherein the focusing of the camera system in the ToF based AF mode is based on a multi-grid contrast detection autofocus (CDAF) search based on the ToF depth estimate.

### Claim 9 (depends on 8)

The method of claim 8, wherein the multi-grid CDAF search is based on one or more of a spatial grid, one or more directions, or one or more spatial frequencies.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving a second ToF depth estimate based on a second zoomed preview of the scene;
determining that the second ToF depth estimate does not exceed a ToF confidence threshold; and
maintaining the PDAF mode and not activating the ToF based AF mode, and
wherein the displaying comprises displaying the second zoomed preview based on the PDAF mode.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
determining that the PDAF depth estimate exceeds a PDAF confidence threshold;
determining that the ToF depth estimate exceeds a ToF confidence threshold;
determining, based on the zoomed preview of the scene, whether a brightness intensity of a background exceeds a brightness threshold, and
wherein the bypassing of the PDAF mode is based on the determination whether the brightness intensity of the background exceeds the brightness threshold.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
determining that the brightness intensity of the background exceeds the brightness threshold; and
bypassing the PDAF mode and activating the ToF based AF mode.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
determining that a second brightness intensity of a second background in a second zoomed preview does not exceed the brightness threshold; and
maintaining the PDAF mode and not activating the ToF based AF mode, and
wherein the displaying comprises displaying the second zoomed preview based on the PDAF mode.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
receiving, by a user interface of the display screen, an indication to disable the ToF based AF mode; and
responsive to the indication, maintaining the PDAF mode and not activating the ToF based AF mode, and
wherein the displaying comprises displaying a second zoomed preview based on the PDAF mode.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
displaying, by the display screen, an initial preview of the scene being captured by another camera system;
detecting a zoom operation that causes a transition from the second camera system to the camera system; and
providing, by a user interface of the display screen, a selectable virtual object to receive an indication whether to enable or disable the ToF based AF mode.

### Claim 16 (depends on 15)

The method of claim 15, wherein the camera system is configured to provide an ultrawide field of view (FOV), and wherein the other camera system is configured to provide a wide FOV.

### Claim 17 (depends on 1)

The method of claim 1, wherein the focusing of the camera system comprises adjusting at least one lens of the camera system.

### Claim 18 (depends on 1)

The method of claim 1, wherein the focusing of the camera system comprises determining an exposure time for the camera system based on a motion-blur tolerance of the camera system.

### Claim 19 (depends on 1)

The method of claim 1, wherein the camera system is a component of a mobile device.

### Claim 20

A computing device, comprising:
a display screen;
a camera system configured to operate at a focal length less than a threshold focal length;
one or more processors; and
data storage, wherein the data storage has stored thereon computer-executable instructions that, when executed by the one or more processors, cause the mobile device to carry out functions comprising:
displaying, by a display screen of the camera system, a zoomed preview of a scene captured by the camera system;
determining a phase-detect autofocus (PDAF) depth estimate and a time-of-flight (ToF) depth estimate for the scene;
based on a comparison of the PDAF depth estimate and the ToF depth estimate, determining whether a foreground object in the zoomed preview is in-focus for a ToF based AF mode of the camera system;
based on a determination that the foreground object in the zoomed preview is in-focus for the ToF based AF mode, bypassing a PDAF mode and activating the ToF based AF mode to focus on the foreground object, wherein the PDAF mode comprises focusing of the camera system based on the PDAF depth estimate, and wherein the ToF based AF mode comprises focusing of the camera system based on the ToF depth estimate; and
displaying, by the display screen and based on the ToF based AF mode, the focused foreground object as part of the zoomed preview of the scene.

### Claim 21

A non-transitory computer-readable medium comprising program instructions executable by one or more processors to cause the one or more processors to perform operations comprising:
displaying, by a display screen of a camera system, a zoomed preview of a scene captured by the camera system;
determining a phase-detect autofocus (PDAF) depth estimate and a time-of-flight (ToF) depth estimate for the scene;
based on a comparison of the PDAF depth estimate and the ToF depth estimate, determining whether a foreground object in the zoomed preview is in-focus for a ToF based AF mode of the camera system;
based on a determination that the foreground object in the zoomed preview is in-focus for the ToF based AF mode, bypassing a PDAF mode and activating the ToF based AF mode to focus on the foreground object, wherein the PDAF mode comprises focusing of the camera system based on the PDAF depth estimate, and wherein the ToF based AF mode comprises focusing of the camera system based on the ToF depth estimate; and
displaying, by the display screen and based on the ToF based AF mode, the focused foreground object as part of the zoomed preview of the scene.
