# US 2022/0294964 A1 · Low-light autofocus technique

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0294964 A1
- Document ID: US20220294964A1
- Status: Published application
- Kind: A1
- Application number: 17/754,179
- Filed: 2019-10-11
- Published: 2022-09-15
- Earliest claimed: 2019-10-11
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Ying Chen Lou; Leung Chun Chan; Kiran Murthy; Qiurui He; Szepo Robert Hung; Sushil Nath
- Web page: https://patentgrep.com/patent/US20220294964A1

## CPC

- G02B 7/36: using image sharpness techniques {, e.g. image processing techniques for generating autofocus signals (image data processing per se G06T; in cameras having a solid state image sensor H04N23/67)}
- H04N 23/73: by influencing the exposure time
- G02B 7/343: {using light beam separating prisms}
- G02B 13/001: {Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras (G02B23/243 takes precedence)}
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/672: {based on the phase difference signals}
- H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method}
- H04N 23/71: Circuitry for evaluating the brightness variation
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure relates to a low-light autofocus technique. One example embodiment includes a method. The method includes receiving an indication of a low-light condition for a camera system. The method also includes determining an extended exposure time for a low-light autofocus procedure of the camera system. Further, the method includes capturing, by the camera system, an extended frame for the low-light autofocus procedure. The extended frame is captured by die camera system using the determined extended exposure time. In addition, the method includes determining, based on the captured extended frame, an in-focus lens setting for a lens of the camera system.

## Claims

### Claim 1

A method comprising:
receiving an indication of a low-light condition for a camera system;
determining an extended exposure time for a low-light autofocus procedure of the camera system;
capturing, by the camera system, an extended frame for the low-light autofocus procedure, wherein the extended frame is captured by the camera system using the determined extended exposure time; and
determining, based on the captured extended frame, an in-focus lens setting for a lens of the camera system.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining an extended exposure time for a low-light autofocus procedure of the camera system is based on a motion-blur tolerance and the low-light condition.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
adjusting the lens based on the determined in-focus lens setting.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining a confidence level for the in-focus lens setting;
performing a comparison of the confidence level to a confidence threshold; and
adjusting the lens based on the comparison.

### Claim 5 (depends on 4)

The method of claim 4, wherein adjusting the lens based on the comparison comprises:
adjusting the lens to match the in-focus lens setting in response to the confidence level being greater than or equal to the confidence threshold.

### Claim 6 (depends on 4)

The method of claim 4, wherein adjusting the lens based on the comparison comprises:
adjusting the lens to a default lens setting in response to the confidence level being less than the confidence threshold.

### Claim 7 (depends on 6)

The method of claim 6, wherein the default lens setting provides a maximum focal length for the lens.

### Claim 8 (depends on 6)

The method of claim 6, wherein the default lens setting provides a focal length for the lens that corresponds to a hyperfocal distance of the camera system.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
capturing, by the camera system, a plurality of extended frames for the low-light autofocus procedure, wherein determining the in-focus lens setting for the lens of the camera system is based upon the plurality of captured extended frames.

### Claim 10 (depends on 3)

The method of claim 3, further comprising:
capturing, by the camera system using the adjusted lens, a second extended frame for the low-light autofocus procedure; and
determining, a second in-focus lens setting for the lens of the camera system based upon the second extended frame.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
adjusting the lens based upon at least of one the following: the second in-focus lens setting, a confidence level associated with the second in-focus lens setting, and a confidence level associated with the in-focus lens setting determined prior to the second in-focus lens setting.

### Claim 12 (depends on 9)

The method of claim 9, wherein at least one of the extended frames is captured by the camera system using an exposure time different than the determined extended exposure time.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
capturing, by the camera system, a plurality of additional frames,
wherein each of the additional frames is captured by the camera system using a secondary exposure time, and
wherein the secondary exposure time is shorter than the determined extended exposure time;
aligning the additional frames such that similar objects in the additional frames are in similar pixel locations within each of the additional frames; and
forming a composite image based on the additional frames.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
enhancing the composite image using a fast Fourier color constancy algorithm;
determining an optimized tone mapping for the composite image; and
modifying the composite image according to the optimized tone mapping.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
detecting the low-light condition for the camera system.

### Claim 16 (depends on 15)

The method of claim 15, wherein detecting the low-light condition for the camera system comprises:
comparing an ambient light intensity to a threshold low-light intensity.

### Claim 17 (depends on 16)

The method of claim 16, wherein the threshold low-light intensity is 1.0 lux.

### Claim 18 (depends on 1)

The method of claim 1, further comprising adjusting the lens to a pre-autofocus setting, wherein the pre-autofocus setting comprises a middle focal position for the lens.

### Claim 19 (depends on 1)

The method of claim 1, wherein the camera system is a component of a mobile device.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
receiving, via a user interface of the mobile device, an indication that a still image or video image is to be captured using the mobile device.

### Claim 21 (depends on 20)

The method of claim 20, further comprising:
displaying, on the user interface of the mobile device, an indication to a user to hold the mobile device still.

### Claim 22 (depends on 1)

The method of claim 1, wherein determining the extended exposure time further comprises:
determining the extended exposure time based on a total time over which the low-light autofocus procedure is to be performed and a number of frames to be captured during the low-light autofocus procedure.

### Claim 23 (depends on 22)

The method of claim 22,
wherein the camera system is part of a mobile device or a digital single-lens reflex (DSLR) camera, and
wherein the total time is based on a mode of operation of the camera system.

### Claim 24 (depends on 1)

The method of claim 1, wherein determining, based on the captured extended frame, the in-focus lens setting for the lens of the camera system comprises:
applying a phase-detection autofocus algorithm.

### Claim 25 (depends on 24)

The method of claim 24, further comprising:
capturing a plurality of frames, wherein the plurality of captured frames includes a first-captured frame and one or more subsequently captured frames captured after the first-captured frame; and
performing facial recognition on the first-captured frame to identify a region of interest in the first-captured frame and identifying corresponding regions of interest in the one or more subsequently captured frames,
wherein applying the phase-detection autofocus algorithm comprises using the phase-detection autofocus algorithm to determine the in-focus lens setting based on the corresponding regions of interest in the subsequently captured frames.

### Claim 26 (depends on 1)

The method of claim 1, wherein determining the extended exposure time further comprises:
determining the extended exposure time based on a tunable duration that represents an acceptable amount of time to dedicate to the low-light autofocus procedure.

### Claim 27 (depends on 2)

The method of claim 2, further comprising:
capturing, by the camera system and prior to determining the extended exposure time, a plurality of preview frames,
wherein the motion-blur tolerance is based on a center-weighted average of motion across the plurality of preview frames.

### Claim 28 (depends on 2)

The method of claim 2, further comprising:
determining the motion-blur tolerance based on a phase-detection autofocus algorithm.

### Claim 29

A non-transitory, computer-readable medium having instructions stored therein, wherein the instructions, when executed by a processor, perform a method comprising:
receiving an indication of a low-light condition for a camera system;
determining an extended exposure time for a low-light autofocus procedure of the camera system;
causing the camera system to capture an extended frame for the low-light autofocus procedure, wherein the extended frame is captured by the camera system using the determined extended exposure time; and
determining, based on the captured extended frame, an in-focus lens setting for a lens of the camera system.

### Claim 30

A mobile device comprising:
a camera system comprising:
an image sensor; and
a lens configured to modify light from an environment surrounding the mobile device prior to the light being detected by the image sensor; and
a controller, wherein the controller is configured to:
receive an indication of a low-light condition for the camera system;
determine an extended exposure time for a low-light autofocus procedure of the camera system;
cause the camera system to capture an extended frame for the low-light autofocus procedure, wherein the extended frame is captured by the camera system using the determined extended exposure time; and
determine, based on the captured extended frame, an in-focus lens setting for the lens.
