# US 2024/0003680 A1 · Depth map construction by camera phase detection and lens calibration

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0003680 A1
- Document ID: US20240003680A1
- Status: Published application
- Kind: A1
- Application number: 17/855,108
- Filed: 2022-06-30
- Published: 2024-01-04
- Earliest claimed: 2022-06-30
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: Wei-Chih Hung; Po-Min Wang; Yu-Huai Chen
- Web page: https://patentgrep.com/patent/US20240003680A1

## CPC

- G01B 11/22: for measuring depth
- G06T 7/571: from focus
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Techniques for generating a depth map are described. The techniques include obtaining a set of phase difference measurements with a phase detect sensor, and generating a depth map based on the set of phase difference measurements, utilizing a first set of calibration data correlating phase difference measurements with lens defocus data and a second set of calibration data correlating lens positions with object distances.

## Claims

### Claim 1

A processing device, comprising:
a phase detect sensor; and
a processing unit configured to:
obtain a set of phase difference measurements with the phase detect sensor, and
generate a depth map based on the set of phase difference measurements, utilizing a first set of calibration data correlating phase difference measurements with lens defocus data and a second set of calibration data correlating lens positions with object distances.

### Claim 2 (depends on 1)

The processing device of claim 1, wherein:
the set of phase difference measurements includes a phase difference measurement for each of a set of phase detect sites.

### Claim 3 (depends on 2)

The processing device of claim 2, wherein the phase difference measurement corresponds to a displacement between a first image taken with a first separating feature and a second image taken with a second separating feature.

### Claim 4 (depends on 1)

The processing device of claim 1, wherein generating the depth map comprises:
determining, based on the set of phase difference measurements, and the first set of calibration data, a set of lens defocus data.

### Claim 5 (depends on 4)

The processing device of claim 4, wherein generating the depth map further comprises:
determining, based on the set of lens defocus data and an actual lens position, a set of in-focus lens positions.

### Claim 6 (depends on 5)

The processing device of claim 5, wherein generating the depth map further comprises:
determining, based on the set of in-focus lens positions and the second set of calibration data, distance data that comprises the depth map.

### Claim 7 (depends on 1)

The processing device of claim 1, wherein the depth map includes an object distance corresponding to each of a set of phase detect sites.

### Claim 8 (depends on 1)

The processing device of claim 1, wherein obtaining the set of phase difference measurements includes capturing an image.

### Claim 9 (depends on 1)

The processing device of claim 1, wherein the phase detect sensor is integrated within an image sensor.

### Claim 10

A method, comprising:
obtaining a set of phase difference measurements with the phase detect sensor, and
generate a depth map based on the set of phase difference measurements, utilizing a first set of calibration data correlating phase difference measurements with lens defocus data and a second set of calibration data correlating lens positions with object distances.

### Claim 11 (depends on 10)

The method of claim 10, wherein:
the set of phase difference measurements includes a phase difference measurement for each of a set of phase detect sites.

### Claim 12 (depends on 11)

The method of claim 11, wherein the phase difference measurement corresponds to a displacement between a first image taken with a first separating feature and a second image taken with a second separating feature.

### Claim 13 (depends on 10)

The method of claim 10, wherein generating the depth map comprises:
determining, based on the set of phase difference measurements, and the first set of calibration data, a set of lens defocus data.

### Claim 14 (depends on 13)

The method of claim 13, wherein generating the depth map further comprises:
determining, based on the set of lens defocus data and an actual lens position, a set of in-focus lens positions.

### Claim 15 (depends on 14)

The method of claim 14, wherein generating the depth map further comprises:
determining, based on the set of in-focus lens positions and the second set of calibration data, distance data that comprises the depth map.

### Claim 16 (depends on 10)

The method of claim 10, wherein the depth map includes an object distance corresponding to each of a set of phase detect sites.

### Claim 17 (depends on 10)

The method of claim 10, wherein obtaining the set of phase difference measurements includes capturing an image.

### Claim 18 (depends on 10)

The method of claim 10, wherein the phase detect sensor is integrated within an image sensor.

### Claim 19

A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
obtaining a set of phase difference measurements with the phase detect sensor, and
generate a depth map based on the set of phase difference measurements, utilizing a first set of calibration data correlating phase difference measurements with lens defocus data and a second set of calibration data correlating lens positions with object distances.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein:
the set of phase difference measurements includes a phase difference measurement for each of a set of phase detect sites.
