# US 2021/0176447 A1 · Determining Depth Information From A Single Camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176447 A1
- Document ID: US20210176447A1
- Status: Published application
- Kind: A1
- Application number: 17/113,011
- Filed: 2020-12-05
- Published: 2021-06-10
- Earliest claimed: 2019-12-06
- Assignees: OmniVision Technologies, Inc.
- Applicants: OmniVision Technologies, Inc.
- Inventors: Richard Mann; Badrinath Padmanabhan; Boyd Fowler; Alireza Bonakdar; Eiichi Funatsu
- Web page: https://patentgrep.com/patent/US20210176447A1

## CPC

- H04N 13/218: using spatial multiplexing
- G06T 7/571: from focus
- G06T 7/593: from stereo images
- H04N 13/257: Colour aspects
- H04N 23/672: {based on the phase difference signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An optical system comprises an imaging lens for imaging an object to an image and a sensing pixel array for detecting lights from the object toward the image. The sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a one-dimensional series of photodiodes having n photodiodes. A photodiode at an end of the one-dimensional series of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite end of the one-dimensional series of photodiodes of the second sensing pixel detects a second light from the object toward the image, where the first light and the second light pass opposite parts of the imaging lens.

## Claims

### Claim 1

An optical system comprising,
an imaging lens for imaging an object to an image; and
a sensing pixel array for detecting lights from the object, wherein each light passes different part of the imaging lens toward the image;
wherein the sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a one-dimensional series of photodiodes having n photodiodes, n is integer larger than two;
wherein a photodiode at an end of the one-dimensional series of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite end of the one-dimensional series of photodiodes of the second sensing pixel detects a second light from the object toward the image;
wherein the first light and the second light pass opposite parts of the imaging lens; and
wherein positions of the first sensing pixel and the second sensing pixel are used to determine a distance of the object to the imaging lens.

### Claim 2 (depends on 1)

The optical system of claim 1, wherein each of the first and second sensing pixels comprises the microlens covering a two-dimensional array of photodiodes having n×n photodiodes, n is integer larger than two, and wherein the two-dimensional array of photodiodes having n×n photodiodes includes the one-dimensional series of photodiodes having n photodiodes.

### Claim 3 (depends on 1)

The optical system of claim 1, wherein positions of the first sensing pixel and the second sensing pixel are determined by a correlation of a right image and a left image, wherein the right image comprises the first light detected by the photodiode at the end of the one-dimensional series of photodiodes of the first sensing pixel, and the left image comprises the second light detected by the photodiode at the opposite end of the one-dimensional series of photodiodes of the second sensing pixel.

### Claim 4 (depends on 1)

The optical system of claim 1, wherein n is 3.

### Claim 5 (depends on 1)

The optical system of claim 1, wherein photodiodes of the one-dimensional series of photodiodes having n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the one-dimensional series of photodiodes having n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

### Claim 6 (depends on 1)

The optical system of claim 1, wherein photodiodes of the one-dimensional series of photodiodes having n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the one-dimensional series of photodiodes having n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

### Claim 7 (depends on 2)

The optical system of claim 2, wherein photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

### Claim 8 (depends on 2)

The optical system of claim 2, wherein photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

### Claim 9

An optical system comprising,
an imaging lens for imaging an object to an image;
a sensing pixel array for detecting lights from the object passing the imaging lens toward the image; and
a mask at an optical axis of the optical system blocking lights from the object passing central part of the imaging lens toward the image;
wherein the sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a pair of photodiodes;
wherein a photodiode at a side of the pair of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite side of the pair of photodiodes of the second sensing pixel detects a second light from the object toward the image;
wherein the first light and the second light pass opposite parts of the imaging lens; and
wherein positions of the first sensing pixel and the second sensing pixel are used to determine a distance of the object to the imaging lens.

### Claim 10 (depends on 9)

The optical system of claim 9, wherein each of the first and second sensing pixels comprises the microlens covering a two-dimensional array of photodiodes having 2×2 photodiodes, and wherein the two-dimensional array of photodiodes having 2×2 photodiodes includes the pair of photodiodes.

### Claim 11 (depends on 9)

The optical system of claim 9, wherein positions of the first sensing pixel and the second sensing pixel are determined by a correlation of a right image and a left image, wherein the right image comprises the first light detected by the photodiode at a side of the pair of photodiodes of the first sensing pixel, and the left image comprises the second light detected by the photodiode at an opposite side of the pair of photodiodes of the second sensing pixel.

### Claim 12 (depends on 9)

The optical system of claim 9, wherein photodiodes of the pair of photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the pair of photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

### Claim 13 (depends on 9)

The optical system of claim 9, wherein photodiodes of the pair of photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the pair of photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

### Claim 14 (depends on 10)

The optical system of claim 10, wherein photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

### Claim 15 (depends on 10)

The optical system of claim 10 wherein photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

### Claim 16 (depends on 9)

The optical system of claim 9, wherein the mask is removable.

### Claim 17 (depends on 9)

The optical system of claim 9, wherein the mask is a circular mask.

### Claim 18 (depends on 9)

The optical system of claim 9, wherein the mask is a cross shape mask.

### Claim 19 (depends on 9)

The optical system of claim 9, wherein the mask is a liquid crystal switch blocking lights from the object passing central part of the imaging lens toward the image.

### Claim 20 (depends on 19)

The optical system of claim 19, wherein the liquid crystal switch has an opaque part of one of circular shape and cross shape.
