# US 2021/0281790 A1 · Camera system with complementary pixlet structure

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0281790 A1
- Document ID: US20210281790A1
- Status: Published application
- Kind: A1
- Application number: 17/088,893
- Filed: 2020-11-04
- Published: 2021-09-09
- Earliest claimed: 2020-03-06
- Assignees: Dexelion Inc.
- Applicants: Dexelion Inc.
- Inventors: Chong Min KYUNG; Hyun Sang PARK; Seung Hyuk CHANG; Jong Ho PARK; Sang Jin LEE
- Web page: https://patentgrep.com/patent/US20210281790A1

## CPC

- H04N 13/218: using spatial multiplexing
- H04N 25/79: Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors
- H04N 13/257: Colour aspects
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- H04N 25/133: including elements passing panchromatic light, e.g. filters passing white light
- H04N 25/705: Pixels for depth measurement, e.g. RGBZ
- H04N 25/77: Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A camera system with a complementary pixlet structure and a method of operating the same are provided. The camera system includes an image sensor that includes at least one 2×2 pixel block including a first pixel, a second pixel, and two third pixels—the two third pixels are disposed at positions diagonal to each other in the 2×2 pixel block and include deflected small pixlets, which are deflected in opposite directions to be symmetrical to each other with respect to each pixel center, and large pixlets adjacent to the deflected small pixlets, respectively, and each pixlet includes an photodiode converting an optical signal to an electrical signal and a depth calculator that receives images acquired from the deflected small pixlets of the two third pixels and calculates a depth between the image sensor and an object using a parallax between the images.

## Claims

### Claim 1

A camera system with a complementary pixlet structure, the camera system comprising:
an image sensor configured to include at least one 2×2 pixel block including a first pixel, a second pixel, and two third pixels—the two third pixels are disposed at positions diagonal to each other in the 2×2 pixel block and include deflected small pixlets, which are deflected in opposite directions to be symmetrical to each other with respect to each pixel center, and large pixlets adjacent to the deflected small pixlets, respectively, and each pixlet includes an photodiode converting an optical signal to an electrical signal; and
a depth calculator configured to receive images acquired from the deflected small pixlets of the two third pixels and calculate a depth between the image sensor and an object using a parallax between the images,
wherein, when the first pixel is the “R” pixel, the second pixel is the “Y” pixel, and each of the two third pixels is the “W” pixel,
the image sensor,
uses the optical signal of a wavelength processed in the first pixel and the optical signal of a wavelength processed in the second pixel to generate an image based on the “G” optical signal, and
uses the optical signals of wavelengths processed in the two third pixels and the optical signal of the wavelength processed in the second pixel to generate an image based on the “B” optical signal.

### Claim 2 (depends on 1)

The camera system of claim 1, wherein the deflected small pixlets of the two third pixels are disposed to maximize a distance apart from each other, within the two third pixels, respectively.

### Claim 3 (depends on 2)

The camera system of claim 2, wherein the deflected small pixlet of one of the two third pixels is a left-deflected small pixlet deflected in a left direction with respect to the pixel center of the one third pixel, and
wherein the deflected small pixlet of the other third pixel is a right-deflected small pixlet deflected in a right direction with respect to the pixel center of the other third pixel.

### Claim 4 (depends on 1)

The camera system of claim 1, wherein each of the two third pixels is one of a “W” pixel processing a white “W” optical signal or a “G” pixel processing a green “G” optical signal.

### Claim 5

A camera system with a complementary pixlet structure, the camera system comprising:
an image sensor configured to include at least one 2×2 pixel block including a first pixel, a second pixel, and two third pixels—the two third pixels are disposed at positions diagonal to each other in the 2×2 pixel block and include deflected small pixlets, which are deflected in opposite directions to be symmetrical to each other with respect to each pixel center, and large pixlets adjacent to the deflected small pixlets, respectively, and each pixlet includes an photodiode converting an optical signal to an electrical signal; and
a depth calculator configured to receive images acquired from the deflected small pixlets of the two third pixels and calculate a depth between the image sensor and an object using a parallax between the images,
wherein each of the deflected small pixlets of each of the two third pixels processes a “W” optical signal having a wavelength different from a “G” optical signal processed by each of the large pixlets of each of the two third pixels.

### Claim at position 6

6-7. (canceled)

### Claim 8

A camera system with a complementary pixlet structure, the camera system comprising:
an image sensor configured to include at least one 2×2 pixel block including a first pixel, a second pixel, and two third pixels—the two third pixels are disposed at positions diagonal to each other in the 2×2 pixel block and include deflected small pixlets, which are deflected in opposite directions to be symmetrical to each other with respect to each pixel center, and large pixlets adjacent to the deflected small pixlets, respectively, and each pixlet includes an photodiode converting an optical signal to an electrical signal; and
a depth calculator configured to receive images acquired from the deflected small pixlets of the two third pixels and calculate a depth between the image sensor and an object using a parallax between the images,
wherein, when the first pixel is the “G” pixel, the second pixel is the “Y” pixel, and each of the two third pixels is the “W” pixel,
the image sensor,
uses the optical signal of a wavelength processed in the first pixel and the optical signal of a wavelength processed in the second pixel to generate an image based on the “R” optical signal, and
uses the optical signals of wavelengths processed in the two third pixels and the optical signal of the wavelength processed in the second pixel to generate an image based on the “B” optical signal.

### Claim at position 8

9-12. (canceled)
