# US 2025/0097591 A1 · Photographing device and control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097591 A1
- Document ID: US20250097591A1
- Status: Published application
- Kind: A1
- Application number: 18/289,988
- Filed: 2022-07-21
- Published: 2025-03-20
- Earliest claimed: 2022-07-21
- Assignees: Beijing Xiaomi Mobile Software Co., Ltd.
- Applicants: Beijing Xiaomi Mobile Software Co., Ltd.
- Inventors: Yuichiro YAMASHITA; Atsushi KOBAYASHI
- Web page: https://patentgrep.com/patent/US20250097591A1

## CPC

- H04N 23/958: for extended depth of field imaging
- G02B 27/0075: {with means for altering, e.g. increasing, the depth of field or depth of focus}
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N 23/957: Light-field or plenoptic cameras or camera modules
- H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H10F 39/8063: {Microlenses}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION

## Abstract

A photographing device includes: a plurality of microlenses; a photographing element having a plurality of pixels arranged on the plurality of microlenses and configured to receive light from the plurality of microlenses; and a processor configured to generate an image based on the light received at the plurality of pixels. The plurality of pixels each have a first part including a central part and a second part surrounding the central part. The image includes a first image based on the light received at the first part and a second image based on the light received at the second part. The processor is configured to synthesize the first image based on the light received at the first part with the second image based on the light received at the second part, when a specified condition is met.

## Claims

### Claim 1

A photographing device, comprising:
a plurality of microlenses;
a photographing element having a plurality of pixels arranged on the plurality of microlenses and configured to receive light from the plurality of microlenses; and
a processor configured to generate an image based on the light received at the plurality of pixels,
wherein the plurality of pixels each have a first part comprising a central part and a second part surrounding the central part, and the image comprises a first image based on the light received at the first part and a second image based on the light received at the second part,
the processor is configured to synthesize the first image based on the light received at the first part with the second image based on the light received at the second part, when a specified condition is met.

### Claim 2 (depends on 1)

The photographing device according to claim 1, wherein,
the processor is configured to synthesize the first image with the second image by using information related to the second image, when the specified condition is met.

### Claim 3 (depends on 1)

The photographing device according to claim 1, wherein,
the specified condition comprises a condition regarding at least one of a depth of field or a sensitivity to light related to the first image.

### Claim 4 (depends on 1)

The photographing device according to claim 1, wherein,
the plurality of pixels have a one-to-one correspondence with the plurality of microlenses;
a first optical path length from a light exit surface of each of the plurality of microlenses to a first light incident surface of the first part of a corresponding pixel is different from a second optical path length from the exit surface of each of the plurality of microlenses to a second light incident surface of the second part of the corresponding pixel.

### Claim 5 (depends on 4)

The photographing device according to claim 4, further comprising:
a convex lens arranged between the exit surface of each of the plurality of microlenses and the first incident surface of the first part of the corresponding pixel as well as the second incident surface of the second part of the corresponding pixel.

### Claim 6 (depends on 4)

The photographing device according to claim 4, wherein,
a first distance from the exit surface of each of the plurality of microlenses to the first incident surface of the first part of the corresponding pixel is different from a second distance from the exit surface of each of the plurality of microlenses to the second incident surface of the second part of the corresponding pixel.

### Claim 7

A control method, executed by a processor comprised in a photographing device, and comprising:
a generation step, wherein an image is generated based on light received by a plurality of pixels arranged on a plurality of microlenses comprised in the photographing device and from the plurality of microlenses,
the plurality of pixels each have a first part comprising a central part and a second part surrounding the central part, and the image comprises a first image based on the light received at the first part and a second image based on the light received at the second part,
the generation step comprises synthesizing the first image based on the light received at the first part with the second image based on the light received at the second part, when a specified condition is met.

### Claim 8

(canceled)

### Claim 9 (depends on 7)

The control method according to claim 7, wherein the generation step further comprises:
synthesizing the first image with the second image by using information related to the second image, when the specified condition is met.

### Claim 10 (depends on 7)

The control method according to claim 7, wherein,
the specified condition comprises a condition regarding at least one of a depth of field or a sensitivity to light related to the first image.

### Claim 11 (depends on 7)

The control method according to claim 7, wherein,
the plurality of pixels have a one-to-one correspondence with the plurality of microlenses;
a first optical path length from a light exit surface of each of the plurality of microlenses to a first light incident surface of the first part of a corresponding pixel is different from a second optical path length from the exit surface of each of the plurality of microlenses to a second light incident surface of the second part of the corresponding pixel.

### Claim 12 (depends on 11)

The control method according to claim 11, wherein,
a first distance from the exit surface of each of the plurality of microlenses to the first incident surface of the first part of the corresponding pixel is different from a second distance from the exit surface of each of the plurality of microlenses to the second incident surface of the second part of the corresponding pixel.

### Claim 13

A terminal, comprising a photographing device, and the photographing device comprising:
a plurality of microlenses;
a photographing element having a plurality of pixels arranged on the plurality of microlenses and configured to receive light from the plurality of microlenses; and
a processor configured to generate an image based on the light received at the plurality of pixels,
wherein the plurality of pixels each have a first part comprising a central part and a second part surrounding the central part, and the image comprises a first image based on the light received at the first part and a second image based on the light received at the second part,
the processor is configured to synthesize the first image based on the light received at the first part with the second image based on the light received at the second part, when a specified condition is met.

### Claim 14 (depends on 13)

The terminal according to claim 13, wherein,
the processor is configured to synthesize the first image with the second image by using information related to the second image, when the specified condition is met.

### Claim 15 (depends on 13)

The terminal according to claim 13, wherein,
the specified condition comprises a condition regarding at least one of a depth of field or a sensitivity to light related to the first image.

### Claim 16 (depends on 13)

The terminal according to claim 13, wherein,
the plurality of pixels have a one-to-one correspondence with the plurality of microlenses;
a first optical path length from a light exit surface of each of the plurality of microlenses to a first light incident surface of the first part of a corresponding pixel is different from a second optical path length from the exit surface of each of the plurality of microlenses to a second light incident surface of the second part of the corresponding pixel.

### Claim 17 (depends on 16)

The terminal according to claim 16, further comprising:
a convex lens arranged between the exit surface of each of the plurality of microlenses and the first incident surface of the first part of the corresponding pixel as well as the second incident surface of the second part of the corresponding pixel.

### Claim 18 (depends on 16)

The terminal according to claim 16, wherein,
a first distance from the exit surface of each of the plurality of microlenses to the first incident surface of the first part of the corresponding pixel is different from a second distance from the exit surface of each of the plurality of microlenses to the second incident surface of the second part of the corresponding pixel.
