# US 2023/0276126 A1 · Imaging device, focus position setting method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0276126 A1
- Document ID: US20230276126A1
- Status: Published application
- Kind: A1
- Application number: 18/005,637
- Filed: 2021-07-02
- Published: 2023-08-31
- Earliest claimed: 2020-07-27
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: SEIICHI INOMATA; NA XU
- Web page: https://patentgrep.com/patent/US20230276126A1

## CPC

- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/675: {comprising setting of focusing regions}
- G02B 7/08: adapted to co-operate with a remote control mechanism
- G02B 7/28: Systems for automatic generation of focusing signals
- G03B 13/36: Autofocus systems
- G03B 15/02: Illuminating scene
- G03B 17/18: Signals indicating condition of a camera member or suitability of light (indicating depth of field G03B13/30)
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/50: Depth or shape recovery
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/635: {Region indicators; Field of view indicators}
- H04N 23/672: {based on the phase difference signals}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06T 2207/20221: Image fusion; Image merging
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An imaging device according to the present technology includes a user operation detection unit that detects an operation of a user for focus control, a focus position movement detection unit that detects movement of a focus position based on the operation of the user detected by the user operation detection unit, a depth information detection unit that detects depth information in a focus control target area, and a focus control unit that sets a target focus position on the basis of the movement of the focus position and the depth information. Thus, a technology for executing focus control more in accordance with a user's intention is proposed.

## Claims

### Claim 1

An imaging device, comprising:
a user operation detection unit that detects an operation of a user for focus control;
a focus position movement detection unit that detects movement of a focus position based on the operation of the user detected by the user operation detection unit;
a depth information detection unit that detects depth information in a focus control target area; and
a focus control unit that sets a target focus position on a basis of the movement of the focus position and the depth information.

### Claim 2 (depends on 1)

The imaging device according to claim 1, wherein
the focus position movement detection unit detects a moving direction of the focus position.

### Claim 3 (depends on 2)

The imaging device according to claim 2, wherein
the focus position movement detection unit detects the moving direction every predetermined time.

### Claim 4 (depends on 2)

The imaging device according to claim 2, wherein
the depth information detection unit detects depth information of an entirety of the focus control target area, and
the focus control unit sets the target focus position on a basis of the depth information of the entirety of the focus control target area, the moving direction of the focus position, and an end time focus position at a time of detecting that an operation of the user with respect to the movement of the focus position has ended.

### Claim 5 (depends on 4)

The imaging device according to claim 4, further comprising
an in-screen target position setting unit that sets an in-screen target position on a basis of the depth information, wherein
the focus control unit sets a focus position corresponding to the in-screen target position as the target focus position.

### Claim 6 (depends on 5)

The imaging device according to claim 5, wherein
in a case where the in-screen target position setting unit sets a plurality of the in-screen target positions, the focus control unit sets, as the target focus position, a focus position closest to the end time focus position among focus positions corresponding to the in-screen target positions.

### Claim 7 (depends on 5)

The imaging device according to claim 5, further comprising
a subject recognition unit that recognizes a subject, wherein
in a case of determining that the in-screen target position matches an in-screen subject position that is a position of the subject in a screen recognized by the subject recognition unit, the focus control unit sets a focus position corresponding to the in-screen subject position as the target focus position.

### Claim 8 (depends on 7)

The imaging device according to claim 7, wherein
in a case where the subject recognition unit has recognized a plurality of the subjects, the focus control unit sets, as the target focus position, a focus position closest to the end time focus position among focus positions corresponding to the in-screen subject position.

### Claim 9 (depends on 7)

The imaging device according to claim 7, wherein
the focus control unit performs tracking focus control for the subject focused according to the target focus position set after an end of the movement of the focus position.

### Claim 10 (depends on 1)

The imaging device according to claim 1, further comprising
an area setting unit that sets the focus control target area according to an operation of a user.

### Claim 11 (depends on 7)

The imaging device according to claim 7, further comprising
a display control unit that performs processing of superimposing and displaying a first frame image on a subject focused by the focus control unit among the subjects recognized by the subject recognition unit, and processing of superimposing and displaying a second frame image on other subjects.

### Claim 12 (depends on 1)

The imaging device according to claim 1, wherein
the focus control unit performs focus control according to a set focus moving speed.

### Claim 13 (depends on 2)

The imaging device according to claim 2, wherein
the user operation detection unit detects an operation of a user on a focus ring, and
the focus position movement detection unit detects the moving direction of the focus position on a basis of an operation direction of the focus ring.

### Claim 14 (depends on 2)

The imaging device according to claim 2, wherein
the user operation detection unit detects a focus operation of the user by receiving operation information transmitted from an external operation device, and
the focus position movement detection unit detects the moving direction of the focus position on a basis of an operation direction of the focus operation.

### Claim 15 (depends on 13)

The imaging device according to claim 13, wherein
the focus control unit
is capable of switching between a first mode in which autofocus control on a subject is performed and a second mode in which manual focus control is performed, and
switches to the second mode in a case where the user operation detection unit detects an operation on the focus ring in the first mode.

### Claim 16 (depends on 13)

The imaging device according to claim 13, wherein
the user operation detection unit determines that an end of the movement of the focus position is detected in a case where a state in which an operation on the focus ring is detected as the operation of the user is changed to a state in which the operation is not detected.

### Claim 17 (depends on 5)

The imaging device according to claim 5, wherein
the focus control unit
is capable of executing a first control of setting a focus position closest to the end time focus position among focus positions corresponding to the in-screen target position as the target focus position, and a second control of setting the target focus position according to the focus position and the moving direction at an end time point of the movement, and
switches from the first control to the second control in a case where a deviation between the closest focus position and the end time focus position is equal to or more than a predetermined threshold.

### Claim 18

A focus position setting method, comprising:
detecting an operation of a user for focus control;
detecting movement of a focus position based on the operation of the user detected;
detecting depth information in a focus control target area; and
setting a target focus position on a basis of the movement of the focus position and the depth information.

### Claim 19

A program for causing an imaging device to execute:
processing of detecting an operation of a user for focus control;
processing of detecting movement of a focus position based on the operation of the user detected;
processing of detecting depth information in a focus control target area; and
processing of setting a target focus position on a basis of the movement of the focus position and the depth information.
