# US 2020/0404157 A1 · Display control device, camera device, and display control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404157 A1
- Document ID: US20200404157A1
- Status: Published application
- Kind: A1
- Application number: 17/014,758
- Filed: 2020-09-08
- Published: 2020-12-24
- Earliest claimed: 2018-03-22
- Assignees: Sz Dji Technology Co., Ltd.
- Applicants: Sz Dji Technology Co., Ltd.
- Inventors: Ming SHAO; Chihiro TSUKAMOTO; Hui XU
- Web page: https://patentgrep.com/patent/US20200404157A1

## CPC

- H04N 23/67: Focus control based on electronic image sensor signals
- G02B 7/28: Systems for automatic generation of focusing signals
- G02B 7/36: using image sharpness techniques {, e.g. image processing techniques for generating autofocus signals (image data processing per se G06T; in cameras having a solid state image sensor H04N23/67)}
- G03B 17/18: Signals indicating condition of a camera member or suitability of light (indicating depth of field G03B13/30)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/635: {Region indicators; Field of view indicators}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A display control device includes a processor and a computer-readable storage medium. The computer-readable storage medium stores a program that, when executed by the processor, causes the processor to determine a present lens position of a lens of a camera device, determine a target position of a target object being photographed by the camera device, and display a first indicator indicating the present lens position and a second indicator indicating the target position on a display in a position relationship corresponding to a relationship between the present lens position and the target position.

## Claims

### Claim 1

A display control device comprising:
a processor;
a computer-readable storage medium storing a program that, when executed by the processor, causes the processor to:
determine a present lens position of a lens of a camera device;
determine a target position of a target object being photographed by the camera device; and
display a first indicator indicating the present lens position and a second indicator indicating the target position on a display in a position relationship corresponding to a relationship between the present lens position and the target position.

### Claim 2 (depends on 1)

The device of claim 1, wherein the program further causes the processor to:
display the first indicator on the display in a manner that the first indicator moves along a direction relative to the second indicator according to a change of the present lens position.

### Claim 3 (depends on 2)

The device of claim 2, wherein the program further causes the processor to:
determine a range of the target position; and
display the second indicator on the display with a width in the direction corresponding to the range of the target position.

### Claim 4 (depends on 3)

The device of claim 3, wherein the program further causes the processor to:
determine the range of the target position according to the change of the present lens position.

### Claim 5 (depends on 3)

The device of claim 3, wherein:
the direction is a first direction; and
the program further causes the processor to:
determine a reliability of the target position; and
display the second indicator on the display with a width in a second direction corresponding to the reliability.

### Claim 6 (depends on 5)

The device of claim 5, wherein the program further causes the processor to:
determine the reliability of the target position according to the change of the present lens position.

### Claim 7 (depends on 5)

The device of claim 5, wherein the program further causes the processor to:
determine the reliability of the target position based on a cost of the target object in an image photographed by the camera device.

### Claim 8 (depends on 3)

The device of claim 3, wherein the program further causes the processor to:
determine a reliability of the target position; and
display the first indicator or the second indicator on the display with a size corresponding to the reliability.

### Claim 9 (depends on 8)

The device of claim 8, wherein the program further causes the processor to:
determine the reliability of the target position according to the change of the present lens position.

### Claim 10 (depends on 8)

The device of claim 8, wherein the program further causes the processor to:
determine the reliability of the target position based on a cost of the target object in an image photographed by the camera device.

### Claim 11 (depends on 10)

The device of claim 10, wherein the target object is selected in the image photographed by the camera device.

### Claim 12 (depends on 10)

The device of claim 10, wherein the target object is included in a predetermined region in the image photographed by the camera device.

### Claim 13 (depends on 1)

The device of claim 1, wherein the program further causes the processor to:
display the first indicator and the second indicator on the display with an interval corresponding to a difference between the present lens position and an ideal lens position corresponding to the lens being focused on the target position.

### Claim 14 (depends on 13)

The device of claim 13, wherein the program further causes the processor to:
display the first indicator and the second indicator on the display in a manner that the first indicator moves relative to the second indicator according to a change of the difference.

### Claim 15 (depends on 1)

The device of claim 1, wherein the program further causes the processor to:
obtain a first image photographed when an imaging plane of the camera device and the lens are in a first position relationship;
obtain a second image photographed when the imaging plane and the lens are in a second position relationship;
calculate a cost of the first image and a cost of the second image; and
predict the target position based on the cost of the first image and the cost of the second image.

### Claim 16 (depends on 15)

The device of claim 15, wherein the cost of first image and the cost of the second image are associated with blurry of an image.

### Claim 17 (depends on 15)

The device of claim 15, wherein the program further causes the processor to:
calculate the cost of first image and the cost of the second image based on a point spread function.

### Claim 18 (depends on 1)

The device of claim 1, wherein:
the target object is one of a plurality of target objects being photographed by the camera device; and
the program further causes the processor to:
determine a plurality of target positions of the plurality of target objects; and
display a plurality of second indicators on the display to indicate the plurality of target positions in position relationships corresponding to relationships between the present lens position and the plurality of target positions.

### Claim 19 (depends on 1)

The device of claim 1, wherein the display is a smartphone.

### Claim 20

A camera device comprising:
a lens;
an image sensor configured to convert an optical image formed through the lens into an electrical signal;
a display; and
a display control device including:
a processor;
a computer-readable storage medium storing a program that, when executed by the processor, causes the processor to:
determine a present lens position of the lens;
determine a target position of a target object being photographed by the camera device; and
display a first indicator indicating the present lens position and a second indicator indicating the target position on a display in a position relationship corresponding to a relationship between the present lens position and the target position.
