# US 2021/0243339 A1 · Direction control device, direction control method and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243339 A1
- Document ID: US20210243339A1
- Status: Published application
- Kind: A1
- Application number: 17/236,394
- Filed: 2021-04-21
- Published: 2021-08-05
- Earliest claimed: 2014-12-03
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Shoji YACHIDA; Toshihiko HIROAKI
- Web page: https://patentgrep.com/patent/US20210243339A1

## CPC

- G06V 40/161: {Detection; Localisation; Normalisation}
- G03B 15/04: Combinations of cameras with non-electronic flash apparatus; Non-electronic flash units
- G03B 17/02: Bodies
- G06T 1/0014: {Image feed-back for automatic industrial control, e.g. robot with camera (robots B25J19/023)}
- G06T 7/74: {involving reference images or patches}
- G06V 10/245: {by locating a pattern; Special marks for positioning}
- H04N 5/222: Studio circuitry; Studio devices; Studio equipment (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00)
- H04N 23/61: based on recognised objects
- H04N 23/67: Focus control based on electronic image sensor signals
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/685: {performed by mechanical compensation}
- G06T 7/248: {involving reference images or patches}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A direction control device includes: a camera unit that acquires an image captured by photographing a subject by a camera targeted for adjustment of a photographing direction; an image-processing unit that calculates a position of a first setting image that represents the subject in the captured image; a posture detection unit that detects a difference between a position of a second setting image that represents the subject in a reference image registered in advance and the position of the first setting image; and a camera control unit that shifts the photographing direction of the camera based on the difference.

## Claims

### Claim 1

A control device comprising:
at least one memory configured to store instructions; and
at least one processor configured to execute the instructions to perform:
capturing, by a camera, an first image which display a predetermined marker;
calculating a first position of the predetermined marker in the first image;
calculating a capturing direction of the camera, based on an information extracted from the predetermined marker, the first position and a second position which is a position of the predetermined marker in a second image, wherein the second image is captured by the camera;
controlling to change the capturing direction of the camera, based on a calculation result.

### Claim 2 (depends on 1)

The control device according to the claim 1, wherein the processor configured to execute the instructions to perform:
detecting a difference between the first position and the second position.

### Claim 3 (depends on 2)

The control device according to the claim 2, wherein the processor configured to execute the instructions to perform:
acquiring the capturing direction of the camera in case the difference is absent.

### Claim 4 (depends on 1)

The control device according to the claim 1, wherein the processor configured to execute the instructions to perform:
detecting the predetermined marker in the first image;
extracting an information from the predetermined marker, wherein the extracted information includes an installation height of the predetermined marker and a size of the predetermined marker;
calculating the position of the predetermined marker in the first image, based on the extracted information.

### Claim 5

A controlling method, comprising:
capturing, by a camera, an first image which display a predetermined marker;
calculating a first position of the predetermined marker in the first image;
calculating a capturing direction of the camera, based on an information extracted from the predetermined marker, the first position and a second position which is a position of the predetermined marker in a second image, wherein the second image is captured by the camera;
controlling to change the capturing direction of the camera, based on a calculation result.

### Claim 6 (depends on 5)

The controlling method according to the claim 5, further comprising:
detecting a difference between the first position and the second position.

### Claim 7 (depends on 6)

The controlling method according to the claim 6, further comprising:
acquiring the capturing direction of the camera in case the difference is absent.

### Claim 8 (depends on 5)

The controlling method according to the claim 5, further comprising:
detecting the predetermined marker in the first image;
extracting an information from the predetermined marker, wherein the extracted information includes an installation height of the predetermined marker and a size of the predetermined marker;
calculating the position of the predetermined marker in the first image, based on the extracted information.

### Claim 9

A non-transitory computer readable medium storing instructions for causing a computer to execute:
capturing, by a camera, an first image which display a predetermined marker;
calculating a first position of the predetermined marker in the first image;
calculating a capturing direction of the camera, based on an information extracted from the predetermined marker, the first position and a second position which is a position of the predetermined marker in a second image, wherein the second image is captured by the camera;
controlling to change the capturing direction of the camera, based on a calculation result.

### Claim 10 (depends on 9)

The non-transitory computer readable medium according to the claim 9,
detecting a difference between the first position and the second position.

### Claim 11 (depends on 10)

The non-transitory computer readable medium according to the claim 10,
acquiring the capturing direction of the camera in case the difference is absent.

### Claim 12 (depends on 9)

The non-transitory computer readable medium according to the claim 9,
detecting the predetermined marker in the first image;
extracting an information from the predetermined marker, wherein the extracted information includes an installation height of the predetermined marker and a size of the predetermined marker;
calculating the position of the predetermined marker in the first image, based on the extracted information.