# US 2021/0064066 A1 · Control device, system, and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0064066 A1
- Document ID: US20210064066A1
- Status: Published application
- Kind: A1
- Application number: 17/003,448
- Filed: 2020-08-26
- Published: 2021-03-04
- Earliest claimed: 2019-08-30
- Assignees: Rakuten, Inc.
- Applicants: Rakuten, Inc.
- Inventors: Toshiaki TAZUME
- Web page: https://patentgrep.com/patent/US20210064066A1

## CPC

- H04N 7/185: {from a mobile camera, e.g. for remote control}
- B64U 10/14: with four distinct rotor axes, e.g. quadcopters
- B64U 30/297: Tilting rotors
- B64U 60/50: with landing legs
- G05D 1/0094: {involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target}
- G05D 1/0676: {specially adapted for landing}
- G05D 1/1064: {specially adapted for avoiding collisions with other aircraft}
- G06V 20/13: Satellite images
- G06V 20/17: taken from planes or by drones
- B64U 2101/30: for imaging, photography or videography
- B64U 2101/64: for parcel delivery or retrieval
- B64U 2201/10: autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
- G06V 2201/10: Recognition assisted with metadata
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A control device 200 includes at least one memory configured to store a program code, and at least one processor configured to access the program code and operate as instructed by the program code. The program code includes an acquisition code configured to cause the at least one processor to acquire a request for requesting determination as to whether or not a target area is usable for a predetermined purpose, and a control code configured to cause the at least one processor to perform control to cause a first flying object to fly to the target area. The acquisition code is configured to cause the at least one processor to further acquire sensing data that is data obtained by optical sensing of the target area by the first flying object. The program code further comprises a determination code configured to cause the at least one processor to determine, based on the acquired sensing data, whether or not the target area is usable for the predetermined purpose.

## Claims

### Claim 1

A control device comprising:
at least one memory configured to store a program code; and
at least one processor configured to access the program code and operate as instructed by the program code,
the program code including:
an acquisition code configured to cause the at least one processor to acquire a request for requesting determination as to whether or not a target area is usable for a predetermined purpose; and
a control code configured to cause the at least one processor to perform control to cause a first flying object to fly to the target area,
wherein the acquisition code is configured to cause the at least one processor to further acquire sensing data that is data obtained by optical sensing of the target area by the first flying object, and
the program code further includes a determination code configured to cause the at least one processor to determine, based on the acquired sensing data, whether or not the target area is usable for the predetermined purpose.

### Claim 2 (depends on 1)

The control device according to claim 1, wherein
the acquisition code is configured to cause the at least one processor to further acquire, together with the request or separately from the request, a first image obtained by capturing of an image of a surface of the target area,
the determination code is configured to cause the at least one processor to
determine, based on the acquired first image, whether or not the surface satisfies a predetermined first condition, and
upon determination that the surface does not satisfy the first condition, determine that the target area is unusable for the predetermined purpose, and
the control code is configured to cause, upon determination that the surface satisfies the first condition, the at least one processor to perform control to cause the first flying object to fly to the target area.

### Claim 3 (depends on 2)

The control device according to claim 2, wherein
the acquisition code is configured to cause the at least one processor to further acquire the second image that is an image different from the first image and that is obtained by capturing of an image of a cover that covers the target area,
the determination code is configured to cause the at least one processor to
determine, based on the acquired second image, whether or not the cover satisfies a predetermined second condition, and
upon determination that the cover does not satisfy the second condition, determine that the target area is unusable for the predetermined purpose, and
the control code is configured to cause the at least one processor to perform, upon determination that the surface satisfies the first condition and the cover satisfies the second condition, the control to cause the first flying object to fly to the target area.

### Claim 4 (depends on 3)

The control device according to claim 3, wherein
the determination code is configured to cause the at least one processor to
further determine, based on a feature point based on the first image and a feature point based on the second image, whether or not the target area whose surface is imaged to obtain the first image is identical to the target area covered with the cover imaged to obtain the second image, and
upon determination the target areas are identical to each other, determine whether or not the cover imaged to obtain the second image satisfies the second condition.

### Claim 5 (depends on 1)

The control device according to claim 1, wherein
the predetermined purpose is to install a predetermined object or construct a predetermined building.

### Claim 6 (depends on 2)

The control device according to claim 2, wherein
the predetermined purpose is to install a predetermined object or construct a predetermined building.

### Claim 7 (depends on 3)

The control device according to claim 3, wherein
the predetermined purpose is to install a predetermined object or construct a predetermined building.

### Claim 8 (depends on 4)

The control device according to claim 4, wherein
the predetermined purpose is to install a predetermined object or construct a predetermined building.

### Claim 9 (depends on 5)

The control device according to claim 5, wherein
the predetermined object is a radio station, and
the predetermined purpose is to install the radio station.

### Claim 10 (depends on 9)

The control device according to claim 9, wherein the determination code is configured to cause the at least one processor to
calculate a distance from a ground level to the target area based on the sensing data, and
determine, based on the calculated distance, whether or not the target area is usable for the predetermined purpose.

### Claim 11 (depends on 5)

The control device according to claim 5, wherein the determination code is configured to cause the at least one processor to
determine, based on the sensing data, a positional relationship between the target area and the building that is located at a distance shorter than a predetermined distance from the target area, and
determine, based on the determined positional relationship, whether or not the target area is usable for the predetermined purpose.

### Claim 12 (depends on 9)

The control device according to claim 9, wherein the determination code is configured to cause the at least one processor to
determine, based on the sensing data, a positional relationship between the target area and the building that is located at a distance shorter than a predetermined distance from the target area, and
determine, based on the determined positional relationship, whether or not the target area is usable for the predetermined purpose.

### Claim 13 (depends on 10)

The control device according to claim 10, wherein the determination code is configured to cause the at least one processor to
determine, based on the sensing data, a positional relationship between the target area and the building that is located at a distance shorter than a predetermined distance from the target area, and
determine, based on the determined positional relationship, whether or not the target area is usable for the predetermined purpose.

### Claim 14 (depends on 1)

The control device according to claim 1, wherein
the predetermined purpose is to use the target area as a port,
the sensing data represents a target area image obtained by capturing of an image of the target area by the first flying object, and
the determination code is configured to cause the at least one of processors to determine, based on the target area image, whether or not either one or both of the first flying object and the second flying object different from the first flying object can land in the target area.

### Claim 15 (depends on 2)

The control device according to claim 2, wherein
the predetermined purpose is to use the target area as a port,
the sensing data represents a target area image obtained by capturing of an image of the target area by the first flying object,
the first image is an image different from the target area image, and
the determination code is configured to cause the at least one processor to determine that upon determination based on the acquired first image that the surface of the target area does not satisfy the first condition, either one or both of the first flying object and a second flying object different from the first flying object cannot land in the target area.

### Claim 16 (depends on 3)

The control device according to claim 3, wherein
the predetermined purpose is to use the target area as a port,
the request includes destination information that represents a destination of the cover that covers the target area to indicate that the target area is to be used as the port,
the sensing data represents a target area image obtained by capturing of an image of the target area by the first flying object,
the first image is an image different from the target area image,
the determination code is configured to cause the at least one processor to determine that upon determination based on the acquired first image that the surface of the target area does not satisfy the first condition, either one or both of the first flying object and a second flying object different from the first flying object cannot land in the target area,
the control code is configured to cause the at least one processor to output the destination information upon determination that the surface satisfies the first condition,
the acquisition code is configured to cause the at least one processor to further acquire, together with a report that tells that the target area is covered with the cover or separately from the report, the second image that is different from the target area image and the first image and obtained by capturing of an image of the cover that covers the target area, and
the determination code is configured to cause the at least one processor to determine that upon determination based on the acquired second image that the cover does not satisfy the second condition, either one or both of the first flying object and the second flying object cannot land in the target area.

### Claim 17 (depends on 4)

The control device according to claim 4, wherein
the predetermined purpose is to use the target area as a port,
the request includes destination information that represents a destination of the cover that covers the target area to indicate that the target area is to be used as the port,
the sensing data represents a target area image obtained by capturing of an image of the target area by the first flying object,
the first image is an image different from the target area image,
the determination code is configured to cause the at least one processor to determine that upon determination based on the acquired first image that the surface of the target area does not satisfy the first condition, either one or both of the first flying object and a second flying object different from the first flying object cannot land in the target area,
the control code is configured to cause the at least one processor to output the destination information upon determination that the surface satisfies the first condition,
the acquisition code is configured to cause the at least one processor to further acquire, together with a report that tells that the target area is covered with the cover or separately from the report, the second image that is different from the target area image and the first image and obtained by capturing of an image of the cover that covers the target area, and
the determination code is configured to cause the at least one processor to determine that upon determination based on the acquired second image that the cover does not satisfy the second condition, either one or both of the first flying object and the second flying object cannot land in the target area.

### Claim 18 (depends on 14)

The control device according to claim 14, wherein
the determination code is configured to cause the at least one processor to further determine, based on the target area image, whether or not either one or both of the first flying object and the second flying object different from the first flying object can land in the target area.

### Claim 19

A system comprising a terminal device and a control device, wherein
the terminal device comprises a communication circuit configured to transmit a request for requesting determination as to whether or not the target area is usable for a predetermined purpose,
the control device comprises:
a communication circuit configured to receive the request;
at least one memory configured to store a program code; and
at least one processor configured to access the program code and operate as instructed by the program code,
the program code includes a control code configured to cause the at least one processor to perform control to cause a first flying object to fly to the target area upon reception the request,
the communication circuit is configured to further receive sensing data that is data obtained by optical sensing of the target area by the first flying object, and
the program code further includes a determination code configured to cause the at least one processor to determine, based on the received sensing data, whether or not the target area is usable for the predetermined purpose.

### Claim 20

A method comprising:
acquiring a request for requesting determination as to whether or not the target area is usable for a predetermined purpose;
performing control to cause a first flying object to fly to the target area;
acquiring sensing data that is data obtained by optical sensing of the target area by the first flying object; and
determining, based on the acquired sensing data, whether or not the target area is usable for the predetermined purpose.
