# US 2022/0279155 A1 · Mobile object, control device, and imaging method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0279155 A1
- Document ID: US20220279155A1
- Status: Published application
- Kind: A1
- Application number: 17/747,678
- Filed: 2022-05-18
- Published: 2022-09-01
- Earliest claimed: 2019-12-09
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Masashi KURANOSHITA
- Web page: https://patentgrep.com/patent/US20220279155A1

## CPC

- H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
- H04N 23/60: Control of cameras or camera modules
- H04N 5/222: Studio circuitry; Studio devices; Studio equipment (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00)
- H04N 13/257: Colour aspects
- H04N 13/286: having separate monoscopic and stereoscopic modes
- B64U 10/13: Flying platforms
- B64U 2101/30: for imaging, photography or videography
- B64U 2201/20: Remote controls
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR

## Abstract

A mobile object includes a mobile object main body, an imaging device that is included in the mobile object main body and that performs imaging of a target object, the imaging device including an image data acquisition device and a three-dimensional data acquisition device that are calibrated, and a control device that acquires, for the target object, unit image data in which image data acquired for each angle of view of the image data acquisition device and three-dimensional data acquired by the three-dimensional data acquisition device are associated with each other from the imaging device, performs plane estimation on an imaging target, based on the three-dimensional data, determines whether the imaging target is a plane, and in the case where it is determined that the imaging target is the plane, determines a first distance until next unit image data is acquired based on information on the plane.

## Claims

### Claim 1

A mobile object comprising:
a mobile object main body;
an imaging device that is comprised in the mobile object main body and that performs imaging of a target object, the imaging device comprising an image data acquisition device and a three-dimensional data acquisition device that are calibrated; and
a control device that acquires, for the target object, unit image data in which image data acquired for each angle of view of the image data acquisition device and three-dimensional data acquired by the three-dimensional data acquisition device are associated with each other from the imaging device, performs plane estimation on an imaging target, based on the three-dimensional data, determines whether the imaging target is a plane, and determines, in the case where it is determined that the imaging target is the plane, a first distance until next unit image data is acquired, based on information on the plane.

### Claim 2 (depends on 1)

The mobile object according to claim 1, wherein in the case where it is determined that the imaging target is not the plane, the control device determines a second distance shorter than the first distance as a distance until next unit image data is acquired.

### Claim 3 (depends on 1)

The mobile object according to claim 1, wherein the imaging device simultaneously acquires the image data and the three-dimensional data.

### Claim 4 (depends on 2)

The mobile object according to claim 2, wherein the imaging device simultaneously acquires the image data and the three-dimensional data.

### Claim 5 (depends on 1)

The mobile object according to claim 1, wherein the three-dimensional data acquisition device includes one of a stereo camera, a laser scanner, or a time-of-flight camera.

### Claim 6 (depends on 2)

The mobile object according to claim 2, wherein the three-dimensional data acquisition device includes one of a stereo camera, a laser scanner, or a time-of-flight camera.

### Claim 7 (depends on 3)

The mobile object according to claim 3, wherein the three-dimensional data acquisition device includes one of a stereo camera, a laser scanner, or a time-of-flight camera.

### Claim 8 (depends on 4)

The mobile object according to claim 4, wherein the three-dimensional data acquisition device includes one of a stereo camera, a laser scanner, or a time-of-flight camera.

### Claim 9 (depends on 1)

The mobile object according to claim 1, wherein the image data is two-dimensional color image data.

### Claim 10 (depends on 2)

The mobile object according to claim 2, wherein the image data is two-dimensional color image data.

### Claim 11 (depends on 3)

The mobile object according to claim 3, wherein the image data is two-dimensional color image data.

### Claim 12 (depends on 4)

The mobile object according to claim 4, wherein the image data is two-dimensional color image data.

### Claim 13 (depends on 5)

The mobile object according to claim 5, wherein the image data is two-dimensional color image data.

### Claim 14 (depends on 6)

The mobile object according to claim 6, wherein the image data is two-dimensional color image data.

### Claim 15 (depends on 7)

The mobile object according to claim 7, wherein the image data is two-dimensional color image data.

### Claim 16 (depends on 1)

The mobile object according to claim 1, wherein the mobile object main body comprising the imaging device and the control device is an unmanned aerial vehicle.

### Claim 17

A control device that is comprised in a mobile object main body and that controls an imaging device, the imaging device performing imaging of a target object and comprising an image data acquisition device and a three-dimensional data acquisition device that are calibrated, wherein
the control device acquires, for the target object, unit image data in which image data acquired for each angle of view of the image data acquisition device and three-dimensional data acquired by the three-dimensional data acquisition device are associated with each other from the imaging device, performs plane estimation on an imaging target, based on the three-dimensional data, determines whether the imaging target is a plane, and determines, in the case where it is determined that the imaging target is the plane, a first distance until next unit image data is acquired, based on information on the plane.

### Claim 18 (depends on 17)

The control device according to claim 17, wherein in the case where it is determined that the imaging target is not the plane, the control device determines a second distance shorter than the first distance as a distance until next unit image data is acquired.

### Claim 19

An imaging method comprising:
acquiring, for a target object, unit image data in which image data and three-dimensional data are associated with each other, during movement;
performing plane estimation on an imaging target, based on the three-dimensional data of the unit image data;
determining whether the imaging target is a plane; and
determining, in the case where it is determined that the imaging target is the plane, a first distance until next unit image data is acquired, based on information on the plane.

### Claim 20 (depends on 19)

The imaging method according to claim 19, further comprising a step of determining, in the case where it is determined that the imaging target is not the plane, a second distance shorter than the first distance as a distance until next unit image data is acquired.
