# US 2020/0394787 A1 · Imaging evaluation map, imaging evaluation map generating device, imaging evaluation map generating method, and imaging evaluation map generating program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394787 A1
- Document ID: US20200394787A1
- Status: Published application
- Kind: A1
- Application number: 17/008,599
- Filed: 2020-08-31
- Published: 2020-12-17
- Earliest claimed: 2018-03-06
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Shuji ONO
- Web page: https://patentgrep.com/patent/US20200394787A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- E01D 22/00: Methods or apparatus for repairing or strengthening existing bridges {(electrochemical desalination or re-alkalisation C04B41/00); Methods or apparatus for dismantling bridges}
- E04G 23/00: Working measures on existing buildings, ({domestic cleaning of walls or floors A47L11/00; grinding floors or walls B24B7/18; removing of wall coverings B44C7/00; removing of paint from surfaces B44D3/16; electrochemical desalination or re-alkalisation C04B41/00}; on foundations E02D35/00, E02D37/00; in connection with insulations E04B; subsequent or finishing work E04F)
- G03B 15/00: Special procedures for taking photographs; Apparatus therefor
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 2207/30108: Industrial image inspection
- G06T 2207/30244: Camera pose
- H04N 23/60: Control of cameras or camera modules
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- E01D: CONSTRUCTION OF BRIDGES, {ELEVATED ROADWAYS} OR VIADUCTS; ASSEMBLY OF BRIDGES (bridges extending between terminal buildings and aircraft for embarking or disembarking passengers B64F1/305; {tracks for special kinds of railways E01B25/00; culverts E01F5/005})
- E04G: SCAFFOLDING; FORMS; SHUTTERING; BUILDING IMPLEMENTS OR AIDS, OR THEIR USE; HANDLING BUILDING MATERIALS ON THE SITE; REPAIRING, BREAKING-UP OR OTHER WORK ON EXISTING BUILDINGS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided are an imaging evaluation map, an imaging evaluation map generating device, an imaging evaluation map generating method, and an imaging evaluation map generating program capable of easily making an imaging plan. A coordinate space setting section (31) that sets a coordinate space including an object, an imaging candidate position setting section (32) that sets a plurality of imaging candidate positions in the coordinate space, an imaging condition setting section that sets an imaging condition for the object (33), a characteristic part setting section (34) that sets a plurality of characteristic parts for the object, an evaluation standard setting section (35) that sets an evaluation standard for imaging based on the imaging candidate position and the imaging condition for each characteristic part, an evaluation value calculating section (36) that calculates an evaluation value that represents an evaluation of imaging in a case where an object is imaged under the imaging condition set by the imaging condition setting section (33) at the imaging candidate positions set by the imaging candidate position setting section (32) for each imaging candidate position, and an imaging evaluation map generating section (37) that generates an imaging evaluation map in which the evaluation value is determined for each imaging candidate position are provided. In a case where the evaluation value for each imaging candidate position is calculated, the evaluation value calculating section (36) calculates individual evaluation values for the respective characteristic parts according to the evaluation standard, and calculates a sum of the obtained individual evaluation values for the respective characteristic parts as the evaluation value.

## Claims

### Claim 1

An imaging evaluation map generating device comprising:
a coordinate space setting section that sets a coordinate space including an object;
an imaging candidate position setting section that sets a plurality of imaging candidate positions in the coordinate space;
an imaging condition setting section that sets an imaging condition of the object;
a characteristic part setting section that sets a plurality of characteristic parts for the object;
an evaluation standard setting section that sets an evaluation standard of imaging based on the imaging candidate position and the imaging condition for each of the characteristic parts;
an evaluation value calculating section that calculates an evaluation value that represents an evaluation of imaging in a case where the object is imaged at the imaging candidate position set by the imaging candidate position setting section under the imaging condition set by the imaging condition setting section, for each of the imaging candidate positions; and
an imaging evaluation map generating section that generates an imaging evaluation map in which the evaluation value is determined for each of the imaging candidate positions,
wherein the evaluation value calculating section calculates, in a case where the evaluation value for each of the imaging candidate positions is calculated, an individual evaluation value for each of the characteristic parts according to the evaluation standard, and calculates a sum of the obtained individual evaluation values for the respective characteristic parts as the evaluation value.

### Claim 2 (depends on 1)

The imaging evaluation map generating device according to claim 1,
wherein the evaluation standard is defined by an evaluation function having a position and an imaging condition as parameters.

### Claim 3 (depends on 1)

The imaging evaluation map generating device according to claim 1,
wherein the imaging condition setting section sets the plurality of imaging conditions,
wherein the evaluation value calculating section calculates the evaluation value for each imaging candidate position and each imaging condition, and
wherein the imaging evaluation map generating section generates the imaging evaluation map in which the evaluation value is determined for each of the plurality of imaging conditions with respect to the plurality of imaging candidate positions.

### Claim 4 (depends on 3)

The imaging evaluation map generating device according to claim 3,
wherein the imaging condition setting section sets the plurality of imaging conditions having at least different imaging directions.

### Claim 5 (depends on 3)

The imaging evaluation map generating device according to claim 3,
wherein the imaging condition setting section sets the plurality of imaging conditions having at least different imaging angles of view.

### Claim 6 (depends on 3)

The imaging evaluation map generating device according to claim 3,
wherein the imaging condition setting section sets the plurality of imaging conditions having at least different numbers of recording pixels.

### Claim 7 (depends on 3)

The imaging evaluation map generating device according to claim 3,
wherein the imaging condition setting section sets the plurality of imaging conditions having at least different exposure correction amounts.

### Claim 8 (depends on 3)

The imaging evaluation map generating device according to claim 3,
wherein the imaging condition setting section sets the plurality of imaging conditions having at least different frame rates.

### Claim 9 (depends on 1)

The imaging evaluation map generating device according to claim 1,
wherein the characteristic part is specified by a position and an azimuth in the coordinate space.

### Claim 10 (depends on 1)

The imaging evaluation map generating device according to claim 1,
wherein the characteristic part setting section sets a vertex and/or a ridge of the object as the characteristic part.

### Claim 11 (depends on 10)

The imaging evaluation map generating device according to claim 10,
wherein in a case where a structure is set as the object, the characteristic part setting section further sets a deteriorated part on a surface of the structure as the characteristic part.

### Claim 12 (depends on 11)

The imaging evaluation map generating device according to claim 11,
wherein a stain and/or a crack on the surface of the structure is set as the deteriorated part.

### Claim 13 (depends on 1)

The imaging evaluation map generating device according to claim 1, further comprising:
a weight setting section that sets a weight for each characteristic part,
wherein the evaluation value calculating section calculates, in a case of calculating the evaluation value for each imaging candidate position, a sum of values obtained by multiplying the obtained individual evaluation values for the respective characteristic parts by the weights as the evaluation value.

### Claim 14 (depends on 13)

The imaging evaluation map generating device according to claim 13,
wherein in a case where a deteriorated part on a surface of a structure is set as the characteristic part, the weight setting section gives a relatively high weight to the deteriorated part.

### Claim 15 (depends on 13)

The imaging evaluation map generating device according to claim 13, further comprising:
a notice part selecting section that selects a notice part from the plurality of characteristic parts,
wherein the weight setting section gives a relatively high weight to the notice part.

### Claim 16 (depends on 1)

The imaging evaluation map generating device according to claim 1, further comprising:
an object image acquiring section that acquires a plurality of images obtained by imaging the object from a plurality of viewpoints; and
a three-dimensional model generating section that generates a three-dimensional model of the object on the basis of the plurality of acquired images,
wherein the coordinate space setting section sets the coordinate space on the basis of the three-dimensional model of the object generated by the three-dimensional model generating section.

### Claim 17 (depends on 16)

The imaging evaluation map generating device according to claim 16,
wherein the characteristic part setting section sets the characteristic part on the basis of the three-dimensional model of the object generated by the three-dimensional model generating section.

### Claim 18 (depends on 17)

The imaging evaluation map generating device according to claim 17,
wherein the evaluation standard setting section sets the evaluation standard for each characteristic part on the basis of the three-dimensional model of the object generated by the three-dimensional model generating section.

### Claim 19

An imaging evaluation map generating method comprising:
a step of setting a coordinate space including an object;
a step of setting a plurality of imaging candidate positions in the coordinate space;
a step of setting an imaging condition of the object;
a step of setting a plurality of characteristic parts in the object;
a step of setting an evaluation standard for imaging based on the imaging candidate position and the imaging condition for each of the characteristic parts;
a step of calculating an evaluation value that represents an evaluation of imaging in a case where the object is imaged at the set imaging candidate position under the set imaging condition for each of the imaging candidate positions; and
a step of generating an imaging evaluation map in which the evaluation value is determined for each of the imaging candidate positions;
wherein the step of calculating the evaluation value for each of the imaging candidate positions includes a step of calculating an individual evaluation value for each of the characteristic parts according to the evaluation standard, and a step of setting a sum of the obtained individual evaluation values for the respective characteristic parts as the evaluation value.

### Claim 20 (depends on 19)

A non-transitory computer-readable recording medium causing a computer to execute the imaging evaluation map generating method according to claim 19 in a case where a command stored in the recording medium is read by the computer.

### Claim 21

An imaging evaluation map in which an evaluation value that represents an evaluation of imaging in a case where an object is imaged at a specific position under a specific imaging condition is determined, for each of a plurality of imaging conditions with respect to a plurality of imaging candidate positions.

### Claim 22 (depends on 21)

The imaging evaluation map according to claim 21,
wherein the evaluation value for each imaging condition at each imaging candidate position is calculated by setting a plurality of characteristic parts on the object, setting an evaluation standard of imaging based on the imaging candidate positions and the imaging conditions for each characteristic part, calculating an individual evaluation value for each characteristic part according to the evaluation standard, and calculating a sum of the obtained individual evaluation values for the respective characteristic parts.
