# US 2021/0065443 A1 · Synthetic image generation apparatus, synthetic image generation program, and synthetic image generation method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0065443 A1
- Document ID: US20210065443A1
- Status: Published application
- Kind: A1
- Application number: 16/999,928
- Filed: 2020-08-21
- Published: 2021-03-04
- Earliest claimed: 2019-08-29
- Assignees: OFFICE YAMANAKA Consolidated Company
- Applicants: OFFICE YAMANAKA Consolidated Company
- Inventors: Takumi YAMANAKA
- Web page: https://patentgrep.com/patent/US20210065443A1

## CPC

- G06T 17/05: Geographic models
- G06T 15/503: {Blending, e.g. for anti-aliasing}
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A synthetic image generation apparatus has a digital surface model (DSM) generator, a slope map generator, a curvature map generator and a synthetic image generator. The digital surface model (DSM) generator meshes three-dimensional point group data and generates a DSM including height of a building and vegetation. The slope map generator calculates a slope amount in accordance with the DSM and generates a slope map expressing levels of the slope amounts with shading in two colors. The curvature map generator smooths the DSM, calculates curvature in accordance with the smoothed DSM, and generates a curvature map expressing bumps and dips according to the curvature with shading in two colors. The synthetic image generator generates a synthetic image obtained by superimposing the slope map transmitted at first transmittance, the curvature map transmitted at second transmittance, and an orthochromatic image.

## Claims

### Claim 1

A synthetic image generation apparatus comprising:
a digital surface model (DSM) generator configured to mesh three-dimensional point group data and generate a DSM including height of a building and vegetation;
a slope map generator configured to calculate a slope amount in accordance with the DSM and generate a slope map expressing levels of the slope amounts with shading in two colors;
a curvature map generator configured to smooth the DSM, calculate curvature in accordance with the smoothed DSM, and generate a curvature map expressing bumps and dips according to the curvature with shading in two colors; and
a synthetic image generator configured to generate a synthetic image obtained by superimposing the slope map transmitted at first transmittance, the curvature map transmitted at second transmittance, and an orthochromatic image.

### Claim 2 (depends on 1)

The synthetic image generation apparatus according to claim 1, further comprising a display controller configured to cause a display to display a superimposed image obtained by superimposing the synthetic image and a current survey plan view.

### Claim 3 (depends on 1)

The synthetic image generation apparatus according to claim 1, wherein each of the three-dimensional point group data and the orthochromatic image is generated by estimating a photographing position and a photographing direction of a camera with reference to a plurality of aerial photographs by structure/shape from motion (SfM) processing and restoring a three-dimensional shape in accordance with the photographing position and the photographing direction by multi-view stereo (MVS) processing.

### Claim 4

A synthetic image generation program comprising the steps of:
(a) meshing three-dimensional point group data and generating a DSM including height of a building and vegetation;
(b) calculating a slope amount in accordance with the DSM and generating a slope map expressing levels of the slope amounts with shading in two colors;
(c) smoothing the DSM, calculating curvature in accordance with the smoothed DSM, and generating a curvature map expressing bumps and dips according to the curvature with shading in two colors; and
(d) generating a synthetic image obtained by superimposing the slope map transmitted at first transmittance, the curvature map transmitted at second transmittance, and an orthochromatic image.

### Claim 5

A synthetic image generation method comprising the steps of:
(a) meshing three-dimensional point group data and generating a DSM including height of a building and vegetation;
(b) calculating a slope amount in accordance with the DSM and generating a slope map expressing levels of the slope amounts with shading in two colors;
(c) smoothing the DSM, calculating curvature in accordance with the smoothed DSM, and generating a curvature map expressing bumps and dips according to the curvature with shading in two colors; and
(d) generating a synthetic image obtained by superimposing the slope map transmitted at first transmittance, the curvature map transmitted at second transmittance, and an orthochromatic image.
