# US 2024/0005599 A1 · Data normalization of aerial images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005599 A1
- Document ID: US20240005599A1
- Status: Published application
- Kind: A1
- Application number: 18/253,129
- Filed: 2021-11-16
- Published: 2024-01-04
- Earliest claimed: 2020-11-16
- Assignees: Ai Clearing Inc.
- Applicants: Ai Clearing Inc.
- Inventors: Aleksander BUCZKOWSKI; Michal MAZUR; Adam WISNIEWSKI
- Web page: https://patentgrep.com/patent/US20240005599A1

## CPC

- G06T 7/149: involving deformable models, e.g. active contour models
- G06T 7/337: {involving reference images or patches}
- G06T 7/11: Region-based segmentation
- G06T 7/174: involving the use of two or more images
- G06T 7/75: {involving models}
- G06T 17/05: Geographic models
- G06V 10/776: Validation; Performance evaluation
- G06V 10/82: using neural networks
- G06V 20/17: taken from planes or by drones
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30181: Earth observation
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system configured for analysis of aerial images is disclosed. The system comprises a data-processing system. The data-processing system comprises a data-processing storage component, a segmentation component, a projection component and an error minimizing component. The data-storage component is configured for providing at least two input orthophoto maps. The segmentation component is configured for generating at least one or a plurality of polygon(s) for the at least two orthophoto maps relating to an area. Each polygon approximates a part of the corresponding input orthophoto map. The error minimizing component is configured for minimizing positional errors on at least one or a plurality of parts on the at least two orthophoto maps. Also, a computer-implemented method for transforming photogrammetric data is disclosed. The method comprises performing an input data providing step comprising providing at least two input orthophoto maps. The method also comprises performing a segmentation step. The segmentation step comprises generating at least one or a plurality of polygon(s) for the at least two orthophoto maps relating to an area. The method further comprises performing an error minimizing step on at least one or a plurality of parts on the at least two orthophoto maps. Further, a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method, is disclosed.

## Claims

### Claim 1

A system configured for analysis of aerial images, comprising a data-processing system, the data-processing system comprising a data-processing storage component, a segmentation component, a projection component and an error minimizing component,
wherein the data-storage component is configured for providing at least two input orthophoto maps and at least two input digital elevation models relating to an area,
wherein the segmentation component is configured for generating at least one or a plurality of polygon(s) for the at least two orthophoto maps relating to the area, each polygon approximating a part of the corresponding input orthophoto map, and
wherein the error minimizing component is configured for minimizing positional errors on at least one or a plurality of parts of the at least two orthophoto maps.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the data-processing system comprises a projection component, wherein the projection component is configured for projecting the polygon(s) on the corresponding input digital elevation model of the area.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the projection component is configured for determining for each vertex of the corresponding polygon(s) at least one coordinate corresponding to the projection of vertices on the corresponding input digital elevation model and a reference value for each projection of the vertices of each polygon to the digital elevation models.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the error minimizing component is configured for applying a machine learning algorithm, wherein the machine learning algorithm is configured for performing a nearest neighbour analysis step, wherein the nearest neighbour analysis step comprises assigning to at least one object of one of the orthophoto maps a corresponding object of the same class in one of the other orthophoto maps.

### Claim 5 (depends on 1)

The system according to claim 1, wherein the data-processing system is further configured for providing object-class data indicating at least one or a plurality of object-class(es), and wherein the error minimizing component is further configured for determining a transformation for a plurality of pairs of corresponding parts of at least one of the indicated object-class(es) of the at least two orthophoto maps by means of an optimization algorithm.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the data-processing system further comprises a transformation component, wherein the transformation component is configured for transforming at least one orthophoto map and at least one digital elevation model based on the transformation determined by the error minimizing component.

### Claim 7 (depends on 1)

The system according to claim 1, wherein the segmentation component is configured for determining classes for at least some of the part(s) of the at least two orthophoto maps by means of at least one convolutional neural network.

### Claim 8 (depends on 7)

The system according to claim 7, wherein the data-processing system comprises a post-processing component, wherein the post-processing component is configured for assigning a first class to a connected plurality of portions to which no class is assigned, if the connected plurality is enclosed by connected portions to which the first class is assigned and for removing excessive vertices of the polygon(s).

### Claim 9

A computer-implemented method for transforming photogrammetric data, comprising:
performing an input data providing step comprising providing at least two input orthophoto maps and at least two digital elevation models relating to an area;
performing a segmentation step, wherein the segmentation step comprises generating at least one or a plurality of polygon(s) for the at least two orthophoto maps;
performing an error minimizing step on at least one or a plurality of parts on the at least two orthophoto maps.

### Claim 10 (depends on 9)

The method according to the claim 9, wherein the method further comprises a projection step, wherein the projection step comprises projecting the polygon(s) on the corresponding input digital elevation model(s) of the area.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the projection step comprises determining for each vertex of the polygon(s) at least one coordinate corresponding to a projection of the respective vertex on the corresponding input digital elevation model.

### Claim 12 (depends on 9)

The method according to claim 9, wherein the error minimizing step comprises applying a machine learning algorithm, which machine learning algorithm comprises performing a nearest neighbour analysis step, wherein the nearest neighbour analysis step comprises assigning to at least one object of one of the orthophoto maps a corresponding object of the same class in one of the other orthophoto maps.

### Claim 13 (depends on 9)

The method according to claim 9, wherein the method further comprises providing object-class data indicating at least one or a plurality of object-class(es), and wherein the error minimizing step comprises determining a transformation for a plurality of pairs of corresponding parts of at least one of the indicated object-class(es) of the at least two orthophoto maps by means of an optimization algorithm.

### Claim 14 (depends on 13)

The method according to claim 13, wherein the method further comprises a transformation step comprising transforming at least one orthophoto map (such as O2) and at least one digital elevation model (such as DEM2) based on the transformation determined by the error minimizing step.

### Claim 15 (depends on 9)

The method according to claim 9, wherein the segmentation step comprises determining classes for at least some of the part(s) of the at least two orthophoto maps by means of at least one convolutional neural network.

### Claim 16 (depends on 15)

The method according to claim 15, wherein the segmentation step comprises a post-processing step, wherein the post-processing step comprises for a connected plurality of portions to which no class is assigned, assigning a first class, if the connected plurality is enclosed by connected portions to which the first class is assigned.

### Claim 17 (depends on 9)

A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method according to claim 9.
