# US 12,183,067 B2 · Volumetric baseline image generation and object identification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,183,067 B2
- Document ID: US12183067B2
- Status: Granted
- Kind: B2
- Application number: 17/314,764
- Filed: 2021-05-07
- Published: 2022-11-03
- Granted: 2024-12-31
- Earliest claimed: 2020-05-07
- Applicants: Hypergiant Industries, Inc.
- Inventors: Andrew Thomas Busey; Benjamin Edward Lamm
- Web page: https://patentgrep.com/patent/US12183067B2

## CPC

- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G01S 13/003: {Bistatic radar systems; Multistatic radar systems}
- G01S 13/89: for mapping or imaging
- G06T 15/04: Texture mapping
- G06T 17/05: Geographic models
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06F 2218/08: Feature extraction
- G06F 2218/12: Classification; Matching
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system for generating a three-dimensional map of earth's surface and identification of objects is disclosed. The system is configured to receive data, from one or more collectors, comprising three-dimensional data generated from radio frequency signals reflected from earth's surface. The system is further configured to generate an initial version of a baseline three-dimensional map of earth's surface, wherein generating the three-dimensional map includes determining, based on the surface data, a presence of surface features in the earth's surface. Anomalies may be detected based on a comparison of subsequently received data and the baseline, with the system determining that a first anomaly matches an object having an object type. Based on this determination, the system may create a data structure indicating an object type and a geographic location of the matched object, wherein the geographic location data is usable to track the matched object during an analysis period.

## Claims

### Claim 1

A system comprising:
a computer system configured to:
receive earth's surface data from one or more collectors, wherein the earth's surface data comprises three-dimensional data generated from radio frequency signals reflected from the earth's surface;
generate an initial version of a baseline three-dimensional map of earth's surface, wherein generating the three-dimensional map includes determining, based on the surface data, a presence of surface features in the earth's surface;
based on a comparison of the baseline to subsequently received data, determine a presence of one or more anomalies on the earth's surface;
determine that a first anomaly of the one or more anomalies matches an object having an object type; and
create a data structure, in response to the determining, that indicates an object type and a geographic location of the matched object, wherein the geographic location is usable to track the matched object during an analysis period.

### Claim 2 (depends on 1)

The system of claim 1, wherein, in generating the three-dimensional map, the computer system is configured to perform calculations on the earth's surface data and determining, within the surface features, a presence natural features and a presence of man-made features.

### Claim 3 (depends on 1)

The system of claim 1, wherein the computer system is configured to determine the object type of the object by matching the data with an entry in an object library having a plurality of entries, wherein ones of the plurality of entries store information corresponding to one of a plurality of known objects.

### Claim 4 (depends on 1)

The system of claim 1, further comprising updating the baseline three-dimensional map based on receiving additional data from the one or more collectors.

### Claim 5 (depends on 1)

The system of claim 1, further comprising at least one satellite operating as one of the one or more collectors.

### Claim 6 (depends on 1)

The system of claim 1, further comprising at least one aerial vehicle operating as one of the one or more collectors.

### Claim 7 (depends on 1)

The system of claim 1, wherein the computer system is configured to generate a confidence metric in a classification of a particular one of the one or more anomalies, the confidence metric indicating a degree of confidence that the classification is correct.

### Claim 8 (depends on 1)

The system of claim 1, wherein the computer system is configured to execute a machine learning model to determine a match between the object and the object type.

### Claim 9

A method, comprising:
receiving, at a computer system, earth's surface data from one or more collectors, wherein the earth's surface data comprises three-dimensional data generated from radio frequency signals reflected from the earth's surface;
generating, using the computer system, an initial version of a baseline three-dimensional map of earth's surface;
subsequent to generating the initial version of the baseline three-dimensional map of earth's surface, determining a presence of one or more anomalies on the earth's surface based on a comparison of subsequently received data and the initial version of the baseline;
determining, by the computer system, that a first one of the one or more anomalies matches an object having an object type; and
in response to the determining, creating, by the computer system, a data structure that indicates the object type and a geographic location of the matched object, wherein the geographic location is usable to track the matched object during an analysis period.

### Claim 10 (depends on 9)

The method of claim 9, further comprising determining the object type of the object by matching the data with an entry in an object library having a plurality of entries, wherein ones of the plurality of entries store information corresponding to one of a plurality of known objects.

### Claim 11 (depends on 9)

The method of claim 9, wherein generating the three-dimensional map includes performing calculations on the earth's surface data and determining the presence of surface features including natural features and man-made features.

### Claim 12 (depends on 9)

The method of claim 9, further comprising determining the dimensions of the object.

### Claim 13 (depends on 9)

The method of claim 9, further comprising generating a confidence metric in a classification of a particular one of the one or more anomalies, the confidence metric indicating a degree of confidence that the classification is correct.

### Claim 14 (depends on 9)

The method of claim 9, further comprising detecting shifting landscapes based on the three-dimensional data.

### Claim 15 (depends on 9)

The method of claim 9, further comprising detecting a presence of one or more hidden objects within surfaces detected to be shifting.

### Claim 16 (depends on 9)

The method of claim 9, wherein the collectors include one or more satellites.

### Claim 17 (depends on 9)

The method of claim 9, further comprising updating the baseline three-dimensional map based on receiving additional data from the one or more collectors.

### Claim 18

A non-transitory computer readable medium storing instructions that, when executed by a computer system, causes the computer system to perform the following operations:
generate an initial version of a baseline three-dimensional map of earth's surface based on earth's surface data received from one or more collectors, wherein the earth's surface data includes three-dimensional data generated from radio frequency signals from the earth's surface;
determine a presence of surface features in the surface data, the surface features including natural and man-made features;
based on a comparison of the baseline to subsequently received data, detect a presence of one or more anomalies on the earth's surface;
determine that a first anomaly of one or more anomalies in the baseline matches an object having an object type; and
create a data structure indicating the object type and geographic location data of the matched object, wherein the geographic location data is usable to track the matched object during an analysis period, wherein tracking the matched object includes tracking movement of the matched object.

### Claim 19 (depends on 18)

The computer readable medium of claim 18, further comprising instructions executable to:
match data of the object with an entry in an object library having a plurality of entries, wherein ones of the plurality of entries store information corresponding to one of a plurality of known objects; and
generate a confidence metric in a classification of the object, the confidence metric indicating a degree of confidence that the classification is correct.

### Claim 20 (depends on 18)

The computer readable medium of claim 18, further comprising instructions executable to:
detect shifting landscapes based on the three-dimensional data; and
detect a presence of one or more hidden objects within surfaces detected to be shifting.
