# US 2021/0264586 A1 · Image processing of aerial imagery for energy infrastructure analysis using pre-processing image selection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0264586 A1
- Document ID: US20210264586A1
- Status: Published application
- Kind: A1
- Application number: 17/314,556
- Filed: 2021-05-07
- Published: 2021-08-26
- Earliest claimed: 2019-01-14
- Assignees: Sourcewater, Inc.
- Applicants: Sourcewater, Inc.
- Inventors: Joshua ADLER
- Web page: https://patentgrep.com/patent/US20210264586A1

## CPC

- G06F 16/29: Geographical information databases
- G01C 11/02: Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 7/0004: {Industrial image inspection}
- G06T 7/73: using feature-based methods
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 20/176: {Urban or other man-made structures}
- G06V 20/182: {Network patterns, e.g. roads or rivers}
- G06Q 50/06: Energy or water supply
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20072: Graph-based image processing
- G06T 2207/20076: Probabilistic image processing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30184: Infrastructure
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A computer-implemented method for selecting aerial images for image processing to identify Energy Infrastructure (EI) features is provided. The method includes performing image processing on aerial images of a portion of global terrain captured at different times to determine differences in terrain content the captured images. Aerial images are selected for further image processing according to identified differences in terrain content. The selected images are imaged processed via an EI feature recognition type to identify EI features within the images.

## Claims

### Claim at position 1

-18. (canceled)

### Claim 19

A computer-implemented method to identify Energy Infrastructure (EI), the method to be carried out by at least one processor executing computer instructions, the method comprising:
receiving an image including at least one captured image of a portion of terrain;
applying an EI feature recognition model to the image to generate EI feature information on at least one EI feature in the portion of terrain;
receiving from a supplemental information source, supplemental information including at least one of GPS information related to the portion of terrain and additional aerial image information related to the portion of terrain; and
identifying activity at the at least one EI feature based on the EI feature information and the supplemental information.

### Claim 20 (depends on 19)

The computer-implemented method of claim 19, further comprising:
receiving, from an additional supplemental information source, additional supplemental information indicative of activity at an EI site in the portion of terrain,
wherein the at least one captured image of the portion of terrain is selected according to the additional supplemental information.

### Claim 21 (depends on 19)

The computer-implemented method of claim 19, further comprising classifying a level of the activity at the at least one EI feature based on the EI feature information and the supplemental information.

### Claim 22 (depends on 19)

The computer-implemented method of claim 19, further comprising identifying a composite indication of EI site status of an EI site associated with the at least one EI feature based on the activity at the at least one EI feature.

### Claim 23 (depends on 19)

The computer-implemented method of claim 19, further comprising generating a report of the activity at the at least one EI feature.

### Claim 24 (depends on 19)

The computer-implemented method of claim 19, further comprising updating the EI feature recognition model based on at least one of the supplemental information and additional supplemental information comprising at least one of oilfield permit information and energy infrastructure reports.

### Claim 25 (depends on 19)

The computer-implemented method of claim 19, wherein the supplemental information includes the additional aerial image information, the additional aerial image information including gas emission information and being obtained from at least one of the image and a second image, the method further comprising identifying gas emissions associated with at least one EI feature based on the EI feature information and the additional aerial image information.

### Claim 26 (depends on 19)

The computer-implemented method of claim 19, further comprising classifying the at least one EI feature based on the EI feature information and the supplemental information.

### Claim 27

A computer-implemented method to identify Energy Infrastructure (EI), the method to be carried out by at least one processor executing computer instructions, the method comprising:
receiving an image including at least one captured image of a portion of terrain;
applying an EI feature recognition model to the image to generate EI feature information on at least one EI feature in the portion of terrain;
receiving from a supplemental information source, supplemental information including at least one of GPS information related to the portion of terrain and additional aerial information related to the portion of terrain; and
classifying the at least one EI feature based on the EI feature information and the supplemental information.

### Claim 28 (depends on 27)

The computer-implemented method of claim 27, further comprising:
receiving, from an additional supplemental information source, additional supplemental information indicative of activity of an EI site in the portion of terrain,
wherein the at least one captured image of the portion of terrain is selected according to the additional supplemental information.

### Claim 29 (depends on 27)

The computer-implemented method of claim 27, further comprising identifying activity at the at least one EI feature based on the EI feature information and the supplemental information.

### Claim 30 (depends on 29)

The computer-implemented method of claim 29, further comprising classifying a level of the activity at the at least one EI feature based on the EI feature information and the supplemental information.

### Claim 31 (depends on 29)

The computer-implemented method of claim 29, further comprising identifying a composite indication of EI site status of an EI site associated with the at least one EI feature based on the activity at the at least one EI feature.

### Claim 32 (depends on 27)

The computer-implemented method of claim 27, further comprising generating a report of the at least one EI feature.

### Claim 33 (depends on 27)

The computer-implemented method of claim 27, further comprising updating the EI feature recognition model based on at least one of the supplemental information and additional supplemental information comprising at least one of oilfield permit information and energy infrastructure reports.

### Claim 34 (depends on 27)

The computer-implemented method of claim 27, wherein the supplemental information includes the additional aerial image information, the additional aerial image information including gas emission information and being obtained from at least one of the image and a second image, the method further comprising identifying gas emissions associated with the at least one EI feature based on the EI feature information and the additional aerial image information.

### Claim 35

A computer-implemented method to identify Energy Infrastructure (EI), the method to be carried out by at least one processor executing computer instructions, the method comprising:
obtaining EI feature information on at least one EI feature in a portion of terrain;
receiving from a supplemental information source, supplemental information including at least one of GPS information related to the portion of terrain and additional aerial imagery information related to the portion of terrain; and
identifying at least one second EI feature in the portion of terrain based on the supplemental information.

### Claim 36 (depends on 35)

The computer-implemented method of claim 35, further comprising generating a report of the at least one second EI feature.

### Claim 37 (depends on 35)

The computer-implemented method of claim 35, further comprising identifying activity at the at least one second EI feature based on the supplemental information.

### Claim 38 (depends on 37)

The computer-implemented method of claim 37, further comprising classifying a level of the activity at the at least one second EI feature based on the supplemental information.

### Claim 39 (depends on 35)

The computer-implemented method of claim 35, further comprising identifying a composite indication of EI site status of an EI site associated with the at least one second EI feature based on the supplemental information.

### Claim 40 (depends on 35)

The computer-implemented method of claim 35, wherein the EI feature information is generated according to an EI feature recognition model, and
the method further comprises:
receiving additional supplemental information including at least one of oilfield permit information and energy infrastructure reports; and
selecting the portion of terrain according to the at least one of oilfield permit information and energy infrastructure reports.

### Claim 41

A computer-implemented method to identify Energy Infrastructure (EI) site status, the method to be carried out by at least one processor executing computer instructions, the method comprising:
receiving from a supplemental information source, supplemental information related to a portion of terrain, the supplemental information including at least one of GPS information related to the portion of terrain, regulatory information related to the portion of terrain, and land data related to the portion of terrain;
receiving an image including at least one captured image of the portion of terrain;
applying an EI feature recognition model to the image to generate EI feature information on at least one EI feature associated with an EI site at a location in the portion of terrain; and
identifying the EI feature based on at least one of the EI feature information and the supplemental information.

### Claim 42 (depends on 41)

The computer-implemented method of claim 41, further comprising:
obtaining additional aerial image information including gas emission information, the additional aerial image information being obtained from at least one of the image and a second image; and
identifying gas emissions associated with the at least one EI feature based on the EI feature information and the additional aerial image information.

### Claim 43 (depends on 41)

The computer-implemented method of claim 41, further comprising identifying activity at the at least one EI feature based on the supplemental information and the EI feature information.

### Claim 44 (depends on 43)

The computer-implemented method of claim 43, further comprising classifying a level of the activity at the at least one EI feature based on the supplemental information and the EI feature information.

### Claim 45 (depends on 41)

The computer-implemented method of claim 41, further comprising classifying the EI feature based on the supplemental information and the EI feature information.

### Claim 46 (depends on 43)

The computer-implemented method of claim 43, further comprising identifying a composite indication of EI site status of an EI site associated with the EI feature based on the EI feature information and the activity.

### Claim 47 (depends on 41)

The computer-implemented method of claim 41, further comprising generating a report of the EI feature.

### Claim 48 (depends on 41)

The computer-implemented method of claim 41, wherein the supplemental information includes at least one of oilfield permit information and energy infrastructure reports, and
the method further comprises:
receiving additional supplemental information including GPS information; and
identifying activity at the EI feature according to the GPS information.
