# US 2023/0267364 A1 · Processing images of wind farms and plant farms captured by a drone

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267364 A1
- Document ID: US20230267364A1
- Status: Published application
- Kind: A1
- Application number: 17/677,321
- Filed: 2022-02-22
- Published: 2023-08-24
- Earliest claimed: 2022-02-22
- Assignees: Inventus Holdings, LLC
- Applicants: Inventus Holdings, LLC
- Inventors: Rachana Vidhi; Prasanna Shrivastava
- Web page: https://patentgrep.com/patent/US20230267364A1

## CPC

- G06N 20/00: Machine learning
- G06T 7/0004: {Industrial image inspection}
- F03D 17/00: Monitoring or testing of wind motors, e.g. diagnostics (testing during commissioning of wind motors F03D13/30)
- F03D 17/003: {characterised by using optical devices, e.g. lidar or cameras}
- F03D 17/007: {Wind farm monitoring}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/092: Reinforcement learning
- G06T 7/11: Region-based segmentation
- G06V 10/82: using neural networks
- G06V 20/17: taken from planes or by drones
- G06V 20/176: {Urban or other man-made structures}
- F03D 80/509: {Maintenance scheduling}
- G06N 3/02: Neural networks
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30108: Industrial image inspection
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- F03D: WIND MOTORS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An artificial intelligence (AI) ensemble engine analyzes a set of images that include a wind turbine and a region of a plant farm to identify potential problem areas in the wind turbine and the plant farm. The AI ensemble engine also analyzes the potential problem areas of the wind turbine and the plant farm to determine whether maintenance is warranted for the potential problem areas to provide a list of problem areas. A notification manager determines whether each problem area in the list of problem areas is related to a wind turbine or agriculture and generates a notification based on the determination.

## Claims

### Claim 1

A non-transitory machine readable medium having machine readable instructions, the machine readable instructions comprising:
an artificial intelligence (AI) ensemble engine that:
analyzes a set of images that include a wind turbine and a region of a plant farm to identify potential problem areas in the wind turbine and the plant farm; and
analyzes the potential problem areas of the wind turbine and the plant farm to determine whether maintenance is warranted for the potential problem areas to provide a list of problem areas; and
a notification manager that determines whether each problem area in the list of problem areas is related to a wind turbine or agriculture and generates a notification based on the determination.

### Claim 2 (depends on 1)

The medium of claim 1, wherein the notification manager provides the notification to a ticket generator interface in response to determining that a given problem area in the list of problem areas is related to a wind turbine, wherein the notification includes a location of the wind turbine extracted from a given image of the set of images that includes the wind turbine.

### Claim 3 (depends on 2)

The medium of claim 2, wherein the ticket generator interface generates a service ticket with an order to dispatch a maintenance crew in response to the notification.

### Claim 4 (depends on 2)

The medium of claim 2, wherein the given problem area is a crack in the wind turbine.

### Claim 5 (depends on 2)

The medium of claim 2, wherein the given problem area is a hot spot on the wind turbine.

### Claim 6 (depends on 1)

The medium of claim 1, wherein the notification manager provides a short message service (SMS) message and/or an email to an operator of a plant farm in response to determining that a given problem area in the list of problem areas is related to a plant farm, wherein the notification includes an image of the given problem area extracted from the set of images.

### Claim 7 (depends on 6)

The medium of claim 6, wherein the given problem area is a dead spot on the plant farm.

### Claim 8 (depends on 6)

The medium of claim 6, wherein the given problem area is an erosion region on the plant farm.

### Claim 9 (depends on 6)

The medium of claim 6, wherein the given problem area is a collapsed wind turbine.

### Claim 10 (depends on 1)

The medium of claim 1, wherein the set of images are captured by a drone surveying the wind turbine and the plant farm.

### Claim 11

A system for analyzing images comprising:
a drone that captures a set of images, the set of images including images of a wind turbine on a wind farm and images of a region of a plant farm proximal to the wind farm;
an artificial intelligence (AI) ensemble engine operating on one or more computing devices that:
analyzes the set of images to identify potential problem areas with the wind turbine and the plant farm; and
analyzes the potential problem areas of the wind turbine and the plant farm to determine whether maintenance is warranted for the potential problem areas to generate a list of problem areas; and
a notification manager operating on the one or more computing devices that determines whether each problem area in the list of problem areas is related to a wind turbine or agriculture and generates a notification based on the determination.

### Claim 12 (depends on 11)

The system of claim 11, wherein the notification manager provides the notification to a ticket generator interface in response to determining that a given problem area in the list of problem areas is related to a wind turbine, wherein the notification includes a location of the wind turbine extracted from a given image of the set of images that includes the wind turbine.

### Claim 13 (depends on 12)

The system of claim 12, wherein the ticket generator interface generates a service ticket with an order to dispatch a maintenance crew in response to the notification.

### Claim 14 (depends on 12)

The system of claim 12, wherein the given problem area is a crack in the wind turbine.

### Claim 15 (depends on 12)

The system of claim 12, wherein the given problem area is a hot spot on the wind turbine.

### Claim 16 (depends on 12)

The system of claim 12, wherein the notification manager provides a short message service (SMS) message and/or an email to an operator of a plant farm in response to determining that a given problem area in the list of problem areas is related to a plant farm, wherein the notification includes an image of the given problem area extracted from the set of images.

### Claim 17 (depends on 16)

The system of claim 16, wherein the given problem area is a dead spot on the plant farm.

### Claim 18 (depends on 16)

The system of claim 16, wherein the given problem area is an erosion region on the plant farm.

### Claim 19

A method for processing images comprising:
receiving, by an image processing system operating on one or more computing devices, a set of images captured by a drone surveying a wind farm with wind turbines and/or a plant farm;
identifying, by machine learning modules operating on the one or more computing devices, potential problem areas related to wind turbines or plant farms in the set of images, wherein the machine learning modules are trained to recognize features related to wind turbines and plant farms;
analyzing, by a feature analyzer operating on the one or more computing devices, the potential problem areas to determine problem areas related to the wind turbines and/or the plant farm; and
determining, by a notification manager operating on the one or more computing devices, a maintenance needed for each problem area.

### Claim 20 (depends on 19)

The method of claim 19, further comprising generating, by the notification manager, a notification that includes an image of the problem area and a location of the problem area.
