# US 2021/0174055 A1 · Ponding water detection on satellite imagery

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174055 A1
- Document ID: US20210174055A1
- Status: Published application
- Kind: A1
- Application number: 17/174,164
- Filed: 2021-02-11
- Published: 2021-06-10
- Earliest claimed: 2015-09-21
- Assignees: Climate LLC
- Applicants: The Climate Corporation
- Inventors: Wei GUAN; Pramithus KHADKA
- Web page: https://patentgrep.com/patent/US20210174055A1

## CPC

- G06V 20/188: {Vegetation}
- A01G 7/00: Botany in general
- G06T 3/06: Topological mapping of higher dimensional structures onto lower dimensional surfaces
- G06T 7/00: Image analysis
- G06V 20/194: {using hyperspectral data, i.e. more or other wavelengths than RGB}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A01G: HORTICULTURE; CULTIVATION OF VEGETABLES, FLOWERS, RICE, FRUIT, VINES, HOPS OR SEAWEED; FORESTRY; WATERING (picking of fruits, vegetables, hops or the like A01D46/00; propagating unicellular algae C12N1/12)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system for identifying ponding water located on a field from image data is described. In an approach, an image of an agricultural field is analyzed using a classifier that has been trained based on the spectral bands of labeled image pixels to identify a probability for each pixel within the image that the pixel corresponds to water. A flow simulation is performed to determine regions of the field that are likely to pool water after rainfall based on precipitation data, elevation data, and soil property data of the field. A graph of vertices representing the pixels and edges representing connections between neighboring pixels is generated. The probability of each pixel within the graph being ponding water is set based on the probability pixel being water, the likelihood that water will pool in the area represented by the pixel, the probability of neighboring pixels being ponding water, and a cropland mask that identifies which pixels correspond to cropland. A class for each pixel is then determined that maximizes the joint probability over the graph.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A method comprising:
a computer system receiving image data of a field comprising a plurality of pixels, precipitation data for the plurality of pixels of the image data of the field indicating one or more amounts of rainfall over one or more regions of the field, elevation data indicating one or more elevations over the one or more regions of the field, and soil property data indicating one or more properties of soil found across the one or more regions of the field;
the computer system running a flow simulation over the plurality of pixels of the image data of the field to identify, using regions of a plurality of regions which still contain water, a set of pixels within the image data that are likely to have ponding water after rainfall;
for each pixel, from the set of pixels within the plurality of pixels:
determining, based on a probability assigned to the pixel and particular precipitation data, from the precipitation data, assigned to the pixel, a class, from one or more classes, to indicate the probability that the pixel represents ponding water after the rainfall;
wherein determining the class for each pixel of the plurality of pixels includes:
generating a model, wherein the model includes a graph comprising a set of vertices, each vertex in the set of vertices representing a respective pixel of the plurality of pixels, and a set of edges representing connections between neighboring pixels of the plurality of pixels;
for each vertex in the set of vertices, setting a probability of being ponding water based on one or more light bands for the pixel represented by the vertex, a probability of representing water for the pixel represented by the vertex, whether the pixel represented by the vertex is in the set of pixels that are likely to have ponding water, and a probability of neighboring pixels of the pixel represented by the vertex being ponding water;
determining the class for each vertex in the set of vertices that maximizes a joint probability over the graph;
generating one or more alerts corresponding to the one or more classes determined for the set of pixels.

### Claim 22 (depends on 21)

The method of claim 21, wherein a region of the plurality of regions of the field corresponds to a portion of a satellite image provided for the field; further comprising: initializing a water level for each region of a plurality of regions of the field is performed based on the precipitation data.

### Claim 23 (depends on 22)

The method of claim 22, wherein the running a flow simulation over the plurality of pixels of the image data of the field comprises:
initializing a water level for each region of the plurality of regions of the field;
iteratively rebalancing water levels between the plurality of regions;
wherein at each iteration water flows from higher elevation regions to neighboring lower elevation regions based on the elevation data until a stopping condition occurs;
wherein the stopping condition occurs when less than a threshold amount of water has shifted from the higher elevation regions to the neighboring lower elevation regions during a previous iteration;
wherein as water flows from the higher elevation regions to the neighboring lower elevation regions an amount of water is removed by being absorbed by soil based on the soil property data;
after iteratively rebalancing the water levels between the plurality of regions of the field, identifying, using regions of the plurality of regions which still contain water, a set of pixels within the image data that are likely to have ponding water after the rainfall.

### Claim 24 (depends on 23)

The method of claim 23, further comprising: training a classifier, which is a logistic regression, based on labeled pixel data derived from one or more images of one or more agricultural fields.

### Claim 25 (depends on 24)

The method of claim 24, wherein each pixel of the plurality of pixels comprises the one or more light bands.

### Claim 26 (depends on 25)

The method of claim 25, wherein the model is implemented using a Markov Random Field.

### Claim 27 (depends on 25)

The method of claim 25, wherein the model increases the probability of being ponding water for a given vertex when the probability of representing water for the pixel represented by the given vertex indicates that the pixel represented by the given vertex likely represents water and the pixel represented by the given vertex is in the set of pixels that are likely to have ponding water.

### Claim 28 (depends on 25)

The method of claim 25, further comprising receiving cropland data that indicates which pixels of the plurality of pixels corresponds to cropland, wherein the model classifies the pixel represented by a given vertex as not ponding water if the cropland data indicates that the pixel represented by the given vertex does not correspond to cropland.

### Claim 29 (depends on 25)

The method of claim 25, wherein generating the one or more alerts includes sending a message to a user device that specifies ponding water has been detected on the field and one or more locations where the ponding water has been detected based on pixels which have been classified as representing the ponding water.

### Claim 30 (depends on 25)

The method of claim 25, wherein generating the one or more alerts includes identifying a shortest route to visit each area on the field corresponding to pixels which have been classified as representing ponding water.

### Claim 31

A non-transitory computer-readable storage medium storing one or more instructions which, when executed by one or more processors, cause the one or more processors to perform:
receiving image data of a field comprising a plurality of pixels, precipitation data for the plurality of pixels of the image data of the field indicating one or more amounts of rainfall over one or more regions of the field, elevation data indicating one or more elevations over the one or more regions of the field, and soil property data indicating one or more properties of soil found across the one or more regions of the field;
running a flow simulation over the plurality of pixels of the image data of the field to identify, using regions of a plurality of regions which still contain water, a set of pixels within the image data that are likely to have ponding water after rainfall;
for each pixel, from the set of pixels within the plurality of pixels:
determining, based on a probability assigned to the pixel and particular precipitation data, from the precipitation data, assigned to the pixel, a class, from one or more classes, to indicate the probability that the pixel represents ponding water after the rainfall;
wherein determining the class for each pixel of the plurality of pixels includes:
generating a model, wherein the model includes a graph comprising a set of vertices, each vertex in the set of vertices representing a respective pixel of the plurality of pixels, and a set of edges representing connections between neighboring pixels of the plurality of pixels;
for each vertex in the set of vertices, setting a probability of being ponding water based on one or more light bands for the pixel represented by the vertex, a probability of representing water for the pixel represented by the vertex, whether the pixel represented by the vertex is in the set of pixels that are likely to have ponding water, and a probability of neighboring pixels of the pixel represented by the vertex being ponding water;
determining the class for each vertex in the set of vertices that maximizes a joint probability over the graph;
generating one or more alerts corresponding to the one or more classes determined for the set of pixels.

### Claim 32 (depends on 31)

The non-transitory computer-readable storage medium of claim 31, wherein a region of the plurality of regions of the field corresponds to a portion of a satellite image provided for the field;
wherein the non-transitory computer-readable storage medium stores additional instructions for: initializing a water level for each region of a plurality of regions of the field is performed based on the precipitation data.

### Claim 33 (depends on 32)

The non-transitory computer-readable storage medium of claim 32, wherein the running a flow simulation over the plurality of pixels of the image data of the field comprises:
initializing a water level for each region of the plurality of regions of the field;
iteratively rebalancing water levels between the plurality of regions;
wherein at each iteration water flows from higher elevation regions to neighboring lower elevation regions based on the elevation data until a stopping condition occurs;
wherein the stopping condition occurs when less than a threshold amount of water has shifted from the higher elevation regions to the neighboring lower elevation regions during a previous iteration;
wherein as water flows from the higher elevation regions to the neighboring lower elevation regions an amount of water is removed by being absorbed by soil based on the soil property data;
after iteratively rebalancing the water levels between the plurality of regions of the field, identifying, using regions of the plurality of regions which still contain water, a set of pixels within the image data that are likely to have ponding water after the rainfall.

### Claim 34 (depends on 33)

The non-transitory computer-readable storage medium of claim 33, storing additional instructions for: training a classifier, which is a logistic regression, based on labeled pixel data derived from one or more images of one or more agricultural fields.

### Claim 35 (depends on 34)

The non-transitory computer-readable storage medium of claim 34, wherein each pixel of the plurality of pixels comprises the one or more light bands.

### Claim 36 (depends on 35)

The non-transitory computer-readable storage medium of claim 35, wherein the model is implemented using a Markov Random Field.

### Claim 37 (depends on 35)

The non-transitory computer-readable storage medium of claim 35, wherein the model increases the probability of being ponding water for a given vertex when the probability of representing water for the pixel represented by the given vertex indicates that the pixel represented by the given vertex likely represents water and the pixel represented by the given vertex is in the set of pixels that are likely to have ponding water.

### Claim 38 (depends on 35)

The non-transitory computer-readable storage medium of claim 35, storing additional instructions for: receiving cropland data that indicates which pixels of the plurality of pixels corresponds to cropland, wherein the model classifies the pixel represented by a given vertex as not ponding water if the cropland data indicates that the pixel represented by the given vertex does not correspond to cropland.

### Claim 39 (depends on 35)

The non-transitory computer-readable storage medium of claim 35, wherein generating the one or more alerts includes sending a message to a user device that specifies ponding water has been detected on the field and one or more locations where the ponding water has been detected based on pixels which have been classified as representing the ponding water.

### Claim 40 (depends on 35)

The non-transitory computer-readable storage medium of claim 35, wherein generating the one or more alerts includes identifying a shortest route to visit each area on the field corresponding to pixels which have been classified as representing ponding water.
