# US 2018/0027145 A1 · Image-based field boundary detection and identification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0027145 A1
- Document ID: US20180027145A1
- Status: Published application
- Kind: A1
- Application number: 15/659,442
- Filed: 2017-07-25
- Published: 2018-01-25
- Earliest claimed: 2016-07-25
- Assignees: Iteris, Inc.
- Applicants: Iteris, Inc.
- Inventors: ALEX A. KURZHANSKIY; JOHN J. MEWES; THOMAS N. BLAIR; DUSTIN M. SALENTINY
- Web page: https://patentgrep.com/patent/US20180027145A1

## CPC

- G06V 20/13: Satellite images
- G06T 5/70: Denoising; Smoothing
- G06T 7/12: Edge-based segmentation
- G06T 11/65: on geographic maps
- H04N 1/3873: {defined only by a limited number of coordinate points or parameters, e.g. corners, centre; for trimming}
- G06T 2207/10024: Color image
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20032: Median filtering
- G06T 2207/20101: Interactive definition of point of interest, landmark or seed
- G06T 2207/20152: Watershed segmentation
- G06T 2207/30188: Vegetation; Agriculture
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/267: {by performing operations on regions, e.g. growing, shrinking or watersheds}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Detection and identification a field's boundaries is performed in a workflow based on processing images of the field captured at different times, relative to a defined seed point. Images are clipped to align with the seed point and a bounding box around the seed point, and a mask is built by extracting edges of the field from the images. The workflow floods an area around the seed point that has pixels of a similar color, using the mask as an initial boundary. The flooded area is compared to threshold parameter values, which are tuned to refine the identified boundary. Flooded areas in multiple images are combined, and a boundary is built based on the combined flooded set. Manual, interactive tuning of floodfill areas allows for a separate boundary detection and identification workflow or for refinement of the automatic boundary detection workflow.

## Claims

### Claim 1

A method of detecting and identifying a boundary of a field, comprising:
defining positional coordinates of a seed point in a particular field, and a first bounding box around the seed point;
obtaining one or more images that include the first bounding box around the seed point;
clipping the one or more images so that pixels in each image in the one or more images refer to positional coordinates of the first bounding box;
building a mask for a boundary of the particular field by identifying one or more edges of the particular field from the one or more images;
filling an area around the seed point and within the mask that has pixels of a similar color to pixels representing the seed point in each image in the one or more images;
checking the filled area around the seed point by a) defining a second boundary box for the filled area, b) determining whether threshold parameter values representing upper and lower distances from a pixel brightness of the seed point are satisfied in the second boundary box for the filled area, and c) tuning the threshold parameters values where the pixel brightness is outside the threshold parameter values to adjust the filled area;
combining, for each image, the filled area into a combined flooded set;
computing a boundary around the combined flooded set; and
translating the boundary in the combined flooded set to positional coordinates in the particular field.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more images are obtained from at least one of satellites, field-based robots, aircraft, and remotely-piloted vehicles.

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more images represent the same location captured at different times, over a period of time spanning either a current season or over multiple years.

### Claim 4 (depends on 3)

The method of claim 3, further comprising creating an average image from the one or more images by computing average pixel color, and smoothing each image to eliminate small-scale noise.

### Claim 5 (depends on 1)

The method of claim 1, further comprising matching the seed point with the one or more images.

### Claim 6 (depends on 1)

The method of claim 1, further comprising interactively tuning the boundary in the combined flooded set by selecting a wrongly-filled area in the one or more images, and determining whether the wrongly-filled area is inside the boundary.

### Claim 7 (depends on 6)

The method of claim 6, further comprising creating an augmented mask with one or more points known to be inside the actual boundary where the wrongly-filled area is inside the boundary and the wrongly-filled area is maintained as outside an actual boundary, re-filling the area around the seed point using the augmented mask, and subtracting a re-filled combined flooded set from the existing combined flooded set, and calculating a revised boundary of the particular field.

### Claim 8 (depends on 6)

The method of claim 6, further comprising creating an augmented mask with one or more points known to be outside the actual boundary, and adding the bounding box, where the wrongly-filled area is outside the boundary and the wrongly-filled area is maintained as inside an actual boundary, and the method, re-filling the area around the seed point using the augmented mask, and adding a re-filled combined flooded set to the existing combined flooded set, and calculating a revised boundary of the particular field.

### Claim 9 (depends on 6)

The method of claim 6, further comprising straightening the boundary by one or more of selecting two different boundary points, and selecting a position near the boundary.

### Claim 10

A method, comprising:
identifying 1) a seed point representing a particular field, and 2) a bounding box around the seed point, the bounding box having a plurality of threshold parameters defining a pixel brightness relative to pixels representing the seed point, and one or more images of the particular field that include bounding box and the seed point;
analyzing the input data in a plurality of data processing modules within a computing environment in which the plurality of data processing modules are executed in conjunction with at least one processor, the data processing modules configured to detect and identify a boundary of the particular field, by:
modifying the one or more images so that pixels in each image in the one or more images refer to positional coordinates of the bounding box,
detecting one or more edges of the particular to create a mask for a boundary of the particular field,
performing a floodfill operation to flood an area around the seed point within the mask, that has pixels of a similar color to pixels representing the seed point in each image in the one or more images,
comparing pixel brightness of the flooded area with the plurality of threshold parameters, and tuning values in the plurality of threshold parameters representing upper and lower distances from a pixel brightness of the seed point where the pixel brightness exceeds the values to adjust the size of the flooded area,
creating a combined flooded set from the flooded areas in each image,
applying an alpha-shape operation to build a boundary around the combined flooded fill set; and
generating, as output data, a set of positional coordinates representing the boundary of the particular field.

### Claim 11 (depends on 10)

The method of claim 10, wherein the one or more images are obtained from at least one of satellites, field-based robots, aircraft, and remotely-piloted vehicles.

### Claim 12 (depends on 10)

The method of claim 10, wherein the one or more images represent the same location captured at different times, over a period of time spanning either a current season or over multiple years.

### Claim 13 (depends on 10)

The method of claim 10, further comprising creating an average image from the one or more images by computing average pixel color, and applying a median filter to eliminate small-scale noise in each image.

### Claim 14 (depends on 10)

The method of claim 10, further comprising matching the at least one seed point with the one or more images.

### Claim 15 (depends on 10)

The method of claim 10, further comprising interactively tuning the boundary in the combined flooded set by selecting a wrongly-filled area in the one or more images, and determining whether the wrongly-filled area is inside the boundary.

### Claim 16 (depends on 15)

The method of claim 15, further comprising creating an augmented mask with one or more points known to be inside the actual boundary where the wrongly-filled area is inside the boundary and the wrongly-filled area is maintained as outside an actual boundary, re-filling the area around the seed point using the augmented mask, and subtracting a re-filled combined flooded set from the existing combined flooded set, and calculating a revised boundary of the particular field.

### Claim 17 (depends on 15)

The method of claim 15, further comprising creating an augmented mask with one or more points known to be outside the actual boundary, and adding the bounding box, where the wrongly-filled area is outside the boundary and the wrongly-filled area is maintained as inside an actual boundary, and the method, re-filling the area around the seed point using the augmented mask, and adding a re-filled combined flooded set to the existing combined flooded set, and calculating a revised boundary of the particular field.

### Claim 18 (depends on 15)

The method of claim 15, further comprising straightening the boundary by one or more of selecting two different boundary points, and by electing a position near the boundary.

### Claim 19

A system, comprising:
a computing environment including at least one computer-readable storage medium having program instructions stored therein and a computer processor operable to execute the program instructions to perform an image-based field boundary detection in a particular field within a plurality of data processing modules, the plurality of data processing modules including:
a data identification component configured to determine 1) a seed point representing a particular field, and 2) a bounding box around the seed point, the bounding box having a plurality of threshold parameters defining a pixel brightness relative to pixels representing the seed point;
an image retrieval component, configured to obtain one or more images of the particular field that include bounding box and the seed point;
a plurality of data processing modules configured to detect and identify a boundary of the particular field based on the seed point from the one or images, the plurality of data processing modules configured to:
modify the one or more images so that pixels in each image in the one or more images refer to positional coordinates of the bounding box,
detect one or more edges of the particular to create mask for a boundary of the particular field,
perform a floodfill operation to flood an area around the seed point that has pixels of a similar color to pixels representing the seed point in each image in the one or more images,
compare pixel brightness of the flooded area around the seed point with the plurality of threshold parameters, and tuning values in the plurality of threshold parameters representing upper and lower distances from a pixel brightness of the seed point where the pixel brightness exceeds the values to adjust a size of the flooded area,
create a combined flooded set from the flooded areas in each image,
apply an alpha-shape operation to build a boundary around the combined flooded fill set; and
a translation module configured to generate a set of positional coordinates representing the boundary of the particular field.

### Claim 20 (depends on 19)

The system of claim 19, wherein the one or more images are obtained from at least one of satellites, field-based robots, aircraft, and remotely-piloted vehicles.

### Claim 21 (depends on 19)

The system of claim 19, wherein the one or more images represent the same location captured at different times, over a period of time spanning either a current season or over multiple years.

### Claim 22 (depends on 19)

The system of claim 19, wherein the data processing modules are further configured to create an average image from the one or more images by computing average pixel color, and apply a median filter to eliminate small-scale noise in each image.

### Claim 23 (depends on 19)

The system of claim 19, wherein the data processing modules are further configured to match the at least one seed point with the one or more images.

### Claim 24 (depends on 19)

The system of claim 19, wherein the data processing modules are further configured to interactively tune the boundary in the combined flooded set by selecting a wrongly-filled area in the one or more images, and determining whether the wrongly-filled area is inside the boundary.

### Claim 25 (depends on 24)

The system of claim 24, wherein the data processing modules are further configured to create an augmented mask with one or more points known to be inside the actual boundary where the wrongly-filled area is inside the boundary and the wrongly-filled area is maintained as outside an actual boundary, re-filling the area around the seed point using the augmented mask, and subtracting a re-filled combined flooded set from the existing combined flooded set, and calculating a revised boundary of the particular field.

### Claim 26 (depends on 24)

The system of claim 24, wherein the data processing modules are further configured to create an augmented mask with one or more points known to be outside the actual boundary, and adding the bounding box, where the wrongly-filled area is outside the boundary and the wrongly-filled area is maintained as inside an actual boundary, and the method, re-filling the area around the seed point using the augmented mask, and adding a re-filled combined flooded set to the existing combined flooded set, and calculating a revised boundary of the particular field.

### Claim 27 (depends on 24)

The system of claim 24, wherein the data processing modules are further configured to straighten the boundary by one or more of selecting two different boundary points, and by electing a position near the boundary.

### Claim 28 (depends on 27)

The system of claim 27, wherein the data processing modules are further configured to further deciding which boundary points are used for straightening the boundary based on user interaction with the one or more images.
