# US 2025/0148587 A1 · Techniques for detection of surface corrosion on infrastructure using a color channel-based classifier and deep learning model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148587 A1
- Document ID: US20250148587A1
- Status: Published application
- Kind: A1
- Application number: 19/014,726
- Filed: 2025-01-09
- Published: 2025-05-08
- Earliest claimed: 2022-01-11
- Assignees: Bentley Systems, Incorporated
- Applicants: Bentley Systems, Incorporated
- Inventors: Zheng Yi Wu; Atiqur Rahman; Rony Kalfarisi
- Web page: https://patentgrep.com/patent/US20250148587A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- G06T 7/11: Region-based segmentation
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20092: Interactive image processing based on input by user
- G06T 2207/30136: Metal
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In various example embodiments, techniques are provided for detecting surface corrosion on infrastructure. A training dataset that includes images of infrastructure that have at least some surface corrosion is received. A red-green-blue (RGB) color channel-based classifier is optimized, wherein the optimizing selects one or more color indices for pixels and determines one or more bounds for each of the selected color indices that indicate a pixel is a corrosion pixel or non-corrosion pixel. The optimized RGB color channel-based classifier is applied to the images to label corrosion segments in the images and produce a labeled training dataset with labeled corrosion segments. The labeled training dataset is used to train a semantic deep learning model to enable the semantic deep learning model to detect corrosion segments.

## Claims

### Claim 1

A method for detecting surface corrosion on infrastructure, comprising:
receiving a training dataset that includes a plurality of images of infrastructure that have at least some surface corrosion;
optimizing a red-green-blue (RGB) color channel-based classifier executing on one or more computing devices, wherein the optimizing selects one or more color indices for pixels and determines one or more bounds for each of the selected color indices that indicate a pixel is a corrosion pixel or non-corrosion pixel;
applying the optimized RGB color channel-based classifier to the plurality of images to label corrosion segments in the images and produce a labeled training dataset with labeled corrosion segments;
training a semantic deep learning model executing on the one or more computing devices using the labeled training dataset to enable the semantic deep learning model to detect corrosion segments;
applying the trained semantic deep learning model to an input dataset that includes one or more images of infrastructure that include at least some surface corrosion to label corrosion segments in the images of the input dataset and produce an output dataset with labeled corrosion segments; and
displaying in a user interface or storing to a memory/storage of the one or more computing devices indications of the labeled corrosion segments of the output dataset.

### Claim 2 (depends on 1)

The method of claim 1, wherein the applying the RGB color channel-based classifier to label corrosion segments further comprises:
classifying pixels of the images as corrosion pixels of a corrosion segment when values for the one or more color indices of the pixels are within the one or more bounds.

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more color indices include at least one color index selected from the group consisting of a blue index, a green index, an excessive blue index, an excessive green index, and an excessive red index.

### Claim 4 (depends on 1)

The method of claim 1, wherein the one or more color indices include at least one customized color index that includes a combination of user-specified color channels and coefficients.

### Claim 5 (depends on 1)

The method of claim 1, wherein the training dataset also includes a plurality of labeled images of infrastructure that have labeled corrosion segments, and the optimizing further comprises:
applying the RGB color channel-based classifier to the labeled images and searching for the one or more bounds for each of the selected color indices that provides an optimal classification of pixels.

### Claim 6 (depends on 5)

The method of claim 5, wherein the searching is performed by a genetic algorithm-based optimization framework executing on the one or more computing device.

### Claim 7 (depends on 1)

The method of claim 1, wherein the semantic deep learning model is a semantic segmentation-enabled convolutional neural network (CNN) model.

### Claim 8 (depends on 1)

The method of claim 1, wherein the training the semantic deep learning model further comprises:
minimizing a total loss function of the semantic deep learning model that weights together misclassification of corrosion pixels and misclassification of non-corrosion pixels.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
calculating a degree of corrosion index for labeled corrosion segments in the output dataset based on a mean grayscale value of pixels of the labeled corrosion segments.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
displaying in the user interface or storing to the memory/storage indications of the degree of corrosion index of the labeled corrosion segments in the output dataset.

### Claim 11

A method for detecting surface corrosion on infrastructure, comprising:
receiving a training dataset that includes a plurality of images of infrastructure that have at least some surface corrosion;
applying an optimized color channel-based classifier executing on one or more computing devices to the plurality of images to label corrosion segments in the images and produce a labeled training dataset with labeled corrosion segments, wherein the color channel-based classifier identifies pixels that have values for one or more color indices that are within one or more bounds to determine the corrosion segments;
training a semantic deep learning model executing on the one or more computing devices using the labeled training dataset to enable the semantic deep learning model to detect corrosion segments;
applying the trained semantic deep learning model to an input dataset that includes one or more images of infrastructure that include at least some surface corrosion to label corrosion segments in the images of the input dataset and produce an output dataset with labeled corrosion segments; and
displaying in a user interface or storing to a memory/storage of the one or more computing devices indications of the labeled corrosion segments of the output dataset.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
optimizing the color channel-based classifier, wherein the optimizing selects the one or more color indices and determines the one or more bounds.

### Claim 13 (depends on 11)

The method of claim 11, wherein the one or more color indices include at least one color index selected from the group consisting of a blue index, a green index, an excessive blue index, an excessive green index, and an excessive red index.

### Claim 14 (depends on 11)

The method of claim 11, wherein the one or more color indices include at least one customized color index that includes a combination of user-specified color channels and coefficients.

### Claim 15 (depends on 11)

The method of claim 11, wherein the training dataset also includes a plurality of labeled images of infrastructure that have labeled corrosion segments, and the method further comprises:
applying the color channel-based classifier to the labeled images and searching for the one or more bounds that provide an optimal classification of pixels.

### Claim 16 (depends on 15)

The method of claim 15, wherein the searching is performed by a genetic algorithm-based optimization framework executing on the one or more computing device.

### Claim 17 (depends on 11)

The method of claim 11, further comprising:
calculating a degree of corrosion index for the labeled corrosion segments in the output dataset based on a mean grayscale value of pixels of the labeled corrosion segments; and
displaying in the user interface or storing to the memory/storage indications of the degree of corrosion index of the labeled corrosion segments in the output dataset.

### Claim 18

A non-transitory electronic device readable medium having instructions stored thereon that when executed on one or more processors of one or more electronic devices are operable to:
receive a training dataset that includes a plurality of images of infrastructure of that have at least some surface corrosion;
optimize a color channel-based classifier by selecting one or more color indices for pixels and determining one or more bounds for each of the selected color indices that indicate a pixel is a corrosion pixel or non-corrosion pixel;
apply the optimized color channel-based classifier to the plurality of images to label corrosion segments in the images and produce a labeled training dataset with labeled corrosion segments, wherein the optimized color channel-based classifier identifies pixels that have value for one or more color indices that are within the one or more bounds as the corrosion segments;
train a model using the labeled training dataset to enable the model to detect corrosion segments; and
provide the trained model to detect surface corrosion in images of infrastructure.

### Claim 19 (depends on 18)

The non-transitory electronic device readable medium of claim 18, wherein the one or more color indices include at least one color index selected from the group consisting of a blue index, a green index, an excessive blue index, an excessive green index, an excessive red index, and a customized color index that includes a combination of user-specified color channels and coefficients.

### Claim 20 (depends on 18)

The non-transitory electronic device readable medium of claim 18, wherein the training dataset also includes a plurality of labeled images of infrastructure that include labeled corrosion segments and the instructions when executed on the one or more processors are further operable to:
apply the color channel-based classifier to the labeled images and search for the one or more bounds for each of the selected color indices that provides an optimal classification of pixels as corrosion or non-corrosion pixels.
