# US 2023/0273069 A1 · System for Monitoring a Switchgear

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0273069 A1
- Document ID: US20230273069A1
- Status: Published application
- Kind: A1
- Application number: 18/175,656
- Filed: 2023-02-28
- Published: 2023-08-31
- Earliest claimed: 2022-02-28
- Assignees: ABB Schweiz AG
- Applicants: ABB Schweiz AG
- Inventors: Ralf Gitzel; Marcel Dix; Holger Kaul; Tomas Kozel
- Web page: https://patentgrep.com/patent/US20230273069A1

## CPC

- G01J 5/0096: {for measuring wires, electrical contacts or electronic systems}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G01J 5/0066: {for hot spots detection}
- G01J 5/48: Thermography; Techniques using wholly visual means
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/136: involving thresholding
- G06T 7/174: involving the use of two or more images
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 10/28: Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/82: using neural networks
- G01J 2005/0077: {Imaging}
- G06T 2207/10048: Infrared image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system and method for monitoring a switchgear includes an infrared camera, a processing unit, and an output unit. The infrared camera acquires an infrared image of the switchgear, and the processing unit converts it into a binary image. Pixels in the infrared image having a temperature equal to or above a first threshold value are given the same first value. Pixels in the infrared image having a temperature below the first threshold value are given the same second value. The processing unit is configured to implement a Siamese neural network to determine if a hot spot exists in the infrared image.

## Claims

### Claim 1

A system for monitoring a switchgear, the system comprising:
an infrared camera;
a processing unit; and
an output unit;
wherein, the infrared camera is configured to acquire an infrared image of the switchgear;
wherein the processing unit is configured to convert the infrared image into a binary image, wherein pixels in the infrared image having a temperature equal to or above a first threshold value are given the same first value and wherein pixels in the infrared image having a temperature below the first threshold value are given the same second value;
wherein the processing unit is configured to implement a Siamese neural network to determine if a hot spot exists in the infrared image, wherein the determination comprises analysis by the Siamese neural network of the binary image and a reference binary image, and wherein the reference binary image was generated from a reference infrared image of the switchgear or of a reference switchgear, and wherein pixels in the reference infrared image having a temperature equal to or above a second threshold value were given the same first value and wherein pixels in the reference infrared image having a temperature below the second threshold value were given the same second value to generate the reference binary image; and
wherein the output unit is configured to output an indication of a fault in the switchgear on the basis that a hot spot has been determined to exist in the infrared image.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the first threshold value is equal to the second threshold value.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the first threshold value is determined as a temperature in the infrared image that is a temperature range below a maximum temperature in the infrared image; and wherein the second threshold value is determined as a temperature in the reference infrared image that is a temperature range below a maximum temperature in the reference infrared image.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the first threshold value is determined as a temperature in the infrared image that results in a number of pixels in the infrared image having a temperature between the first threshold temperature in the infrared image and a maximum temperature in the infrared image that most closely matches a number less than a total number of pixels in the infrared image; and wherein the second threshold value is determined as a temperature in the reference infrared image that results in a number of pixels in the reference infrared image having a temperature between the second threshold temperature in the reference infrared image and a maximum temperature in the reference infrared image that most closely matches the number less than the total number of pixels in the infrared image.

### Claim 5 (depends on 1)

The system according to claim 1, wherein the first threshold value is determined as an average temperature in the infrared image; and wherein the second threshold value is determined as an average temperature in the reference infrared image.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the Siamese neural network is a trained Siamese neural network, and wherein training of the Siamese neural network comprised utilization of a plurality of synthetic binary images.

### Claim 7 (depends on 5)

The system according to claim 5, wherein the plurality of synthetic binary images was derived from a real infrared image.

### Claim 8 (depends on 7)

The system according to claim 7, wherein each of the plurality of synthetic binary images were derived from the real infrared image through random noise being added to a binary image generated from the real infrared image.

### Claim 9 (depends on 6)

The system according to claim 6, wherein the plurality of synthetic binary images was derived from an abstract synthetic binary image.

### Claim 10 (depends on 9)

The system according to claim 9, wherein each of the plurality of synthetic binary images were derived from the abstract synthetic binary image through random noise being added to the abstract synthetic binary image.

### Claim 11 (depends on 1)

The system according to claim 1, wherein one of the first value and the second value is 1 and other is 0.

### Claim 12 (depends on 1)

The system according to claim 1, wherein the system comprises a visible camera configured to acquire a visible image of the switchgear, and wherein the processing unit is configured to overlay a location of a determined hotspot in the infrared image onto a corresponding location in the visible image.

### Claim 13

A method for monitoring a switchgear, the method comprising:
acquiring with an infrared camera an infrared image of the switchgear;
converting by a processing unit the infrared image into a binary image, wherein pixels in the infrared image having a temperature equal to or above a first threshold value are given the same first value and wherein pixels in the infrared image having a temperature below the first threshold value are given the same second value;
implementing by the processing unit a Siamese neural network and determining if a hot spot exists in the infrared image, wherein the determining comprises analyzing by the Siamese neural network the binary image and a reference binary image, and wherein the reference binary image was generated from a reference infrared image of the switchgear or of a reference switchgear, and wherein pixels in the reference infrared image having a temperature equal to or above a second threshold value were given the same first value and wherein pixels in the reference infrared image having a temperature below the second threshold value were given the same second value to generate the reference binary image; and
outputting by an output unit an indication of a fault in the switchgear on the basis that a hot spot has been determined to exist in the infrared image.

### Claim 14 (depends on 13)

The method according to claim 13, wherein the first threshold value is equal to the second threshold value.

### Claim 15 (depends on 13)

The method according to claim 13, wherein the first threshold value is determined as a temperature in the infrared image that is a temperature range below a maximum temperature in the infrared image; and wherein the second threshold value is determined as a temperature in the reference infrared image that is a temperature range below a maximum temperature in the reference infrared image.

### Claim 16 (depends on 13)

The method according to claim 13, wherein the first threshold value is determined as a temperature in the infrared image that results in a number of pixels in the infrared image having a temperature between the first threshold temperature in the infrared image and a maximum temperature in the infrared image that most closely matches a number less than a total number of pixels in the infrared image; and wherein the second threshold value is determined as a temperature in the reference infrared image that results in a number of pixels in the reference infrared image having a temperature between the second threshold temperature in the reference infrared image and a maximum temperature in the reference infrared image that most closely matches the number less than the total number of pixels in the infrared image.

### Claim 17 (depends on 13)

The method according to claim 13, wherein the first threshold value is determined as an average temperature in the infrared image; and wherein the second threshold value is determined as an average temperature in the reference infrared image.

### Claim 18 (depends on 13)

The method according to claim 13, wherein the Siamese neural network is a trained Siamese neural network, and wherein training of the Siamese neural network comprised utilization of a plurality of synthetic binary images.

### Claim 19 (depends on 17)

The method according to claim 17, wherein the plurality of synthetic binary images was derived from a real infrared image.

### Claim 20 (depends on 19)

The method according to claim 19, wherein each of the plurality of synthetic binary images were derived from the real infrared image through random noise being added to a binary image generated from the real infrared image.
