# US 12,010,409 B2 · Camera view port dedicated self cleaning cycles

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,409 B2
- Document ID: US12010409B2
- Status: Granted
- Kind: B2
- Application number: 17/559,008
- Filed: 2021-12-22
- Published: 2023-06-22
- Granted: 2024-06-11
- Earliest claimed: 2021-12-22
- Assignees: Whirlpool Corporation
- Applicants: Whirlpool Corporation
- Inventors: Margherita Basso; Luca Distaso
- Web page: https://patentgrep.com/patent/US12010409B2

## CPC

- H04N 23/52: Elements optimising image sensor operation, e.g. for electromagnetic interference [EMI] protection or temperature control by heat transfer or cooling elements
- F24C 7/085: {on baking ovens}
- F24C 14/02: pyrolytic type
- G01J 5/0044: {Furnaces, ovens, kilns (G01J5/0007, G01J5/004 take precedence)}
- G01J 5/026: {Control of working procedures of a pyrometer, other than calibration; Bandwidth calculation; Gain control}
- G01J 5/0859: {Sighting arrangements, e.g. cameras}
- G01J 5/0875: Windows; Arrangements for fastening thereof
- G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- H04N 7/183: {for receiving images from a single remote source}
- G01J 2005/0077: {Imaging}
- H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- F24C: DOMESTIC STOVES OR RANGES (exclusively for solid fuels F24B); DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A dedicated self-cleaning cycle for a camera for imaging a cavity of an oven is provided. An indication is received to perform a localized pyrolytic cycle to clean a view port glass protecting an image sensor of the camera from heat or detritus in the cavity of the oven. Responsive to the indication, a camera viewport heating element configured to provide localized heating to the view port glass is operated to perform the localized pyrolytic cycle. The camera is utilized to view the cavity of the oven.

## Claims

### Claim 1

A method for a dedicated self-cleaning cycle for a camera for imaging a cavity of an oven, comprising:
receiving a current image of the cavity from an image sensor of the camera;
using the current image to determine whether a view port glass protecting the image sensor of the camera from heat or detritus in the cavity of the oven requires cleaning to ensure visibility from the camera;
responsive to the current image indicating the view port glass requires cleaning, providing an indication to perform a localized pyrolytic cycle to clean the view port glass to ensure the camera has a clear view through the view port glass for operation of functions that require images from the camera;
responsive to the indication, operating a camera viewport heating element configured to provide localized heating to the view port glass to perform the localized pyrolytic cycle and refrain from using a main heating element to perform the full oven pyrolytic cycle; and
utilizing the camera to view the cavity of the oven.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
comparing the current image with a reference image of the cavity corresponding to a clean viewport glass to determine whether the view port glass is dirty and requires cleaning to ensure visibility from the camera, the comparing including counting pixels that differ between the current image and the reference image; and
providing the indication to perform the localized pyrolytic cycle responsive to the counted pixels that differ being greater than a threshold amount, to ensure the camera has a clear view through the view port glass for operation of functions that require images from the camera.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
periodically receiving further images of the cavity from the image sensor of the camera and comparing the further images with the reference image to determine whether the view port glass is dirty; and
completing the localized pyrolytic cycle by deactivating the camera viewport heating element responsive to the comparing indicating that at least one of the further images indicating that the view port glass is clean.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving a current image of the cavity from the image sensor of the camera;
utilizing a machine learning model to infer whether the current image corresponding to a clean viewport glass or a dirty viewport glass; and
providing the indication to perform the localized pyrolytic cycle responsive to the machine learning model indicating the view port glass is dirty.

### Claim 5 (depends on 4)

The method of claim 4, further comprising training the machine learning model using a dataset of images of oven cavities that have clean viewport glass and images of oven cavities that have dirty viewport glass.

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
periodically receiving further images of the cavity from the image sensor of the camera; and
completing the localized pyrolytic cycle by deactivating the camera viewport heating element responsive to the machine learning model indicating that at least one of the further images indicating that the view port glass is clean.

### Claim 7 (depends on 1)

The method of claim 1, wherein the camera viewport heating element is mounted in the cavity surrounding the view port glass, without obstructing a view of the image sensor into the cavity.

### Claim 8

A system for performing a dedicated self-cleaning cycle for a camera configured to image a cavity of an oven, comprising:
a camera including an image sensor and a view port glass configured to protect the image sensor of the camera from heat or detritus in the cavity of the oven;
a camera viewport heating element configured to provide localized heating to the view port glass of the camera;
a main heating element configured to perform a full oven pyrolytic cycle; and
a controller programmed to
receive a current image of the cavity from the image sensor of the camera,
use the current image to determine whether the view port glass requires cleaning to ensure visibility of the cavity by the image sensor of the camera,
responsive to the current image indicating the view port glass requires cleaning, provide an indication to perform a localized pyrolytic cycle to clean the view port glass to ensure the camera has a clear view through the view port glass for operation of functions that require images from the camera,
responsive to the indication, operate the camera viewport heating element to perform the localized pyrolytic cycle and refrain from using the main heating element to perform the full oven pyrolytic cycle, and
utilize the camera to view the cavity of the oven.

### Claim 9 (depends on 8)

The system of claim 8, wherein the controller is further programmed to:
compare the current image with a reference image of the cavity corresponding to a clean viewport glass to determine whether the view port glass is dirty and requires cleaning to ensure visibility from the camera, the compare including counting pixels that differ between the current image and the reference image; and
provide the indication to perform the localized pyrolytic cycle responsive to the counted pixels that differ being greater than a threshold amount, to ensure the camera has a clear view through the view port glass for operation of functions that require images from the camera.

### Claim 10 (depends on 9)

The system of claim 9, wherein the controller is further programmed to:
periodically receive further images of the cavity from the image sensor of the camera and comparing the further images with the reference image to determine whether the view port glass is dirty; and
complete the localized pyrolytic cycle by deactivating the camera viewport heating element responsive to the comparing indicating that at least one of the further images indicating that the view port glass is clean.

### Claim 11 (depends on 8)

The system of claim 8, wherein the controller is further programmed to:
receive a current image of the cavity from the image sensor of the camera;
utilize a machine learning model to infer whether the current image corresponding to a clean viewport glass or a dirty viewport glass; and
provide the indication to perform the localized pyrolytic cycle responsive to the machine learning model indicating the view port glass is dirty.

### Claim 12 (depends on 11)

The system of claim 11, wherein the controller is further programmed to train the machine learning model using a dataset of images of oven cavities that have clean viewport glass and images of oven cavities that have dirty viewport glass.

### Claim 13 (depends on 11)

The system of claim 11, wherein the controller is further programmed to:
periodically receive further images of the cavity from the image sensor of the camera; and
complete the localized pyrolytic cycle by deactivating the camera viewport heating element responsive to the machine learning model indicating that at least one of the further images indicating that the view port glass is clean.

### Claim 14 (depends on 8)

The system of claim 8, wherein the camera viewport heating element is mounted in the cavity surrounding the view port glass, without obstructing a view of the image sensor into the cavity.

### Claim 15

A non-transitory computer-readable medium comprising instructions for performing a dedicated self-cleaning cycle for a camera configured to image a cavity of an oven that, when executed by a controller, cause the controller to perform operations including to:
receive a current image of the cavity from an image sensor of the camera;
use the current image to determine whether a view port glass protecting the image sensor of the camera from heat or detritus in the cavity of the oven requires cleaning to ensure visibility of the cavity by the image sensor of the camera;
responsive to the current image indicating the view port glass requires cleaning, provide an indication to perform a localized pyrolytic cycle to clean the view port glass to ensure the camera has a clear view through the view port glass for operation of functions that require images from the camera,
responsive to the indication, operate a camera viewport heating element configured to provide localized heating to the view port glass to perform the localized pyrolytic cycle and refrain from using the main heating element to perform the full oven pyrolytic cycle; and
utilize the camera to view the cavity of the oven.

### Claim 16 (depends on 15)

The medium of claim 15, further comprising instructions that when executed by the controller, cause the controller to perform operations including to:
compare the current image with a reference image of the cavity corresponding to a clean viewport glass to determine whether the view port glass is dirty and requires cleaning to ensure visibility from the camera, the compare including counting pixels that differ between the current image and the reference image; and
provide the indication to perform the localized pyrolytic cycle responsive to the counted pixels that differ being greater than a threshold amount, to ensure the camera has a clear view through the view port glass for operation of functions that require images from the camera.

### Claim 17 (depends on 16)

The medium of claim 16, further comprising instructions that when executed by the controller, cause the controller to perform operations including to:
periodically receive further images of the cavity from the image sensor of the camera and comparing the further images with the reference image to determine whether the view port glass is dirty; and
complete the localized pyrolytic cycle by deactivating the camera viewport heating element responsive to the comparing indicating that at least one of the further images indicating that the view port glass is clean.

### Claim 18 (depends on 15)

The medium of claim 15, further comprising instructions that when executed by the controller, cause the controller to perform operations including to:
receive a current image of the cavity from the image sensor of the camera;
utilize a machine learning model to infer whether the current image corresponding to a clean viewport glass or a dirty viewport glass; and
provide the indication to perform the localized pyrolytic cycle responsive to the machine learning model indicating the view port glass is dirty.

### Claim 19 (depends on 18)

The medium of claim 18, further comprising instructions that when executed by the controller, cause the controller to perform operations including to train the machine learning model using a dataset of images of oven cavities that have clean viewport glass and images of oven cavities that have dirty viewport glass.

### Claim 20 (depends on 18)

The medium of claim 18, further comprising instructions that when executed by the controller, cause the controller to perform operations including to:
periodically receive further images of the cavity from the image sensor of the camera; and
complete the localized pyrolytic cycle by deactivating the camera viewport heating element responsive to the machine learning model indicating that at least one of the further images indicating that the view port glass is clean.
