# US 2022/0044458 A1 · Information providing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044458 A1
- Document ID: US20220044458A1
- Status: Published application
- Kind: A1
- Application number: 17/433,461
- Filed: 2020-02-26
- Published: 2022-02-10
- Earliest claimed: 2019-02-27
- Assignees: Daikin Industries, Ltd.
- Applicants: Daikin Industries, Ltd.
- Inventors: Yoshinao INABA
- Web page: https://patentgrep.com/patent/US20220044458A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- G06T 11/26: Drawing of charts or graphs
- F24F 8/90: Cleaning of purification apparatus
- F24F 11/32: Responding to malfunctions or emergencies
- F24F 11/38: Failure diagnosis
- F24F 11/52: Indication arrangements, e.g. displays
- F24F 11/56: Remote control
- F24F 11/64: using pre-stored data
- F24F 11/89: Arrangement or mounting of control or safety devices
- F24F 13/22: Means for preventing condensation or evacuating condensate
- F24F 13/222: {for evacuating condensate}
- G01N 21/94: Investigating contamination, e.g. dust (G01N21/85 takes precedence)
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06V 10/56: relating to colour
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 2207/30108: Industrial image inspection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- F24F: AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING (removing dirt or fumes from areas where they are produced B08B15/00; vertical ducts for carrying away waste gases from buildings E04F17/02; tops for chimneys or ventilating shafts, terminals for flues F23L17/02)
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information providing system provides information relating to dirt in a drain pan of an air conditioner. The information providing system is provided with a computer which is connected to a camera and a user terminal. The computer acquires image data of a target object imaged by the camera, identifies a dirty region in the image data, creates dirt-related information in which the dirty region is highlighted in the image data, and outputs the dirt-related information to the user terminal.

## Claims

### Claim 1

An information providing system that provides information related to contamination of a drain pan of an air conditioner, the information providing system comprising:
a computer connected to a camera and a user terminal,
wherein the computer is configured to:
obtain image data of a subject captured by the camera;
convert the image data to image data from which a type of contamination is easily recognized;
find a contaminated region in the image data in accordance with the type of contamination based on a hue value of every pixel in the image data that is converted;
generate contamination-related information in which the contaminated region is highlighted in accordance with the type of contamination so that the type of contamination can be identified in the image data; and
output the contamination-related information to the user terminal.

### Claim 2 (depends on 1)

The information providing system according to claim 1, wherein the computer is configured to:
obtain first image data of a preceding time and second image data of a subsequent time after the preceding time;
find the contaminated region in the second image data;
generate the contamination-related information including the first image data and the second image data; and
highlight the contaminated region in the second image data in the contamination-related information.

### Claim 3 (depends on 2)

The information providing system according to claim 2, wherein the computer is configured to identify and highlight a type of contamination.

### Claim 4

(canceled)

### Claim 5 (depends on 3)

The information providing system according to claim 3, wherein the computer is configured to highlight the type of contamination to allow for identification by adjusting saturation.

### Claim 6 (depends on 1)

The information providing system according to claim 1, wherein the computer is configured to:
form a contamination chart indicating a change in a contaminant amount with respect to elapsed time based on image data of the subject captured at different times;
generate the contamination-related information including the contamination chart and a threshold value of the contaminant amount indicating when to perform cleaning; and
highlight a time point at which the contaminant amount reaches the threshold value of the contamination in the contamination chart.

### Claim 7

An information providing system that provides information related to contamination of a drain pan of an air conditioner, the information providing system comprising:
a computer connected to a camera and a user terminal,
wherein the computer is configured to:
obtain image data of a subject captured by the camera;
find a contaminated region in the image data;
generate contamination-related information in which the contaminated region is highlighted in the image data;
calculate a failure probability in a predetermined future period based on the image data of the subject;
generate the contamination-related information including the failure probability and
in which the failure probability is highlighted when the failure probability is greater than a predetermined probability; and
output the contamination-related information to the user terminal.

### Claim 8

An information providing system that provides information related to contamination of a drain pan of an air conditioner, the information providing system comprising:
a computer connected to a camera and a user terminal,
wherein the computer is configured to:
obtain image data of a subject captured by the camera;
find a contaminated region in the image data;
generate contamination-related information in which the contaminated region is highlighted in the image data;
calculate an air pollution level in a predetermined future period based on the image data of the subject;
generate the contamination-related information including the air pollution level and
in which the air pollution level is highlighted when the air pollution level is greater than an upper limit value; and
output the contamination-related information to the user terminal.

### Claim 9 (depends on 6)

The information providing system according to claim 6, wherein the computer is configured to:
obtain image data of an additional subject, which differs from the subject, captured by a camera;
form a contamination chart indicating a change in a contaminant amount with respect to elapsed time based on image data of the additional subject captured at different times;
generate the contamination-related information including a chart that shows both of the contamination chart for the subject and the contamination chart for the additional subject with a common time axis; and
highlight the contamination chart for the subject in the contamination-related information.

### Claim 10

An information providing system that provides information related to contamination of a drain pan of an air conditioner, the information providing system comprising:
a computer connected to a camera and a user terminal,
wherein the computer is configured to:
obtain image data of a subject captured by the camera;
convert the image data to image data of HSV format;
find a contaminated region in the image data in accordance with the type of contamination based on a hue value of every pixel in the image data that is converted;
generate contamination-related information in which the contaminated region is highlighted in accordance with the type of contamination so that the type of contamination can be identified in the image data; and
output the contamination-related information to the user terminal.

### Claim 11 (depends on 10)

The information providing system according to claim 10, wherein the computer is configured to:
obtain first image data of a preceding time and second image data of a subsequent time after the preceding time;
find the contaminated region in the second image data;
generate the contamination-related information including the first image data and the second image data; and
highlight the contaminated region in the second image data in the contamination-related information.

### Claim 12 (depends on 11)

The information providing system according to claim 11, wherein the computer is configured to identify and highlight a type of contamination.

### Claim 13 (depends on 12)

The information providing system according to claim 12, wherein the computer is configured to highlight the type of contamination to allow for identification by adjusting saturation.

### Claim 14 (depends on 10)

The information providing system according to claim 10, wherein the computer is configured to:
form a contamination chart indicating a change in a contaminant amount with respect to elapsed time based on image data of the subject captured at different times;
generate the contamination-related information including the contamination chart and a threshold value of the contaminant amount indicating when to perform cleaning; and
highlight a time point at which the contaminant amount reaches the threshold value of the contamination in the contamination chart.

### Claim 15 (depends on 14)

The information providing system according to claim 14, wherein the computer is configured to:
obtain image data of an additional subject, which differs from the subject, captured by a camera;
form a contamination chart indicating a change in a contaminant amount with respect to elapsed time based on image data of the additional subject captured at different times;
generate the contamination-related information including a chart that shows both of the contamination chart for the subject and the contamination chart for the additional subject with a common time axis; and
highlight the contamination chart for the subject in the contamination-related information.
