# US 2025/0093065 A1 · Learning device, air conditioning control system, inference device, air conditioning control device, and trained model generation method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0093065 A1
- Document ID: US20250093065A1
- Status: Published application
- Kind: A1
- Application number: 18/724,374
- Filed: 2022-12-22
- Published: 2025-03-20
- Earliest claimed: 2022-01-05
- Assignees: Mitsubishi Electric Corporation
- Applicants: Mitsubishi Electric Corporation
- Inventors: Hajime IKEDA
- Web page: https://patentgrep.com/patent/US20250093065A1

## CPC

- F24F 11/64: using pre-stored data
- F24F 11/30: for purposes related to the operation of the system, e.g. for safety or monitoring
- F24F 11/46: Improving electric energy efficiency or saving
- F24F 11/62: characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
- F24F 11/63: Electronic processing
- F24F 11/74: for controlling air flow rate or air velocity
- F24F 11/79: for controlling the direction of the supplied air
- F24F 11/80: for controlling the temperature of the supplied air
- G06N 3/02: Neural networks
- G06N 20/00: Machine learning
- F24F 2110/10: Temperature
- F24F 2120/12: Position of occupants
- F24F: AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING (removing dirt or fumes from areas where they are produced B08B15/00; vertical ducts for carrying away waste gases from buildings E04F17/02; tops for chimneys or ventilating shafts, terminals for flues F23L17/02)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A simulator of a learning device simulates a thermal environment of an indoor space predicted to result from air conditioning of the indoor space by an air conditioner in a situation in which at least one of a state of a refrigeration cycle included in the air conditioner and a state of the indoor space is given. A reinforcement learner executes reinforcement learning that employs, as a reward, a value based on the thermal environment simulated by the simulator, and thereby generates a trained model aimed at inferring, from the at least one of the state of the refrigeration cycle and the state of the indoor space, a control value of the air conditioner.

## Claims

### Claim 1

A learning device, comprising:
processing circuitry to
simulate a thermal environment of an indoor space, the thermal environment being predicted to result from air conditioning of the indoor space by an air conditioner in a situation in which at least one of a state of a refrigeration cycle included in the air conditioner or a state of the indoor space is given, and
execute reinforcement learning that employs, as a reward, a value based on the stimulated thermal environment, and thereby generate a trained model aimed at inferring, from the at least one of the state of the refrigeration cycle or the state of the indoor space, a control value of the air conditioner, wherein
the processing circuitry simulates, as the thermal environment, air quality of the indoor space, and
executes the reinforcement learning, and thereby generates the trained model aimed at inferring, from the state of the indoor space, a timing of ventilating the indoor space.

### Claim 2 (depends on 1)

The learning device according to claim 1, wherein the processing circuitry simulates, using a simulation model for the refrigeration cycle generated based on specifications of the air conditioner, the thermal environment predicted to result from air conditioning of the indoor space by the air conditioner in a situation in which the state of the refrigeration cycle is given.

### Claim 3 (depends on 2)

The learning device according to claim 2, wherein the simulation model for the refrigeration cycle is a model aimed at calculating, based on a control value of the refrigeration cycle, an operation capacity of the air conditioner, and a volume and a temperature of air delivered from the air conditioner to the indoor space.

### Claim 4 (depends on 2)

The learning device according to claim 2, wherein
the processing circuitry generates, as the trained model, a refrigeration cycle control model for controlling the refrigeration cycle, and
the refrigeration cycle control model is a model aimed at inferring, from the state of the refrigeration cycle, a control value of the refrigeration cycle.

### Claim 5 (depends on 4)

The learning device according to claim 4, wherein
the air conditioner includes an indoor heat exchanger, an indoor fan, an outdoor heat exchanger, an outdoor fan, a compressor, and an expansion valve,
the state of the refrigeration cycle is defined by at least one of a temperature of the indoor heat exchanger, a temperature of the outdoor heat exchanger, a frequency of the compressor, an aperture of the expansion valve, or a discharge superheat temperature, and
the control value of the refrigeration cycle is a value for control of at least one of a rotational speed of the indoor fan, a rotational speed of the outdoor fan, the frequency of the compressor, or the aperture of the expansion valve.

### Claim 6 (depends on 1)

The learning device according to claim 1, wherein the processing circuitry simulates, using a simulation model for a temperature distribution in the indoor space, the thermal environment predicted to result from air conditioning of the indoor space by the air conditioner in a situation in which the state of the indoor space is given, the simulation model being generated based on specifications of the air conditioner, and dimensions and a heat insulation performance of the indoor space.

### Claim 7 (depends on 6)

The learning device according to claim 6, wherein the simulation model for the temperature distribution is a model aimed at calculating the temperature distribution, based on the dimensions and the heat insulation performance of the indoor space and a volume and a direction of air delivered from the air conditioner to the indoor space.

### Claim 8 (depends on 6)

The learning device according to claim 6, wherein
the processing circuitry means generates, as the trained model, an airflow control model for controlling airflow in the indoor space, and
the airflow control model is a model aimed at inferring, from the state of the indoor space, a control value of the airflow in the indoor space.

### Claim 9 (depends on 8)

The learning device according to claim 8, wherein
the state of the indoor space is defined by at least one of a direction of air delivered from the air conditioner to the indoor space, the temperature distribution in the indoor space, or a position of a user in the indoor space, and
the control value of the airflow is a value for control of at least one of a volume, the direction, or a temperature of the delivered air.

### Claim 10 (depends on 1)

The learning device according to claim 1 wherein
the processing circuitry
generates training data indicating a target value of the thermal environment, and
executes the reinforcement learning using the generated training data, and thereby generates the trained model.

### Claim 11 (depends on 10)

The learning device according to claim 10, wherein the training data indicates, as the target value, a chronological pattern of temperatures preferred by a user.

### Claim 12 (depends on 1)

The learning device according to claim 1,
wherein the processing circuitry corrects the trained model in response to an operation on the air conditioner, the operation being received from a user during air conditioning of the indoor space by the air conditioner in accordance with the control value inferred using the generated trained model.

### Claim 13

(canceled)

### Claim 14 (depends on 1)

The learning device according to claim 1, wherein
the processing circuitry
simulates, as the thermal environment, a variation in a temperature distribution in the indoor space caused by ventilation, and
executes the reinforcement learning, and thereby generates the trained model aimed at inferring, from the state of the indoor space, a timing of ventilating the indoor space.

### Claim 15 (depends on 1)

An air conditioning control system, comprising:
the learning device according to claim 1; and
an air conditioning control device to control the air conditioner, wherein
the air conditioning control device includes processing circuitry to
acquire state data indicating the at least one of the state of the refrigeration cycle included in the air conditioner or the state of the indoor space,
infer the control value from the acquired state data, using the trained model generated by the learning device, and
control the air conditioner in accordance with the inferred control value.

### Claim 16

An inference device, comprising:
processing circuitry to
acquire state data indicating a state of an indoor space, and
infer a timing of ventilating the indoor space from the acquired state data, using a trained model aimed at inferring the timing of ventilating the indoor space from the state of the indoor space, wherein
the trained model is a model generated by
simulating air quality of the indoor space, the air quality being predicted to result from air conditioning of the indoor space by an air conditioner in a situation in which the state of the indoor space is given, and
executing reinforcement learning that employs, as a reward, a value based on the simulated air quality.

### Claim 17 (depends on 16)

An air conditioning control device, comprising:
the inference device according to claim 16, wherein
the processing circuitry controls the air conditioner in accordance with the inferred timing of ventilating the indoor space.

### Claim 18

A method of generating a trained model, the method comprising:
simulating a thermal environment of an indoor space, the thermal environment being predicted to result from air conditioning of the indoor space by an air conditioner in a situation in which at least one of a state of a refrigeration cycle included in the air conditioner or a state of the indoor space is given; and
executing reinforcement learning that employs, as a reward, a value based on the simulated thermal environment, and thereby generating a trained model aimed at inferring, from the at least one of the state of the refrigeration cycle or the state of the indoor space, a control value of the air conditioner, wherein
simulating the thermal environment includes simulating, as the thermal environment, air quality of the indoor space, and
generating the trained model includes executing the reinforcement learning, and thereby generating the trained model aimed at inferring, from the state of the indoor space, a timing of ventilating the indoor space.

### Claim 19

(canceled)

### Claim 20

(canceled)
