US 11,892,184 B2Granted

Facility apparatus control device and facility apparatus control method

AssigneeMitsubishi Electric Corporation

InventorSatoshi Nakano

Life of this patent

Estimating the term…

Loading patent…

Abstract

A facility apparatus control device includes: first and second image capturing units capturing images of first and second spaces; a data-for-learning generator generating location information on a person in the first space by analyzing a first image captured and extracting therefrom, an image of a range including the person in the first space; a learning unit learning, using the location information and a first extracted image extracted by the data-for-learning generator, a feature of the person in the first space and a staying location of the person in the first space; a person detector detecting a person in the second space by analyzing a second image captured and extracting therefrom, an image of a range including the detected person; and an apparatus controller controlling a facility apparatus installed in the first space using a second extracted image extracted by the person detector and a learned result of the learning unit.

Claims8

Dependent claims

A facility apparatus control device comprising:

a first image capturing device that captures an image of a first space;
a second image capturing device that captures an image of a second space that does not entirely encompass and is not entirely encompassed by the first space;
a data-for-learning generating circuit that
generates location information on a person present in the first space by analyzing a first image and
extracts, from the first image, an image of a determined range covering the person present in the first space, the first image being an image captured by the first image capturing device;
a learning circuit that learns, using the location information generated by the data-for-learning generating circuit and a first extracted image,
a feature of the person present in the first space and
a staying location occupied by the person present in the first space, the first extracted image being an image extracted by the data-for-learning generating circuit;
a person detecting circuit that
detects a person present in the second space by analyzing a second image and
extracts, from the second image, an image of a determined range covering the detected person, the second image being an image captured by the second image capturing device;
and
an apparatus control circuit that controls a facility apparatus installed in the first space with use of the second extracted image and a learned result obtained by the learning circuit, the second extracted image being an image extracted by the person detecting circuit, wherein
the learned result obtained by the learning circuit and used by the apparatus control circuit includes the feature of the person present in the first space and the staying location occupied by the person present in the first space.

11 more elements

A facility apparatus control method comprising:

a first image capturing step of capturing an image of a first space by a facility apparatus control device;
a data-for-learning generating step of, by the facility apparatus control device,
generating location information on a person present in the first space by analyzing a first image and
extracting, from the first image, an image of a determined range covering the person present in the first space, the first image being an image captured at the first image capturing step;
a learning step of, by the facility apparatus control device, learning, with use of the location information generated at the data-for-learning generating step and a first extracted image,
a feature of the person present in the first space and
a staying location occupied by the person present in the first space, the first extracted image being an image extracted at the data-for-learning generating step;
a second image capturing step of capturing an image of a second space by the facility apparatus control device, the second space not entirely encompassing and not entirely being encompassed by the first space;
a person detecting step of, by the facility apparatus control device,
detecting a person present in the second space by analyzing a second image and
extracting, from the second image, an image of a determined range including the detected person, the second image being an image captured at the second image capturing step;
and
an apparatus controlling step of, by the facility apparatus control device, controlling a facility apparatus installed in the first space with use of a second extracted image and a learned result obtained at the learning step, the second extracted image being an image extracted at the person detecting step, wherein
the learned result obtained in the learning step and used in the apparatus controlling step includes the feature of the person present in the first space and the staying location occupied by the person present in the first space.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/289,140Filed 3 Dec 2018
Published: US 2021/0381710 A19 Dec 2021
Granted: 6 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

F24F 11/63
Characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values: electronic…
G06V 20/52
Context or environment of the image: surveillance or monitoring of activities, e.g. for recognising suspicious objects
F24F 11/58
Remote control: using Internet communication
G06N 20/00
Machine learning