# US 2019/0313948 A1 · Monitoring assistance system, control method thereof, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0313948 A1
- Document ID: US20190313948A1
- Status: Published application
- Kind: A1
- Application number: 16/461,253
- Filed: 2017-11-28
- Published: 2019-10-17
- Earliest claimed: 2017-03-02
- Assignees: OMRON Corporation
- Applicants: Omron Corporation
- Inventors: Jumpei Matsunaga; Kiyoaki Tanaka; Shinji Takahashi; Tatsuya Murakami
- Web page: https://patentgrep.com/patent/US20190313948A1

## CPC

- A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/1113: {Local tracking of patients, e.g. in a hospital or private home}
- A61G 7/05: Parts, details or accessories of beds (devices for prevention against falling out A47C21/08, A47D7/00 {; mattresses A47C27/00})
- A61G 12/00: Accommodation for nursing, e.g. in hospitals, not covered by groups A61G1/00 - A61G11/00, e.g. trolleys for transport of medicaments or food {(service or tea-tables, trolleys or wagons A47B31/00)}; Prescription lists
- G06T 7/00: Image analysis
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras}
- G08B 21/22: responsive to presence or absence of persons
- H04N 7/183: {for receiving images from a single remote source}
- A61B 5/1117: {Fall detection}
- A61B 5/746: {Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G08B 21/043: {detecting an emergency event, e.g. a fall}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 2201/0079: Medical imaging device
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61G: TRANSPORT, PERSONAL CONVEYANCES OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS (appliances for aiding patients or disabled persons to walk A61H3/00); OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES (embalming corpses A01N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A watching assistance system that assists watching over a subject on a bed includes an image acquisition unit configured to acquire an image captured by an imaging device, a criterion storage in which a criterion for determining a dangerous state are previously set for each of a plurality of determination regions set based on a region of the bed in the image, a detector configured to detect the subject from the image acquired by the image acquisition unit, a state recognition unit configured to recognize a state of the subject detected by the detector, a determination unit configured to determine a danger degree of the state of the subject recognized by the state recognition unit using the criterion for the determination region corresponding to a position at which the subject is detected by the detector, and an output unit configured to provide notification according to the danger degree determined by the determination unit.

## Claims

### Claim 1

A watching assistance system that assists watching over a subject on a bed, the watching assistance system comprising:
an image acquisition unit configured to acquire an image captured by an imaging device;
a criterion storage in which a criterion for determining a dangerous state is previously set for each of a plurality of determination regions set based on a region of the bed in the image;
a detector configured to detect the subject from the image acquired by the image acquisition unit;
a state recognition unit configured to recognize a state of a head of the subject including a head orientation of the subject detected by the detector;
a determination unit configured to determine a danger degree of the state of the head of the subject recognized by the state recognition unit using the criterion for the determination region corresponding to a position at which the subject is detected by the detector; and
an output unit configured to provide notification according to the danger degree determined by the determination unit.

### Claim at position 2

-3. (canceled)

### Claim 4 (depends on 1)

The watching assistance system according to claim 1, wherein
the state of the head includes a plurality of items including at least one of a head moving speed, a head moving direction, and a head moving vector in addition to the head orientation, and
the determination unit determines the danger degrees relating to the plurality of items and determines the danger degree of the state of the head by integrating the danger degrees relating to the plurality of items.

### Claim 5 (depends on 1)

The watching assistance system according to claim 1, wherein the output unit does not provide notification when the determined danger degree is smaller than a threshold.

### Claim 6

A method for controlling a watching assistance system that assists watching over a subject on a bed, the watching assistance system control method comprising:
a step of acquiring an image captured by an imaging device;
a step of previously setting a criterion for determining a dangerous state for each of a plurality of determination regions set based on a region of the bed in the image;
a step of detecting the subject from the acquired image;
a step of recognizing a state of a head of the subject including a head orientation of the detected subject;
a step of determining a danger degree of the state of the head of the recognized subject using the criterion for the determination region corresponding to the position at which the subject is detected; and
a step of providing notification according to the determined danger degree.

### Claim 7 (depends on 6)

A program causing a computer to perform each step of the watching assistance system control method according to claim 6.

### Claim 8 (depends on 4)

The watching assistance system according to claim 4, wherein the output unit does not provide notification when the determined danger degree is smaller than a threshold.
