# US 7,612,666 B2 · Video based monitoring system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 7,612,666 B2
- Document ID: US7612666B2
- Status: Granted
- Kind: B2
- Application number: 10/898,952
- Filed: 2004-07-27
- Published: 2006-02-02
- Granted: 2009-11-03
- Earliest claimed: 2004-07-27
- Inventors: Wael Badawy
- Web page: https://patentgrep.com/patent/US7612666B2

## CPC

- G08B 13/19652: {Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm}
- G05B 15/02: electric
- G08B 13/19641: {Multiple cameras having overlapping views on a single scene}
- G08B 13/19673: {Addition of time stamp, i.e. time metadata, to video stream}
- G08B 21/0446: {worn on the body to detect changes of posture, e.g. a fall, inclination, acceleration, gait}
- G08B 21/0461: {integrated or attached to an item closely associated with the person but not worn by the person, e.g. chair, walking stick, bed sensor}
- G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras}
- H04N 5/76: Television signal recording
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- G05B 2219/2642: Domotique, domestic, home control, automation, smart house
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video-based monitoring system has a video recording device having a field of view, wherein plural zones are defined within the field of view of the video recording device, each zone having an algorithm corresponding to movement in that zone, and a processing unit for receiving and processing video data from the video recording device.

## Claims

### Claim 1

A video-based monitoring system for monitoring an occupant of a room, the monitoring system comprising:
a video recording device having a field of view within the room;
a processing unit for receiving and processing video data from the video recording device, wherein the processing unit is configured to define plural zones within the field of view of the video recording device, each zone being associated with at least one algorithm, stored in the processing unit, for detecting and classifying a movement of the occupant in the respective zone; and
the plural zones correspond at least to a bed zone and a zone within the room outside of the bed that is adjacent to the bed zone;
the algorithm associated with the zone adjacent the bed zone being programmed to classify the movement of the occupant in the zone adjacent the bed zone based on the type of movement and movement of the occupant into the zone adjacent the bed zone from the bed zone.

### Claim 2 (depends on 1)

The video-based monitoring system of claim 1 wherein the processing unit comprises an analysis unit configured to classify a movement in each zone of the plural zones based on the at least one algorithm, and a control unit configured to activate a response based on the classification.

### Claim 3 (depends on 2)

The video-based monitoring system of claim 2 wherein the analysis unit is further configured to classify movement in a zone as one of no motion, motion-allowed, motion-required, motion-risky or motion-prohibited.

### Claim 4 (depends on 2)

The video-based monitoring system of claim 2 wherein the processing unit further comprises a detection unit for detecting movement and a video recording unit for recording the event.

### Claim 5 (depends on 1)

The video-based monitoring system of claim 1 wherein the processing unit further comprises a storage unit for storing a record of movements for future reference.

### Claim 6 (depends on 5)

The video-based monitoring system of claim 5 wherein the storage unit is configured to store the movement according to time and classification.

### Claim 7 (depends on 2)

The video-based monitoring system of claim 2 wherein the control unit is configured to activate a response that comprises activation of a remote monitor, activation of a wireless device, generation of a visual signal, generation of an audio signal, or activation of a dial-up connection.

### Claim 8 (depends on 1)

The video-based monitoring system of claim 1 the processing unit is configured to transmit data over a wireless network.

### Claim 9 (depends on 1)

The video-based monitoring system of claim 1 wherein more than one video recording device is present in the room.

### Claim 10 (depends on 2)

The video-based monitoring system of claim 2 wherein the control unit is configured to receive data from plural recording devices.

### Claim 11 (depends on 2)

The video-based monitoring system of claim 2 wherein the analysis unit is configured to receive data from plural recording devices.

### Claim 12 (depends on 1)

The video-based monitoring system of claim 1 wherein the field of view is a hospital room.

### Claim 13 (depends on 12)

The video-based monitoring system of claim 12 wherein the zones comprise one or more of a door zone, an activity zone, and a high risk zone.

### Claim 14

A method of monitoring the movement of an occupant of a room, the method comprising the steps of:
receiving video data from plural zones within the field of view of a sensor, the field of view being within a room, the plural zones including at least a bed zone and a zone outside the bed zone that is adjacent to the bed zone;
monitoring the plural zones to detect a movement of an occupant in each zone according to respective motion detection algorithms corresponding to each zone; and
classifying a movement of the occupant in a zone of the plural zones based on the corresponding algorithm, the algorithm associated with the zone adjacent the bed zone being programmed to classify the movement of the occupant in the zone adjacent the bed zone based on the type of movement and movement of the occupant into the zone adjacent the bed zone from the bed zone.

### Claim 15 (depends on 14)

The method of claim 14 further comprising activating a response from a set of responses based on the classification.

### Claim 16 (depends on 14)

The method of claim 14 further comprising classifying the movement as one of no motion, motion-allowed, motion-required, motion-risky or motion-prohibited.

### Claim 17 (depends on 16)

The method of claim 16 further comprising activating a response from a set of responses according to the classification of the movement.

### Claim 18 (depends on 14)

The method of claim 14 used to monitor movement in a hospital room.

### Claim 19 (depends on 18)

The method of claim 18 in which the plural zones comprise more than one bed zone, each bed zone having a corresponding zone adjacent the bed zone.

### Claim 20 (depends on 14)

The method of claim 14 in which the plural zones comprise one or more of a door zone, an activity zone and a high-risk zone.

### Claim 21 (depends on 20)

The method of claim 20 further comprising activating a response from a set of responses based on the classification.

### Claim 22 (depends on 21)

The method of claim 21 in which the movement is classified as relating to a person falling out of bed.

### Claim 23 (depends on 22)

The method of claim 22 in which movement classification comprises:
tracking movement in the bed zone towards the zone adjacent the bed zone; and
activating at least one of the responses when the movement moves from the bed zone into the zone adjacent the bed zone.

### Claim 24 (depends on 15)

The method of claim 15 in which one of the plural zones is a door zone containing a door, the method further comprising activating at least one of the responses when movement within the door zone is directed towards the door.

### Claim 25 (depends on 15)

The method of claim 15 in which one of the plural zones is a door zone containing a door, the method further comprising activating at least one of the responses when movement within the door zone is directed away from door.

### Claim 26 (depends on 24)

The method of claim 24 in which the at least one response comprises locking the door.

### Claim 27 (depends on 15)

The method of claim 15 further comprising:
tracking movement within an activity zone of the plural zones and identifying a property of the movement within the activity zone, the property comprising at least one of a type of movement event, a frequency of movement events, a duration of movement event and a time elapsed between movement events; and
classifying the movement in the activity zone based on identifying the at least one property of the movement event.

### Claim 28 (depends on 15)

The method of claim 15 further comprising:
tracking movement within a high-risk zone of the plural zones; and
activating at least one of the responses.

### Claim 29 (depends on 28)

The method of claim 28 wherein the high-risk zone comprises a window, a stove, or a source of danger.

### Claim 30 (depends on 14)

The method of claim 14 used to monitor movement in a detention cell.

### Claim 31

A method of monitoring the movement of an occupant of a room, the method comprising the steps of:
receiving video data from an activity zone of a plurality of zones defined within a field of view of a sensor, the plurality of zones including a bed zone and a door zone, the activity zone being away from the door zone and the bed zone,
monitoring the plurality of zones to detect a movement of an occupant in each zone according to respective motion detection algorithms corresponding to each zone; classifying a movement of the occupant in a zone of the plurality of zones based on the corresponding algorithm, the algorithm associated with a zone adjacent the bed zone being programmed to classify the movement of the occupant in the zone adjacent the bed zone based on the type of movement and movement of the occupant into the zone adjacent the bed zone from the bed zone;
detecting a movement event of an occupant taking place within the activity zone;
tracking at least one property of the movement event, the at least one property comprising:
a type of movement event, a frequency of movement events, a duration of the movement event, or a time elapsed between movement events; and
activating a response based on the at least one property of the movement event.

### Claim 32

A method of monitoring the movement of an occupant of a room, the method comprising the steps of:
receiving video data from a high risk zone of a plurality of zones defined within a field of view of a sensor, the high risk zone containing a danger area, the plurality of zones including a bed zone;
monitoring the plurality of zones to detect a movement of an occupant in each zone according to respective motion detection algorithms corresponding to each zone; classifying a movement of the occupant in a zone of the plurality of zones based on the corresponding algorithm, the algorithm associated with a zone adjacent the bed zone being programmed to classify the movement of the occupant in the zone adjacent the bed zone based on the type of movement and movement of the occupant into the zone adjacent the bed zone from the bed zone;
detecting a movement event of an occupant taking place within the high-risk zone;
tracking movement of an occupant in the high-risk zone, when the movement is either near the danger area or within the danger area; and
activating a response based on the tracking of the movement.

### Claim 33 (depends on 32)

The method of claim 32, wherein the danger area comprises a window, stove, or source of danger.