# US 9,519,969 B1 · System for determining whether an individual suffers a fall requiring assistance > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,519,969 B1 - Document ID: US9519969B1 - Status: Granted - Kind: B1 - Application number: 14/743,499 - Filed: 2015-06-18 - Granted: 2016-12-13 - Earliest claimed: 2011-07-12 - Assignees: Cerner Innovation, Inc. - Applicants: Cerner Innovation, Inc. - Inventors: Neil Kusens - Web page: https://patentgrep.com/patent/US9519969B1 ## CPC - G08B 21/043: {detecting an emergency event, e.g. a fall} - G06T 1/0007: {Image acquisition} - G06T 7/251: {involving models} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras} - G08B 21/0492: {Sensor dual technology, i.e. two or more technologies collaborate to extract unsafe condition, e.g. video tracking and RFID tracking} - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00) - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/30196: Human being; Person - G06T 2207/30232: Surveillance - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A system and method for monitoring an individual in a dwelling so as to know when such individual falls or indicates the need of assistance. A plurality of 3D motion and sound sensors are located in the dwelling and provide data to a computerized monitoring system. The sensors are configured to recognize one or more biometric identifiers of the individual being monitored. When the monitoring system detects that the individual has fallen or gestured, a computerized communication system contacts the individual to determine the need to send assistance to help the individual. Where assistance is required the system automatics contacts the previously designated caregiver for the individual and can also contact emergency personnel. ## Claims ### Claim 1 A system for detecting when a monitored individual within a dwelling has fallen, is about to fall or has otherwise indicated that he or she needs medical assistance, said system comprising: one or more 3D Camera, Motion and Sound sensors positioned such that the one or more sensors capture continuous video of a preconfigured area of a particular room wherein an individual is to be monitored; a computerized monitoring system in communication with said one or more 3D Camera, Motion and Sound sensors to receive the captured continuous video of the preconfigured area for analysis by the computerized monitoring system, said computerized monitoring system programmed to recognize skeletal points on a body of the monitored individual in order to identify and track movement by the monitored individual in the continuous video received from the 3D Camera, Motion and Sound sensors; and a computerized communication system in communication with the computerized monitoring system, said computerized communication system programmed to facilitate communication with the monitored individual or a caregiver or other designated person when the computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance based on video received from the one or more 3D Camera, Motion and Sound sensors. ### Claim 2 (depends on 1) The system for detecting of claim 1 wherein said computerized communication system is located within the particular room. ### Claim 3 (depends on 1) The system for detecting of claim 1 wherein the one or more 3D Camera, Motion and Sound sensors are located within the monitored room. ### Claim 4 (depends on 1) The system for detecting of claim 1 wherein the computerized monitoring system is located within the monitored room. ### Claim 5 (depends on 1) The system for detecting of claim 1 further comprising: a centralized monitoring station in communication with the computerized monitoring system and the one or more 3D Camera, Motion and Sound Sensors, said centralized monitoring station receiving the captured video from the one or more 3D Camera, Motion and Sound sensors. ### Claim 6 (depends on 5) The system for detecting of claim 5 further comprising a centralized monitoring primary display in communication with the centralized monitoring station for displaying the captured video received by the centralized monitoring station. ### Claim 7 (depends on 6) The system for detecting of claim 6 wherein said centralized monitoring station receives captured video for a plurality of different monitored rooms by receiving captured video from a plurality of one or more 3D Camera, Motion and Sound sensors with each one of the plurality of one or more 3D Camera, Motion and Sound sensors associated with a particular one of the plurality of different monitored rooms. ### Claim 8 (depends on 7) The system for detecting of claim 7 further comprising a centralized monitoring alert display in communication with the centralized monitoring station, said centralized monitoring alert display displaying a video for a particular monitored room from the plurality of monitored rooms when said computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance. ### Claim 9 (depends on 5) The system for detecting of claim 5 wherein said centralized monitoring station continuously receives captured video from the one or more 3D Camera, Motion and Sound sensors which is continuously displayed on the centralized monitoring primary display while monitoring of the room is taking place. ### Claim 10 (depends on 5) The system for detecting of claim 5 further comprising an electronic database in communication with the centralized monitoring station; said electronic database storing electronic records of any alerts received by the centralized monitoring station from the computerized monitoring system. ### Claim 11 (depends on 1) The system for detecting of claim 1 wherein the preconfigured area is zone around a bed located in a hospital or nursing home room. ### Claim 12 A system for detecting when a monitored individual within a dwelling has fallen, is about to fall or has otherwise indicated that he or she needs medical assistance, said system comprising: one or more 3D Camera, Motion and Sound sensors positioned such that the one or more sensors capture continuous video of a preconfigured area of a particular room wherein an individual is to be monitored; a computerized monitoring system in communication with said one or more 3D Camera, Motion and Sound sensors to receive the captured continuous video of the preconfigured area for analysis by the computerized monitoring system, said computerized monitoring system programmed to recognize skeletal points on a body of the monitored individual in order to identify and track movement by the monitored individual in the continuous video received from the 3D Camera, Motion and Sound sensors; a centralized monitoring station in communication with the computerized monitoring system and the one or more 3D Camera, Motion and Sound Sensors, said centralized monitoring station receiving the captured video from the one or more 3D Camera, Motion and Sound sensors; and a centralized monitoring primary display in communication with the centralized monitoring station for displaying the captured video received by the centralized monitoring station. ### Claim 13 (depends on 12) The system for detecting of claim 12 wherein said centralized monitoring station receives captured video for a plurality of different monitored rooms by receiving captured video from a plurality of one or more 3D Camera, Motion and Sound sensors with each one of the plurality of one or more 3D Camera, Motion and Sound sensors associated with a particular one of the plurality of different monitored rooms. ### Claim 14 (depends on 13) The system for detecting of claim 13 further comprising a centralized monitoring alert display in communication with the centralized monitoring station, said centralized monitoring alert display displaying a video for a particular monitored room from the plurality of monitored rooms when said computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance. ### Claim 15 (depends on 12) The system for detecting of claim 12 wherein said centralized monitoring station continuously receives captured video from the one or more 3D Camera, Motion and Sound sensors which is continuously displayed on the centralized monitoring primary display while monitoring of the room is taking place. ### Claim 16 (depends on 12) The system for detecting of claim 12 wherein the one or more 3D Camera, Motion and Sound sensors are located within the monitored room. ### Claim 17 (depends on 12) The system for detecting of claim 12 wherein the computerized monitoring system is located within the monitored room. ### Claim 18 (depends on 12) The system for detecting of claim 12 further comprising an electronic database in communication with the centralized monitoring station; said electronic database storing electronic records of any alerts received by the centralized monitoring station from the computerized monitoring system. ### Claim 19 (depends on 12) The system for detecting of claim 12 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room. ### Claim 20 A system for detecting when a monitored individual within a dwelling has fallen, is about to fall or has otherwise indicated that he or she needs medical assistance, said system comprising: one or more 3D Camera, Motion and Sound sensors positioned such that the one or more sensors capture continuous video of a preconfigured area of a particular room wherein an individual is to be monitored; a computerized monitoring system in communication with said one or more 3D Camera, Motion and Sound sensors to receive the captured continuous video of the preconfigured area for analysis by the computerized monitoring system, said computerized monitoring system programmed to recognize skeletal points on a body of the monitored individual in order to identify and track movement by the monitored individual in the continuous video received from the 3D Camera, Motion and Sound sensors; a computerized communication system in communication with the computerized monitoring system, said computerized communication system programmed to facilitate communication with the monitored individual or a caregiver or designated person when the computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance based on video received from the one or more 3D Camera, Motion and Sound sensors; a centralized monitoring station in communication with the computerized monitoring system and the one or more 3D Camera, Motion and Sound Sensors, said centralized monitoring station receiving the captured video from the one or more 3D Camera, Motion and Sound sensors; and a centralized monitoring primary display in communication with the centralized monitoring station for displaying the captured video received by the centralized monitoring station.