# US 10,121,070 B2 · Video monitoring system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,070 B2 - Document ID: US10121070B2 - Status: Granted - Kind: B2 - Application number: 15/808,465 - Filed: 2017-11-09 - Published: 2018-03-08 - Granted: 2018-11-06 - Earliest claimed: 2010-09-23 - Assignees: Stryker Corporation - Applicants: Stryker Corporation - Inventors: Richard A. Derenne; Richard Thomas DeLuca - Web page: https://patentgrep.com/patent/US10121070B2 ## CPC - G16H 50/30: for calculating health indices; for individual health risk assessment - A61B 5/0013: {Medical image data (A61B1/00011, A61B6/56, A61B8/56 take precedence)} - A61B 5/002: {Monitoring the patient using a local or closed circuit, e.g. in a room or building (A61B5/0017 takes precedence)} - A61B 5/1113: {Local tracking of patients, e.g. in a hospital or private home} - A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)} - A61B 5/7445: {Display arrangements, e.g. multiple display units} - G06F 16/78: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G08B 21/043: {detecting an emergency event, e.g. a fall} - G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras} - G08B 21/245: {Reminder of hygiene compliance policies, e.g. of washing hands} - G16H 40/67: for remote operation - G16H 70/20: relating to practices or guidelines - G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring - G16Z 99/00: Subject matter not provided for in other main groups of this subclass - H04N 7/185: {from a mobile camera, e.g. for remote control} - A61B 5/1115: {Monitoring leaving of a patient support, e.g. a bed or a wheelchair} - A61B 5/1117: {Fall detection} - A61B 5/1123: {Discriminating type of movement, e.g. walking or running (A61B5/1116, A61B5/112 take precedence)} - A61B 5/6889: {Rooms} - A61B 5/6892: {Mats} - A61B 5/7475: {User input or interface means, e.g. keyboard, pointing device, joystick} - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G16Z: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A monitoring system includes cameras adapted to capture images and depth data of the images. A computer device processes the image signals and depth data from the cameras according to various software modules that monitor one or more of the following: (a) compliance with patient care protocols; (b) patient activity; (c) equipment usage; (d) the location and/or usage of assets; (e) patient visitation metrics; (f) data from other sensors that is integrated with the image and depth data; (g) gestures by the patient or caregivers that are used as signals or for controls of equipment, and other items. Alerts may be issued if any conditions of importance are detected. ## Claims ### Claim 1 A monitoring system for a patient support apparatus comprising: a person support apparatus having an aural alert; a camera adapted to capture images of the patient support apparatus and output image data representative of the images; a database containing patient care protocol data, the patient care protocol data defining a task to be performed by a caregiver assigned to a patient of the patient support apparatus; and a computer device in communication with the camera, the patient support apparatus, and the database, the computer device adapted to analyze the image data to detect a presence of the caregiver in a vicinity of the patient support apparatus and to determine if the task has been performed by the caregiver, and, if not, to send a reminder to the caregiver to perform the task, the computer device further adapted to send a message to the patient support apparatus instructing the patient support apparatus to reduce a volume of the aural alert when the computer device detects the presence of the caregiver in the vicinity of the patient support apparatus. ### Claim 2 (depends on 1) The monitoring system of claim 1 further including a user interface in communication with the database, the user interface adapted to allow an authorized user to enter information into the database defining the task. ### Claim 3 (depends on 1) The monitoring system of claim 1 wherein the patient care protocol data includes a plurality of tasks to be performed by the caregiver, and wherein the computer device analyzes the image data to determine if each of the plurality of tasks has been performed. ### Claim 4 (depends on 3) The monitoring system of claim 3 wherein the computer device is adapted to transmit an alert message to the patient support apparatus instructing the patient support apparatus to issue the aural alert if at least one of the tasks is not completed. ### Claim 5 (depends on 1) The monitoring system of claim 1 furthering including a depth sensor in communication with the computer device, the depth sensor adapted to emit infrared light toward the patient support apparatus and detect reflections of the infrared light. ### Claim 6 (depends on 1) The monitoring system of claim 1 wherein the computer device is further adapted to identify a location of the patient's head in the image data and automatically blur that location in the image data. ### Claim 7 (depends on 1) The monitoring system of claim 1 wherein the task includes at least one of the following: performing a fall risk assessment of the patient; turning the patient; changing a dressing on a wound of the patient; performing therapy on the patient; visiting the patient; taking a vital sign measurement of the patient; administering medication to the patient; starting or stopping an IV of the patient; starting or stopping a compression device used to treat the patient; adjusting an angle of a head section of the patient support apparatus; and starting or stopping a ventilator used on the patient. ### Claim 8 (depends on 7) The monitoring system of claim 7 wherein, if the computer device determines that the task has been performed, the computer device is further adapted to communicate information to an electronic medical record indicating that the task has been performed. ### Claim 9 (depends on 1) The monitoring system of claim 1 wherein the task is activating an exit detection system associated with the patient support apparatus. ### Claim 10 (depends on 9) The monitoring system of claim 9 wherein the database includes a fall risk assessment associated with the patient of the patient support apparatus, and the computer device is adapted to automatically activate the exit detection system after the caregiver leaves the vicinity of the patient support apparatus if the fall risk assessment indicates that the patient is a fall risk. ### Claim 11 (depends on 9) The monitoring system of claim 9 wherein the database is adapted to include a fall risk assessment associated with the patient of the patient support apparatus, and the computer device is adapted to automatically activate the exit detection system after the caregiver leaves the vicinity of the patient support apparatus if the fall risk assessment is not present in the database. ### Claim 12 (depends on 1) The monitoring system of claim 1 wherein the reminder is transmitted to the patient support apparatus for display on a display of the patient support apparatus. ### Claim 13 (depends on 12) The monitoring system of claim 12 wherein the computer device sends the reminder to the caregiver after the computer device detects the presence of the caregiver within the vicinity of the patient support apparatus. ### Claim 14 A monitoring system for a patient support apparatus comprising: a person support apparatus having an aural alert; a camera adapted to capture images of [a] the patient support apparatus and output image data representative of the images, the patient support apparatus including a head section adapted to pivot about a generally horizontal pivot axis; a database containing patient care protocol data, the patient care protocol data defining an angular condition of the head section of the patient support apparatus to be met by a caregiver assigned to a patient of the patient support apparatus; and a computer device in communication with the camera, the patient support apparatus, and the database, the computer device adapted to analyze the image data to detect a presence of the caregiver in a vicinity of the patient support apparatus, to determine if the head section of the patient support apparatus meets the angular condition defined in the patient care protocol data, to determine if the patient is slouching in the patient support apparatus, to issue an alert activation message to the patient support apparatus if the patient is slouching or the head section of the patient support apparatus does not meet the angular condition, and to issue an alert silence message to the patient support apparatus instructing the patient support apparatus to reduce a volume of the aural alert when the computer device detects the presence of the caregiver in the vicinity of the patient support apparatus. ### Claim 15 (depends on 14) The monitoring system of claim 14 wherein the computer device is further adapted to identify a location of the patient's head in the image data and automatically blur that location in the image data. ### Claim 16 (depends on 15) The monitoring system of claim 15 wherein the computer device is further adapted to store the image data with the blurred location and to not store any of the image data without the blurred location. ### Claim 17 (depends on 14) The monitoring system of claim 14 wherein the angular condition of the head section of the patient support apparatus defined in the patient care protocol data is selected to help prevent ventilator associated pneumonia. ### Claim 18 (depends on 14) The monitoring system of claim 14 wherein the patient care protocol data also defines a task to be performed by the caregiver and the computer device analyzes the image data to determine if the task has been performed by the caregiver. ### Claim 19 (depends on 18) The monitoring system of claim 18 wherein the task is activating an exit detection system associated with the patient support apparatus, and the computer device is further adapted to automatically send a message to the patient support apparatus to activate the exit detection system if the caregiver leaves the vicinity of the patient support apparatus without activating the exit detection system.