# US 2019/0318149 A1 · Detecting unauthorized visitors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318149 A1
- Document ID: US20190318149A1
- Status: Published application
- Kind: A1
- Application number: 16/454,508
- Filed: 2019-06-27
- Published: 2019-10-17
- Earliest claimed: 2015-12-31
- Assignees: Cerner Innovation, Inc.
- Applicants: Cerner Innovation, Inc.
- Inventors: MICHAEL KUSENS; NEIL KUSENS
- Web page: https://patentgrep.com/patent/US20190318149A1

## CPC

- A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/1176: {Recognition of faces}
- A61B 5/4064: {Evaluating the brain (for intracranial pressure A61B5/031; for cerebral blood gases A61B5/14553; using EEG A61B5/369)}
- A61B 5/746: {Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/0016: {involving temporal comparison}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/292: Multi-camera tracking
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/647: {by matching two-dimensional images to three-dimensional objects}
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G08B 5/22: using electric transmission; using electromagnetic transmission
- G08B 13/196: using television cameras
- G08B 21/182: {Level alarms, e.g. alarms responsive to variables exceeding a threshold}
- G08B 25/009: {Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range}
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof
- G16H 20/10: relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- H04N 13/207: using a single two-dimensional [2D] image sensor
- H04N 23/63: by using electronic viewfinders
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06T 2200/04: involving 3D image data
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10012: Stereo images
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/10024: Color image
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30201: Face
- G06T 2207/30232: Surveillance
- G06V 40/161: {Detection; Localisation; Normalisation}
- G08B 13/19639: {Details of the system layout}
- G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras}
- H04N 2013/0085: {Motion estimation from stereoscopic image signals}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An unauthorized visitor system collects an image of a person detected in a room of a patient. The system identifies reference points on the person's face, for example, points along the cheeks, jowls, and/or brow. The system may compare the reference points to reference points of images associated with registered visitors. The system then determines, based on the comparison, if the person is a registered visitor. One or more designated recipients may be alerted if the person is not a registered visitor or if the person breaches a patient identification zone established around a particular patient. The system may also register the person in a database of visitors.

## Claims

### Claim 1

A system for detecting unauthorized visitors, the system comprising:
one or more 3D motion sensors located to provide the one or more 3D motion sensors with a view of a person and surrounding area to be monitored; and
a computerized monitoring system communicatively coupled to the one or more 3D motion sensors, the computerized monitoring system configured to:
receive images of the area to be monitored from the one or more 3D motion sensors;
detect when a visitor enters the view of the one or more 3D motion sensors;
receive a plurality of registered reference points on faces of registered visitors from a remote database;
assign a plurality of reference points on the face of the visitor in one or more images from the one or more 3D motion sensors,
determine whether the visitor is an unauthorized visitor by comparing positions, distances between, sizes, or shapes of the reference points to positions, distances between, sizes, or shapes of the reference points of the plurality of registered reference points on faces of registered visitors; and
initiate an alert being sent to one or more designated recipients.

### Claim 2 (depends on 1)

The system of claim 1 further comprising a central communication system communicatively coupled to the computerized monitoring system, wherein initiating the alert to one or more designated recipients comprises transmitting an indication that the unauthorized visitor was detected to the central communication system and wherein the central communication system sends the alert to the one or more designated recipients.

### Claim 3 (depends on 2)

The system of claim 2, wherein the central communication system is located remotely from the computerized monitoring system.

### Claim 4 (depends on 1)

The system of claim 1, wherein determining whether the visitor is an unauthorized visitor further comprises determining whether the visitor is registered.

### Claim 5 (depends on 4)

The system of claim 4, wherein the visitor is determined to be an unauthorized visitor upon determining the visitor is not registered.

### Claim 6 (depends on 5)

The system of claim 5, wherein the computerized monitoring system is further configured to create a recognition profile for the visitor upon determining the visitor is not registered.

### Claim 7 (depends on 1)

The system of claim 1, wherein the computerized monitoring system is further configured to identify the person being monitored utilizing skeletal tracking or blob detection.

### Claim 8 (depends on 1)

The system of claim 1, wherein assigning a plurality of reference points on the face of the visitor comprises automatically assigning a plurality of reference points without user confirmation.

### Claim 9 (depends on 1)

The system of claim 1, wherein assigning a plurality of reference points on the face of the visitor comprise automatically assigning initial reference points and assigning one or more alternative reference points upon detection of one or more bandages on the face of the visitor.

### Claim 10 (depends on 1)

The system of claim 1 further comprising:
a central video monitoring system configured to display at least a portion of images captured by the one or more 3D motion sensors; and
a central communication system that is integrated with the computerized monitoring system and is communicatively coupled to the central video monitoring system, wherein when it is determined that the visitor is an unauthorized visitor, the central communication system sends an alert to the central video monitoring system.

### Claim 11

A computerized method for detecting unauthorized visitors, the method implemented by one or more processors and comprising:
receiving, from one or more 3D motion sensors, an image of a visitor within an area to be monitored;
receive a plurality of registered reference points on faces of registered visitors from a remote database;
assigning a plurality of reference points on the face of the visitor in the image from the one or more 3D motion sensors;
determining whether the visitor is an unauthorized visitor by comparing positions, distances between, sizes, or shapes of the reference points to positions, distances between, sizes, or shapes of the reference points of the plurality of registered reference points on faces of registered visitors; and
initiating an alert being sent to one or more designated recipients.

### Claim 12 (depends on 11)

The computerized method of claim 11, further comprising establishing a virtual zone around an individual to be monitored within the area to be monitored.

### Claim 13 (depends on 12)

The computerized method of claim 12, wherein the alert is initiated only upon determining the unauthorized visitor is within the virtual zone around the individual to be monitored.

### Claim 14 (depends on 11)

The computerized method of claim 11, further comprising, upon determining the visitor is unauthorized, determining whether the visitor made one or more corrective actions after the alert is sent to one or more designed recipients.

### Claim 15 (depends on 14)

The computerized method of claim 14, wherein the one or more corrective actions comprises moving away from an individual being monitored.

### Claim 16

Non-transitory computer-readable storage media having embodied thereon instructions that, when executed by one or more computer processors, cause the one or more computer processors to:
receive, from one or more 3D motion sensors, images of a visitor within an area having an individual to be monitored;
assign a plurality of reference points on the face of the visitor in one or more images received from the one or more 3D motion sensors;
receive a plurality of registered reference points on faces of registered visitors from a remote database;
determine whether the visitor is an unauthorized visitor by comparing positions, distances between, sizes, or shapes of the reference points to positions, distances between, sizes, or shapes of the reference points of the plurality of registered reference points on faces of registered visitors; and
initiate an alert being sent to one or more designated recipients.

### Claim 17 (depends on 16)

The computer-readable storage media of claim 16, wherein one of the one or more designated recipients is a central video monitoring system comprising a primary display and an alert display, and wherein the central video monitoring system moves a display of at least a portion of the one or more images of the visitor from the primary display to the alert display.

### Claim 18 (depends on 16)

The computer-readable storage media of claim 16, wherein the instructions further cause the one or more computer processors to determine whether the visitor is registered and, upon determining the visitor is not registered, create a profile for the visitor.

### Claim 19 (depends on 16)

The computer-readable storage media of claim 16, wherein the visitor is determined to be an unauthorized visitor when the visitor is not identified as someone who is a registered visitor or when the visitor is registered and indicated as someone who is not permitted to be in close proximity to the individual being monitored.

### Claim 20 (depends on 16)

The computer-readable storage media of claim 16, wherein the instructions further cause the one or more computer processors to identify the individual being monitored utilizing skeletal tracking or blob detection.