# US 11,443,602 B2 · Methods and systems for detecting prohibited objects > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,602 B2 - Document ID: US11443602B2 - Status: Granted - Kind: B2 - Application number: 17/152,403 - Filed: 2021-01-19 - Published: 2021-05-13 - Granted: 2022-09-13 - Earliest claimed: 2018-11-06 - Assignees: Cerner Innovation, Inc. - Applicants: Cerner Innovation, Inc. - Inventors: Michael Kusens; Neil Kusens - Web page: https://patentgrep.com/patent/US11443602B2 ## CPC - G08B 21/043: {detecting an emergency event, e.g. a fall} - G06F 18/21: Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/70: using pattern recognition or machine learning (optical pattern recognition or electronic computations therefor G06V10/88) - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G08B 13/19602: {Image analysis to detect motion of the intruder, e.g. by frame subtraction} - G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras} - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/30196: Human being; Person - G06T 2207/30232: Surveillance - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A prohibited object detection system detects improper use of an object in an area being monitored. An image of an object detected in an area associated with a monitored individual, such as a patient room, is collected, and the system identifies reference points on the object. The system may compare the reference points to reference points of known improper uses of the object. The system may determine whether the detected object in the improper use position is in proximity to at least a portion of the monitored individual or other person within the monitored area. One or more designated recipients may be alerted if the object is in a position consistent with an improper use. ## Claims ### Claim 1 One or more non-transitory computer storage media having embodied thereon instructions that, when executed by one or more computer processors, causes the one or more computer processors to perform a method comprising: receiving image data from one or more 3D motion sensors located to provide the one or more 3D motion sensors with a view of an individual to be monitored in a monitored area; based on the image data received from the one or more 3D motion sensors, detecting an object within the monitored area, wherein detecting the object comprises identifying the object using a plurality of reference points of the object; determining that a position of the object within the image data is consistent with an improper use by comparing a known position of the improper use of the object to the position of the object within the image data; and initiating an alert protocol upon determining that the position of the object is consistent with the improper use. ### Claim 2 (depends on 1) The computer storage media of claim 1, wherein the method performed by the one or more computer processors further comprises, upon detecting the object within the monitored area, detecting that the object is within a threshold proximity of one or more hands of a person within the monitored area. ### Claim 3 (depends on 2) The computer storage media of claim 2, wherein the person within the monitored area is the individual to be monitored, a caregiver, or a visitor. ### Claim 4 (depends on 1) The computer storage media of claim 1, wherein identifying the object comprises comparing the plurality of reference points of the object to reference points of known objects stored within a database and identifying a match with a known object. ### Claim 5 (depends on 1) The computer storage media of claim 1, wherein the improper use is a use that poses a safety, security, or health concern. ### Claim 6 (depends on 5) The computer storage media of claim 5, wherein the known position of the improper use of the object and a known position of a proper use of the object are stored in a database. ### Claim 7 (depends on 1) The computer storage media of claim 1, further comprising receiving information corresponding to an action taken in response to the alert protocol and storing the information in a database. ### Claim 8 (depends on 1) The computer storage media of claim 1, wherein determining that the position of the object is consistent with the improper use comprises determining relative locations of at least two or more reference points of the object and comparing the relative locations with known relative locations associated with the improper use of the object. ### Claim 9 (depends on 8) The computer storage media of claim 8, wherein determining the relative locations of the at least two or more reference points of the object comprises determining locations of at least two or more reference points of the object relative to each other. ### Claim 10 A computerized method for detecting objects, the method comprising: receiving image data from one or more 3D motion sensors located to provide the one or more 3D motion sensors with a view of an individual to be monitored in a monitored area; based on image data received from the one or more 3D motion sensors, detecting an object that is within the monitored area, wherein detecting the object comprises identifying the object using a plurality of reference points of the object; detecting that a position of the object within the image data is consistent with an improper use by comparing a known position of the improper use of the object to the position of the object within the image data; and initiating an alert protocol upon determining that the position of the object is consistent with the improper use. ### Claim 11 (depends on 10) The computerized method of claim 10 further comprising, upon detecting the object within the monitored area, detecting that the object is within a threshold proximity of a person within the monitored area. ### Claim 12 (depends on 11) The computerized method of claim 11, wherein the threshold proximity of the person is determined based on reference points on a skeletal outline for the person. ### Claim 13 (depends on 12) The computerized method of claim 12, wherein detecting that the position of the object within the image data is consistent with the improper use further comprises determining whether a hand of the person is touching a particular portion of the object. ### Claim 14 (depends on 11) The computerized method of claim 11, wherein the threshold proximity is based on an identification zone automatically established based on a predetermined distance from the person within the monitored area, wherein the person within the monitored area comprises one of the individual to be monitored, a visitor, or a caregiver. ### Claim 15 A system for detecting an object within a monitored area, the system comprising: one or more 3D motion sensors located to provide the one or more 3D motion sensors with a view of an individual to be monitored, the one or more 3D motion sensors configured to capture image data of the monitored area; a computerized monitoring system communicatively coupled to the one or more 3D motion sensors, a processor of the computerized monitoring system configured to utilize the image data received from the one or more 3D motion sensors to: detect the object in the monitored area using one or more reference points of the object; determine that a position of the object within the image data is consistent with an improper use by comparing a known position of the object to the position of the object within the image data; and initiate an alert protocol upon determining that the position of the object is consistent with the improper use. ### Claim 16 (depends on 15) The system of claim 15 further comprising a computerized communication system communicatively coupled to the computerized monitoring system, the computerized communication system configured to: receive a determination from the computerized monitoring system that the position of the object detected is consistent with the improper use; and transmit one or more alerts indicating at least that the object has been detected. ### Claim 17 (depends on 16) The system of claim 16, wherein the computerized monitoring system is configured to transmit an alert to the individual to be monitored. ### Claim 18 (depends on 17) The system of claim 17, wherein the computerized monitoring system is further configured to, after the alert has been transmitted to the individual to be monitored, determine whether a response indicating corrective action has been given based on information subsequently received from the one or more 3D motion sensors. ### Claim 19 (depends on 18) The system of claim 18, wherein the response indicating corrective action includes one or more of an audible response from the individual to be monitored, a gesture indicative of compliance, and the object being moved out of the position consistent with the improper use. ### Claim 20 (depends on 15) The system of claim 15, further comprising a central monitoring system, wherein the alert protocol comprises the central monitoring system receiving the image data captured by the one or more 3D motion sensors and displaying the image data.