# US 12,112,542 B2 · Monitoring device, monitoring method, and recording medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,112,542 B2 - Document ID: US12112542B2 - Status: Granted - Kind: B2 - Application number: 18/230,515 - Filed: 2023-08-04 - Published: 2023-11-23 - Granted: 2024-10-08 - Earliest claimed: 2019-01-11 - Assignees: NEC Corporation - Applicants: NEC Corporation - Inventors: Yuta Kudo - Web page: https://patentgrep.com/patent/US12112542B2 ## CPC - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - G08B 25/00: Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems - H04N 7/183: {for receiving images from a single remote source} - H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)} - G06T 2207/30196: Human being; Person - G06T 2207/30232: Surveillance - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract To present a region which is not fully monitored, provided is a monitoring device comprising a detection means, an estimation means, a determination means, and a presentation means. The detection means detects a person from an image. The estimation means estimates a region which is being viewed by the person who is detected by the detection means. On the basis of the region estimated by the estimation means, the determination means determines a region which requires special attention within a monitoring area. The presentation means presents information indicating the region which requires special attention determined by the determination means. ## Claims ### Claim 1 A monitoring device comprising: a memory; and at least one processor coupled to the memory, the at least one processor performing operations to: detect a person from a surveillance image captured by one or more monitoring cameras capturing a monitoring area; determine a line-of-sight of the detected person from an image captured by a wearable camera worn by the detected person; estimate a region within the surveillance image that is being viewed by the detected person based on the determined line-of-sight; determine, based on the estimated region, a region that requires special attention within the monitoring area; and present information indicating the determined region that requires special attention. ### Claim 2 (depends on 1) The monitoring device according to claim 1, wherein the image captured by the wearable camera is an image of an eye of the detected person or surroundings of the eye. ### Claim 3 (depends on 1) The monitoring device according to claim 1, wherein the wearable camera is worn by the detectable person via inclusion of a cap-type or eyewear-type device having a wireless communication function. ### Claim 4 (depends on 3) The monitoring device according to claim 3, wherein the wearable camera captures an eye of the detected person or surroundings of the eye, and captures the monitoring area. ### Claim 5 (depends on 4) The monitoring device according to claim 4, wherein the at least one processor further performs operation to: display, on a monitor, the surveillance image captured by the one or more monitoring cameras and the image of the monitoring area captured by the wearable camera. ### Claim 6 (depends on 1) The monitoring device according to claim 1, wherein the at least one processor further performs operation to: detect a particular person from the surveillance image captured by the one or more monitoring cameras; and when the particular person is present in the determined region, issue an alarm to the person. ### Claim 7 (depends on 6) The monitoring device according to claim 6, wherein the particular person is a swimmer. ### Claim 8 A monitoring method performed by a computer and comprising: detecting a person from a surveillance image captured by one or more monitoring cameras capturing a monitoring area; determining a line-of-sight of the detected person from an image captured by a wearable camera worn by the detected person; estimating a region within the surveillance image that is being viewed by the detected person based on the determined line-of-sight; determining, based on the estimated region, a region that requires special attention within the monitoring area; and presenting information indicating the determined region that requires special attention. ### Claim 9 (depends on 8) The monitoring method according to claim 8, wherein the image captured by the wearable camera is an image of an eye of the detected person or surroundings of the eye. ### Claim 10 (depends on 8) The monitoring method according to claim 8, wherein the wearable camera is worn by the detectable person via inclusion of a cap-type or eyewear-type device having a wireless communication function. ### Claim 11 (depends on 10) The monitoring method according to claim 10, wherein the wearable camera captures an eye of the detected person or surroundings of the eye, and captures the monitoring area. ### Claim 12 (depends on 11) The monitoring method according to claim 11, wherein the monitoring method comprises: displaying, on a monitor, the surveillance image captured by the one or more monitoring cameras and the image of the monitoring area captured by the wearable camera. ### Claim 13 (depends on 8) The monitoring method according to claim 8, wherein the monitoring method comprises: detecting a particular person from the surveillance image captured by the one or more monitoring cameras; and when the particular person is present in the determined region, issuing an alarm to the person. ### Claim 14 (depends on 13) The monitoring method according to claim 13, wherein the particular person is a swimmer. ### Claim 15 A non-transitory recording medium storing a program for causing a computer to execute: detecting a person from a surveillance image captured by one or more monitoring cameras capturing a monitoring area; determining a line-of-sight of the detected person from an image captured by a wearable camera worn by the detected person; estimating a region within the surveillance image that is being viewed by the detected person based on the determined line-of-sight; determining, based on the estimated region, a region that requires special attention within the monitoring area; and presenting information indicating the determined region that requires special attention. ### Claim 16 (depends on 15) The non-transitory recording medium according to claim 15, wherein the image captured by the wearable camera is an image of an eye of the detected person or surroundings of the eye. ### Claim 17 (depends on 15) The non-transitory recording medium according to claim 15, wherein the wearable camera is worn by the detectable person via inclusion of a cap-type or eyewear-type device having a wireless communication function. ### Claim 18 (depends on 17) The non-transitory recording medium according to claim 17, wherein the wearable camera captures eye of the detected person or surroundings of the eye, and captures the monitoring area. ### Claim 19 (depends on 18) The non-transitory recording medium according to claim 18, wherein the program causes the computer to execute: displaying, on a monitor, the surveillance image captured by the one or more monitoring cameras and the image of the monitoring area captured by the wearable camera. ### Claim 20 (depends on 15) The non-transitory recording medium according to claim 15, wherein the program causes the computer to execute: detecting a particular person from the surveillance image captured by the one or more monitoring cameras; and when the particular person is present in the determined region, issuing an alarm to the person.