# US 2021/0241597 A1 · Smart surveillance system for swimming pools > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0241597 A1 - Document ID: US20210241597A1 - Status: Published application - Kind: A1 - Application number: 17/217,144 - Filed: 2021-03-30 - Published: 2021-08-05 - Earliest claimed: 2019-01-29 - Assignees: Pool Knight, LLC - Applicants: Pool Knight, LLC - Inventors: Ramy R. Gali; Phillip E. Matar; David C. May - Web page: https://patentgrep.com/patent/US20210241597A1 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G08B 21/086: {by monitoring a perimeter outside the body of the water} - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/172: {Classification, e.g. identification} - G10L 17/22: Interactive procedures; Man-machine interfaces - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)} - G06T 2207/30232: Surveillance - G08B 25/002: {Generating a prealarm to the central station} - G10L 17/00: Speaker identification or verification techniques - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A swimming pool monitoring system including an imaging sensor for detecting the presence of an object within a defined perimeter of the swimming pool and a computer system operatively coupled to the imaging sensor with a non-transitory computer readable medium storing a program causing the computer system to execute processing to determine when an object is moving within a field of view of the imaging sensor once detected by the imaging sensor, to determine an angle of the object relative to the imaging sensor and to determine a range of the object relative to the imaging device to include a determination of a size of object for providing an alarm when the object approaches within a predetermined distance of the pool edge. ## Claims ### Claim 1 A swimming pool monitoring system comprising: an imaging sensor for detecting the presence of an object within a defined perimeter of the swimming pool; and a computer system operatively coupled to the imaging sensor with a non-transitory computer readable medium storing a program causing the computer system to execute processing to determine when an object is moving within a field of view of the imaging sensor once detected by the imaging sensor, to determine an angle of the object relative to the imaging sensor and to determine a range of the object relative to the imaging device to include a determination of a size of object for providing an alarm when the object approaches within a predetermined distance of the pool edge. ### Claim 2 (depends on 1) The swimming pool monitoring system of claim 1, wherein to determine a range of the object from the imaging device, the computer system compares at least two image frames to determine pixel coordinates of the object. ### Claim 3 (depends on 1) The swimming pool monitoring system of claim 1, wherein to determine the range of the object, a field of view at a bottom of an image frame taken by the imaging sensor is determined with right triangle trigonometric equations. ### Claim 4 (depends on 1) The swimming pool monitoring system of claim 1, further comprising a plurality of sensor systems comprising at least an auditory sensor for detecting sounds within the perimeter of the pool and the computer system includes a data storage device and a voice identification system for identifying authorized voices within the pool perimeter and responding to commands from the authorized voices. ### Claim 5 (depends on 4) The swimming pool monitoring system of claim 4, wherein the plurality of sensor systems further comprises an olfactory sensor coupled to the computer system and a data storage device including a database of olfactory signatures associated with authorized objects for comparison to olfactory signatures detected by the olfactory sensor, the computer system providing an alarm in response to unauthorized signatures. ### Claim 6 (depends on 1) The swimming pool monitoring sensor of claim 1, further comprising a passive infrared sensor system for identifying live objects within the perimeter of the pool. ### Claim 7 (depends on 1) The swimming pool monitoring sensor of claim 1, further comprising an ultrasonic range sensor for determining range of a live object from an edge of the pool. ### Claim 8 (depends on 1) The swimming pool monitoring system of claim 1, wherein the computer system inhibits the alarm if an authorized live object is in juxtaposition with an unauthorized live object. ### Claim 9 (depends on 1) The swimming pool monitoring system of claim 1, wherein the computer system includes a data input function coupled to the image sensor for enabling selected captured images to be stored in the data storage whereby the plurality of predetermined images of objects may be updated for additional authorized and unauthorized objects. ### Claim 10 (depends on 1) The swimming pool monitoring system of claim 1, wherein the imaging sensor comprises a camera. ### Claim 11 (depends on 1) The swimming pool monitoring system of claim 1, further comprising a local ambient environment condition sensor coupled to the computer system for adjusting system response as a function of ambient conditions. ### Claim 12 A swimming pool monitoring system comprising: an imaging sensor with a known distance to a base surface; a computer system with a non-transitory computer readable medium storing a program causing the computer system to execute processes to receive image frames from the imaging sensor, to detect an object within when comparing image frames at a horizon of each image frame to a floor of each image frame, to determine a range of the object from the imaging sensor, and to determine a width and height of the object with right triangle trigonometric equations; and an alarm system in communication with the computer system to sound at least one of an audible, visual and tactile alarm emitting from at least one of the computer system and a remote device when determined that the object is entering into a predetermined perimeter area around the swimming pool relative to the imaging sensor. ### Claim 13 (depends on 12) The swimming pool monitoring system of claim 12, wherein the non-transitory computer readable medium storing the program further causes the computer system to determine at least one of whether the object has limbs and whether the object is at least one of walking and crawling. ### Claim 14 A computerized method to monitor a swimming pool for a moving object, the computerized method comprises a non-transitory computer readable medium storing a program causing the computer system to execute processes to image an area of interest with a stationary imaging device, detect a moving object within the field of view of the imaging device, determining a range of the object relative to the imaging device utilizing an angle of the object from the imaging device and a position of the imaging device relative to a base. ### Claim 15 (depends on 14) The computerized method of claim 14, further comprising the non-transitory computer readable medium storing a program causing the computer system to execute processes to compare at least two image frames captured by the imaging device to determine pixel coordinates of the object. ### Claim 16 (depends on 14) The computerized method of claim 14, further comprising the non-transitory computer readable medium storing a program causing the computer system to execute processes to determine the range of the object, a field of view at a bottom of an image frame taken by the imaging sensor determined with right triangle trigonometric equations. ### Claim 17 (depends on 14) The computerized method of claim 14, further comprising the non-transitory computer readable medium storing a program causing the computer system to execute processes to compare image frames taken by the imaging device at a horizon of each image frame to a floor of each image frame to determine a range of the object from the imaging sensor, and to determine a width and height of the object with right triangle trigonometric equations.