System and method for using a camera unit for the pool cleaning robot for safety monitoring and augmented reality games

A detection and tracking system using a camera mounted inside a pool overlooking a bottom of the pool, and a robot that uses a video from the camera for navigation and for safety monitoring for use in and around water-related environments comprising:

• a processing unit enabling real-time detection and tracking of objects;
• wherein the robot is able to propel itself and move throughout a body of water, both on a surface and underwater;
• wherein the robot optimizes a cleaning cycle of the body of water utilizing deep learning techniques;
• wherein the robot has localization sensors and software that allow the robot to be aware of a position of the robot in the pool;
• wherein the camera is able to send its video feed live over an internet;
• wherein the processing is performed in a cloud;
• wherein the robot sends and receives data from the cloud;
• wherein processing utilizes deep learning algorithms, including artificial neural networks, that perform video analytics using a method comprising the following steps:
• a. areas of interest around the body of water are defined upon initial set up of the system;
• in a man-made body of water, area surrounding the pool would be defined as Area 1 and the pool itself would be defined as Area 2;
• in a context of an ocean, such interest areas are a beach area, the ocean and any other pre-defined areas;
• b. in each frame the system extracts features and uses the deep learning algorithms to identify if an image consists of a person and/or object defined by the system;
• this analysis is performed in real-time with no time delay;
• c. the system recognizes and distinguishes between different types of objects, as well as stationary objects;
• d. identification and classification of each object is then cross referenced with a specific location of the object as recognized by the system and the areas of interest as outlined in point a above.

A detection and tracking method using a camera unit on a robot for safety monitoring for use in and around water-related environments comprising:

• a processing unit enabling real-time detection and tracking of objects;
• wherein the robot is able to propel itself and move throughout a body of water, both on a surface and underwater;
• wherein the camera unit functions both on the surface and underwater;
• wherein the robot optimizes a cleaning cycle of the body of water utilizing deep learning techniques;
• wherein the robot has localization sensors and software that allow the robot to be aware of a position of the robot in a pool;
• wherein the camera is able to send its video feed live over an internet;
• wherein processing is performed in a cloud;
• wherein the robot sends and receives data from the cloud;
• wherein the processing utilizes deep learning algorithms, including artificial neural networks, that perform video analytics using a method comprising the following steps:
• a. areas of interest around the body of water are defined upon initial set up of the system;
• in a man-made body of water, area surrounding the pool would be defined as Area 1 and the pool itself would be defined as Area 2;
• in a context of an ocean, such interest areas are a beach area, the ocean and any other pre-defined areas;
• b. in each frame the system extracts features and uses the deep learning algorithms to identify if an image consists of a person and/or object defined by the system;
• this analysis is performed in real-time with no time delay;
• c. the system recognizes and distinguishes between different types of objects, as well as stationary objects;
• d. identification and classification of each object is then cross referenced with a specific location of the object as recognized by the system and the areas of interest as outlined in point a above.