Smart Self Calibrating Camera System

A method for calibrating a plurality of cameras in an area, comprising:

• Synchronizing system time for the plurality of cameras;
• Detecting at least one feature points of an object that is within range of the plurality of cameras, wherein the at least one feature points are setup in a pre-determined fashion, wherein the at least one feature points are configured within range of the plurality of cameras, wherein the at least one feature points are configured to be detected by color or infrared means, wherein any point of the at least one feature points are encoded with location information of the at least one feature points, wherein the location information of the at least one feature points are decoded and recorded during a duration of time, wherein the at least one feature points are encoded with color, infrared and depth information;
• Calibrating the plurality of cameras by using the location information of the at least one feature points during a duration of time;
• Capturing a first set of one or more images of the feature points by a first one of the plurality of cameras and a second set of one or more images of the feature points by a second one of the plurality of cameras;
• Calibrating the first one of the plurality of cameras and the second one of the plurality of cameras by matching same feature points between the first set of one or more images of the object and the second set of one ore more images, wherein the color and depth information is used for the matching of the same feature points, wherein the first one of the plurality of cameras and the second of the plurality of cameras are configured to pan, tilt and zoom;
• and
• Implements a self-healing scheme to recalibrate after camera position changes, change of focus and camera upgrades, wherein people-based calibration is activated during the recalibrating.