System and method for 3D object detection and tracking with monocular surveillance cameras

A method, comprising:

• receiving, by a computing device, a plurality of video frames captured by a camera;
• detecting, by the computing device, an object from the video frames, wherein the detected object in each of the video frames is represented by a detection vector, the detection vector comprises first dimensions representing two dimensional (2D) parameters of the object and second dimensions representing three dimensional (3D) parameters of the object;
• tracking, by the computing device, the object in the video frames based on the detection vectors of the object from the video frames to obtain a trajectory of the object, wherein minimization of loss in tracking of the object is calculated based on the first dimensions and the second dimensions of the detection vectors;
• and
• transforming, by the computing device, the video frames into bird-view, wherein the bird view of the video frames comprises the trajectory of the object.

A non-transitory computer readable medium storing computer executable code, wherein the computer executable code, when executed at a processor of a computing device, is configured to:

• receive a plurality of video frames from a camera;
• detect an object from the video frames, wherein the detected object in each of the video frames is represented by a detection vector, the detection vector comprises first dimensions representing two dimensional (2D) parameters of the object and second dimensions representing three dimensional (3D) parameters of the object;
• track the object in the video frames based on the detection vectors of the object from the video frames to obtain a trajectory of the object, wherein minimization of loss in tracking of the object is calculated based on the first dimensions and the second dimensions of the detection vectors;
• and
• transform the video frames into bird-view, wherein the bird view of the video frames comprises the trajectory of the object.