System and method for three dimensional object tracking using combination of radar and image data

A system comprising:

• a camera configured to provide two dimensional image data;
• a radar device configured to provide radar data;
• a computer communicatively coupled with the camera and the radar device, the computer comprising a hardware processor and a memory coupled with the hardware processor, the memory encoding instructions configured to cause the hardware processor to
• identify a golf ball in flight in the two dimensional image data,
• fit a curve to the radar data to generate a continuous function of time for the radar data,
• find radial distances to the golf ball using the continuous function and times of observations of the golf ball identified in the two dimensional image data,
• find depth distances to the golf ball using the radial distances and angles between a camera reference location in the two dimensional image data and the observations of the golf ball identified in the two dimensional image data,
• find horizontal distances to the golf ball using the depth distances, a focal length of the camera, and horizontal offsets between the camera reference location and the observations of the golf ball identified in the two dimensional image data,
• find vertical distances to the golf ball using the depth distances, the focal length of the camera, and vertical offsets between the camera reference location and the observations of the golf ball identified in the two dimensional image data, and
• provide three dimensional location information of the golf ball in three dimensional space to augment other data before display, the three dimensional location information corresponding to the depth distances, the horizontal distances and the vertical distances.