Depth data processing system capable of performing image registration on depth maps to optimize depth data

A method for operating a depth data processing system, the depth data processing system comprising a first depth capture device, a second depth capture device, a third depth capture device and a depth processing unit, the method comprising:

• generating a first depth map by at least the first depth capture device;
• generating a second depth map by at least the second depth capture device;
• generating a third depth map by the third depth capture device;
• the depth processing unit performing image registration on the first depth map and the second depth map to generate transformed coordinates in the second depth map corresponding to pixels in the first depth map;
• the depth processing unit performing image registration on the third depth map and the second depth map to generate transformed coordinates in the second depth map corresponding to pixels in the third depth map;
• and
• the depth processing unit aligning depth data of the first depth map, depth data of the second depth map and depth data of the third depth map to generate an optimized depth map according to the transformed coordinates in the second depth map corresponding to the pixels in the first depth map and the transformed coordinates in the second depth map corresponding to the pixels in the third depth map.