Method and apparatus for optimizing depth information

An apparatus for optimizing depth information, wherein the apparatus obtains a left image and a right image through shooting of a three dimensional imaging system, and comprises:

• a storage unit, configured to record a plurality of modules;
• and
• one or more processing units, coupled to the storage unit to access and execute the modules recorded in the storage unit, and the modules comprising:
• a segmentation map obtaining module, dividing one of the left image and the right image into a plurality of segmentations for obtaining a plurality of segmentation maps;
• a depth plane dividing module, obtaining a necessary repair depth map, and partitioning the necessary repair depth map into a plurality of depth planes according to a plurality of primary depth values and a camera parameter, wherein the necessary repair depth map records the primary depth values and has a plurality of holes;
• and
• a hole-filling module, respectively generating a plurality of optimized depth values for the holes in each of the depth planes by using the segmentation maps, and filling the optimized depth values into the depth planes to obtain an optimized depth map combining each of the depth planes.