Method and system of depth data filling of shadows for image processing

A computer-implemented system of depth data filling of shadows for image processing, comprising:

• at least one display;
• at least one memory;
• at least one processor communicatively coupled to the display and the memory;
• and
• a shadow filling unit operated by the at least one processor and to operate by:
• obtaining a location of at least one gap of missing depth data on pixel image data of at least one image;
• calculating a shadow band length corresponding to a size and position of the gap on the image, and calculated by using, at least in part, background and foreground depth values;
• forming a revised foreground depth value to be used to determine the shadow band length and the forming comprising:
• comparing a maximum depth value on a foreground object on the image and to the depth values at pixel end locations adjacent the start and end of the gap along a straight line of pixels forming the gap;
• setting the revised foreground depth value equal to a second greatest depth value among the maximum depth value and the pixel end location depth values when at least one of the pixel end locations has a depth value greater than the maximum depth value, and
• setting the maximum depth value as the revised foreground depth value when the maximum depth value is greater than both pixel end location depth values;
• and
• providing depth values for multiple pixel locations extending along the shadow band length.

A non-transitory computer-readable medium having stored thereon instructions that when executed cause a computing device to operate by:

• obtaining a location of at least one gap of missing depth data on pixel image data of at least one image;
• calculating a shadow band length corresponding to a size and position of the gap on the image, and calculated by using, at least in part, background and foreground depth values;
• forming a revised foreground depth value to be used to determine the shadow band length and the forming comprising:
• comparing a maximum depth value on a foreground object on the image and to the depth values at pixel end locations near the start and end of the gap along a straight line of pixels forming the gap;
• setting the revised foreground depth value equal to a second greatest depth value among the maximum depth value and the pixel end location depth values when at least one of the pixel end locations has a depth value greater than the maximum depth value, and
• setting the maximum depth value as the revised foreground depth value when the maximum depth value is greater than both pixel end location depth values;
• and
• providing depth values for multiple pixel locations extending along the shadow band length.