Joint view expansion and filtering for automultiscopic 3D displays

A computer-implemented system for rendering a three-dimensional (3D) video display, comprising:

• at least one processor configured to implement:
• a receiving module configured to receive a video stream formed of a sequence of frames, each frame having image content corresponding to a plurality of views, the views being initial views;
• a computing module responsive to the receiving module and configured to apply one or more spatial band pass filters to the received image content resulting in filtered images, each spatial band pass filter having a respective spatial frequency band;
• the computing module further configured to compute, from the filtered images, one or more output images that synthesize additional views with respect to the initial views, the output images computed from the filtered images of a given spatial band pass filter corresponding to different visual disparities for the respective spatial frequency band of that given band pass filter;
• the computing module further configured to remove inter-view aliasing by performing filtering of the output images:
• (i) according to local depth using phase shift including correcting the phase shift in each sub-band of the respective spatial frequency band separately based on the phase shift in a given corresponding sub-band having a lower frequency as compared with the respective spatial frequency band, and (ii) based upon performing a steerable pyramid decomposition and a corresponding attenuation of coefficients of the steerable pyramid decomposition;
• and
• a display module coupled to receive from the computing module and configured to drive a display with the computed and anti-aliased filtered output images, rendering a multi-view autostereoscopic 3D video display.

A non-transitory computer readable medium having stored thereon a sequence of instructions which, when loaded and executed by a processor coupled to an apparatus, causes the apparatus to:

• receive a video stream formed of a sequence of frames, each frame having image content corresponding to a plurality of views, the views being initial views;
• apply one or more spatial band pass filters to the received image content resulting in filtered images, each spatial band pass filter having a respective spatial frequency band;
• compute, from the filtered images, one or more output images that synthesize additional views with respect to the initial views, the output images computed from the filtered images of a given spatial band pass filter corresponding to different visual disparities for the respective spatial frequency band of that given band pass filter;
• including removing inter-view aliasing by performing filtering of the output images:
• (i) according to local depth using phase shift including correcting the phase shift in each sub-band of the respective spatial frequency band separately based on the phase shift in a given corresponding sub-band having a lower frequency as compared with the respective spatial frequency band, and (ii) based upon performing a steerable pyramid decomposition and a corresponding attenuation of coefficients of the steerable pyramid decomposition;
• and
• drive a display with the computed and anti-aliased filtered output images, rendering a multi-view autostereoscopic 3D video display.