3DTV at home: Eulerian-Lagrangian stereo-to-multi-view conversion

A method of converting stereo video content to multi-view video content, comprising:

• generating a disparity map for each of the left and right views of a received stereoscopic frame;
• for each corresponding pair of left and right scanlines of the received stereoscopic frame, decomposing the left and right scanlines into a left wavelet and a right wavelet, each of the wavelets being a sum of basis functions;
• establishing an initial disparity correspondence between the left wavelet and the right wavelet based on the generated disparity maps;
• refining the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets;
• and
• reconstructing at least one novel view based on the left and right wavelets.

A system for converting stereo video content to multi-view video content, comprising:

• a frame duplicator configured to receive a stereoscopic frame and produce a first stereoscopic frame copy and a second stereoscopic frame copy therefrom;
• a pyramid decomposition processor configured to receive the first stereoscopic frame copy and produce a first pyramid corresponding to the first stereoscopic frame copy and a second pyramid corresponding to the first stereoscopic frame copy;
• a disparity processor configured to receive the second stereoscopic frame copy, and decomposition information from the pyramid decomposition processor, and to produce disparity information therefrom;
• a re-projection processor configured to receive the first pyramid and the second pyramid from the pyramid decomposition processor, and disparity information from the disparity processor, and to produce pyramid re-projection information therefrom;
• and
• a pyramid reconstruction processor configured to receive the re-projection information from the wavelet re-projection processor and to produce at least one novel view therefrom.

A non-transitory computer-readable medium with computer code instruction stored thereon, the computer code instructions, when executed by a processor, cause an apparatus to:

• generate a disparity map for each of the left and right views of a received stereoscopic frame;
• for each corresponding pair of left and right scanlines of the received stereoscopic frame, decompose the left and right scanlines into a left wavelet and a right wavelet, each of the wavelets being a sum of basis functions;
• establish an initial disparity correspondence between the left wavelet and the right wavelet based on the generated disparity maps;
• refine the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets;
• and
• reconstruct at least one novel view based on the left and right wavelets.