Depth modification for display applications

A non-transitory computer-readable medium containing a program which, when executed, performs an operation to programmatically conform multiscopic video content to restricted depth ranges supported by autostereoscopic displays, the operation comprising:

• receiving a multiscopic video frame comprising at least first and second images depicting a scene;
• receiving depth information pertaining to the multiscopic video frame and exceeding a depth range supported by a target autostereoscopic display as measured based on a predefined perception criterion, wherein the supported depth range is smaller in extent than that of a non-autostereoscopic display, wherein the depth information comprises pixel-specific depth information represented as one or more grayscale images;
• determining a depth mapping function based on one or more image characteristics of the multiscopic video frame, other than depth, the one or more image characteristics including at least saliency and edges;
• modifying the depth information based on the depth mapping function and using:
• a mapping algorithm that at least partially preserves perceptible depth in the scene with a predefined degree of depth compression and by accounting for the depth range supported by the target autostereoscopic display, wherein the modified depth information conforms to the depth range supported by the target autostereoscopic display;
• at least partially preserving, in a third image, the saliency and edges of the multiscopic video frame, by generating the third image by operation of one or more computer processors when executing the program and based on (i) the modified depth information and (ii) at least one of the first and second images;
• and
• extending a perceptible depth range of the scene by forming multiview output for the target autostereoscopic display, including augmenting the multiscopic video frame to include the generated third image, wherein the augmented multiscopic video frame is output for display via the target autostereoscopic display.

A system to programmatically conform multiscopic video content to restricted depth ranges supported by autostereoscopic displays, the system comprising:

• one or more computer processors;
• a memory containing a program which, when executed by the one or more computer processors, performs an operation comprising:
• receiving a multiscopic video frame comprising at least first and second images depicting a scene;
• receiving depth information pertaining to the multiscopic video frame and exceeding a depth range supported by a target autostereoscopic display as measured based on a predefined perception criterion, wherein the supported depth range is smaller in extent than that of a non-autostereoscopic display, wherein the depth information comprises pixel-specific depth information represented as one or more grayscale images;
• determining a depth mapping function based on one or more image characteristics of the multiscopic video frame, other than depth, the one or more image characteristics including at least saliency and edges;
• modifying the depth information based on the depth mapping function and using:
• a mapping algorithm that at least partially preserves perceptible depth in the scene with a predefined degree of depth compression and by accounting for the depth range supported by the target autostereoscopic display, wherein the modified depth information conforms to the depth range supported by the target autostereoscopic display;
• at least partially preserving, in a third image, the saliency and edges of the multiscopic video frame, by generating the third image based on (i) the modified depth information and (ii) at least one of the first and second images;
• and
• extending a perceptible depth range of the scene by forming multiview output for the target autostereoscopic display, including augmenting the multiscopic video frame to include the generated third image, wherein the augmented multiscopic video frame is output for display via the target autostereoscopic display.