System and Method for Determining a Depth Map Sequence for a Two-Dimensional Video Sequence

A system for determining a depth map sequence for a subject two-dimensional video sequence, the depth map sequence comprising a depth map for each frame of the subject two-dimensional video, the system comprising:

• (a) a processor;
• and
• (b) a memory having statements and instructions stored thereon for execution by the processor to:
• (i) determine a plurality of monocular depth cues for each frame of the subject two-dimensional video sequence;
• (ii) determine a depth map for each frame of the subject two-dimensional video sequence based on the application of the plurality of monocular depth cues determined for the frame to a depth map model, the depth map model determined by:
• (1) determine a plurality of monocular depth cues for one or more training two-dimensional video sequences;
• and
• (2) determine a depth map model based the plurality of monocular depth cues of the one or more training two-dimensional video sequences and corresponding known depth maps for each of the one or more training two-dimensional video sequences.

The system as claimed in claim 47, wherein the spatial consistency signal conditioning comprises, for each frame of the subject two-dimensional video sequence:

• (a) dividing the frame into an array of blocks;
• (b) determining edge blocks in the array of blocks comprising object edges;
• (c) for each edge block:
• (i) determining which pixels in the edge block relate to an object and which pixels relate to a background;
• (ii) determining blocks in the array of blocks that are neighbouring the edge block that do not comprise object edges;
• (iii) determining pixels in the neighbouring blocks that do not comprise object edges which relate to an object and pixels which relate to a background;
• (iv) determining from the neighbouring blocks that do not comprise object edges, the median depth value in the depth map of pixels relating to an object and the median depth value in the depth map of pixels relating to a background.
• (v) setting the depth value in the depth map of pixels in the edge block relating to an object to the median depth value determined for pixels relating to an object in the neighbouring blocks that do not comprise object edges;
• and
• (vi) setting the depth value in the depth map of pixels in the edge block relating to a background to the median depth value determined for pixels relating to a background in the neighbouring blocks that do not comprise object edges.

A system of determining a depth map model for determining a depth map sequence for a subject two-dimensional video sequence, the depth map sequence comprising a depth map for each frame of the subject two-dimensional video, the system comprising

• (a) a processor;
• and
• (b) a memory having statements and instructions stored thereon for execution by the processor to:
• (i) determine a plurality of monocular depth cues for one or more training two-dimensional video sequences;
• and
• (ii) determine the depth map model based the plurality of monocular depth cues of the one or more training two-dimensional video sequences and corresponding known depth maps for each of the one or more training two-dimensional video sequences.