Multiview video stabilization

A system for providing multiview video stabilization comprising:

• a memory configured to store multiview video comprising a plurality of synchronized input video streams from a corresponding plurality of cameras;
• and
• a processor coupled to the memory, the processor to:
• attain the multiview video;
• select a reference view of the synchronized input video streams, wherein the reference view corresponds to an observed view of a viewer;
• perform single view video stabilization, to compensate for video jitter, on a reference video stream, corresponding to the reference view, of the plurality of synchronized input video streams to generate a stabilized reference video stream, wherein to perform the single view video stabilization comprises the processor to apply a stabilization transform to a frame of the reference video stream to generate a stabilized frame of the stabilized reference video stream;
• detect a plurality of locations of stabilized feature points from the stabilized frame;
• propagate the single view video stabilization to a second video stream of the plurality of synchronized input video streams, wherein the processor to propagate the single view video stabilization comprises the processor to generate a target disparity map based on application of the stabilization transform to an initial disparity map for the frame of the reference video stream and a synchronized frame of the second video stream and minimization of at least a vertical component or a horizontal component of the target disparity map, the target disparity map comprising a plurality of disparity vectors, to determine locations for synchronized stabilized feature points of a synchronized stabilized frame of the second video stream corresponding to the stabilized frame by determining the locations for the synchronized stabilized feature points that minimize an energy term comprising a plurality of differences between the locations of the synchronized stabilized feature points and sums of corresponding locations of the stabilized feature points of the stabilized frames and corresponding disparity vectors of the target disparity map, and to perform video stabilization on the second video stream by warping the synchronized frame using the synchronized stabilized feature points to generate a synchronized stabilized frame of a stabilized second video stream;
• and
• a display to present stabilized multiview video comprising at least the stabilized second video stream to the viewer.

At least one non-transitory machine readable medium comprising a plurality of instructions that, in response to being executed on a device, cause the device to provide multiview video stabilization by:

• attaining input multiview video comprising a plurality of synchronized input video streams from a corresponding plurality of cameras;
• selecting a reference view of the synchronized input video streams, wherein the reference view corresponds to an observed view of a viewer;
• performing single view video stabilization, to compensate for video jitter, on a reference video stream, corresponding to the reference view, of the plurality of synchronized input video streams to generate a stabilized reference video stream, wherein performing the single view video stabilization comprises applying a stabilization transform to a frame of the reference video stream to generate a stabilized frame of the stabilized reference video stream;
• detecting a plurality of locations of stabilized feature points from the stabilized frame;
• propagating the single view video stabilization to a second video stream of the plurality of synchronized input video streams by:
• generating a target disparity map by applying the stabilization transform to an initial disparity map for the frame of the reference video stream and a synchronized frame of the second video stream and by minimizing at least a vertical component or a horizontal component of the target disparity map, the target disparity map comprising a plurality of disparity vectors;
• determining locations for synchronized stabilized feature points of a synchronized stabilized frame of the second video stream corresponding to the stabilized frame by determining the locations for the synchronized stabilized feature points that minimize an energy term comprising a plurality of differences between the locations of the synchronized stabilized feature points and sums of corresponding locations of the stabilized feature points of the stabilized frames and corresponding disparity vectors of the target disparity map;
• and
• performing video stabilization on the second video stream by warping the synchronized frame using the synchronized stabilized feature points to generate a synchronized stabilized frame of a stabilized second video stream;
• and
• presenting stabilized multiview video comprising at least the stabilized second video stream to the viewer.