Efficient Video Prediction using Motion Graph
AssigneeMicrosoft Technology Licensing, LLC
InventorsYiqi ZHONG, Luming LIANG, Ilya Dmitriyevich ZHARKOV
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsYiqi ZHONG, Luming LIANG, Ilya Dmitriyevich ZHARKOV
Estimating the term…
A video prediction technique generates a motion graph based on given video frames. The motion graph includes spatial edges and temporal edges. Each spatial edge describes a same-frame semantic relationship between two graph nodes that are associated with a same video frame. Each temporal edge describes an interframe relationship between two graph nodes of temporally neighboring frames. The temporal edges include backward temporal edges and forward temporal edges. The technique further includes generating initial motion feature information associated with the graph nodes in the plural given video frames, and updating the motion feature information by performing message-passing operations. The technique decodes the motion feature information into dynamic vector information. The technique then predicts and synthesizes a subsequent video frame based on the given video frames and the dynamic vector information.
A method for predicting a subsequent video frame in a sequence of video frames, comprising:
A computing system for processing plural given video frames, comprising:
A computer-readable storage medium for storing computer-readable instructions, a processing system executing the computer-readable instructions to perform operations, the operations comprising each of:
Dependencies are inferred from the claim text.