Online registration of dynamic scenes using video extrapolation

The method according to claim 17, further including combining frames or portions thereof in said sequence of frames and said different sequence of frames.

A computer-implemented program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform a method for determining camera movement of a new frame relative to a sequence of frames of images containing at least one dynamic object and for which relative camera movement is assumed, said method comprising:

• from changes in color values of sets of pixels in different frames of said sequence for which respective locations of all pixels in each set are adjusted so as to neutralize the effect of camera movement between the respective frames in said sequence containing said pixels, predicting corresponding color values of said pixels in the new frame so as to create a predicted frame or part thereof;
• and
• determining said camera movement as a relative movement of the new frame and the predicted frame or part thereof.

A computer-implemented computer program product comprising a computer useable medium having computer readable program code embodied therein for determining camera movement of a new frame relative to a sequence of frames of images containing at least one dynamic object and for which relative camera movement is assumed, said computer program product comprising:

• computer readable program code responsive to changes in color values of sets of pixels in different frames of said sequence for which respective locations of all pixels in each set are adjusted so as to neutralize the effect of camera movement between the respective frames in said sequence containing said pixels, for causing the computer to predict corresponding color values of said pixels in the new frame so as to create a predicted frame or part thereof, and
• computer readable program code for causing the computer to determine said camera movement as a relative movement of the new frame and the predicted frame or part thereof.

A computer-implemented program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform a method for determining camera movement relative to a sequence of frames of images containing at least one dynamic object and for which there exists an aligned space-time volume of frames for which camera movement between said frames is neutralized, said method comprising:

• from changes in color values of pixels in different frames of the aligned space-time volume, predicting corresponding color values of said pixels in a new frame so as to create a predicted frame or part thereof;
• and
• determining said camera movement as a relative movement of the new frame and the predicted frame or part thereof.

A computer-implemented computer program product comprising a computer useable medium having computer readable program code embodied therein for determining camera movement relative to a sequence of frames of images containing at least one dynamic object and for which there exists an aligned space-time volume of frames for which camera movement between said frames is neutralized, said computer program product comprising:

• computer readable program code responsive to changes in color values of pixels in different frames of the aligned space-time volume, for causing the computer to predict corresponding color values of said pixels in a new frame so as to create a predicted frame or part thereof;
• and
• computer readable program code for causing the computer to determine said camera movement as a relative movement of the new frame and the predicted frame or part thereof.