In-Scene Editing of Image Sequences

A user interface comprising:

• an input arranged to access a scene coordinate system for a sequence of images of a scene;
• an input arranged to receive user information specifying a 3D object model;
• a display arranged to display an image in the sequence as selected by a user and also to display the 3D object model at a default position in that image;
• an input arranged to receive a user input to modify a set of projection constraints on the basis of that user input;
• a processor arranged to compute a 3D motion trajectory in the scene coordinate system which optimizes the modified set of projection constraints and which also optimizes a smoothness indicator;
• and
• an output arranged to display the image sequence and to transform the 3D object model in that image sequence on the basis of the computed trajectory.

One or more device-readable media with device-executable instructions for performing steps comprising:

• accessing a scene coordinate system for a sequence of images of a scene;
• receiving a 3D object model;
• displaying an image in the sequence as selected by a user and displaying the 3D object model at a default position in that image;
• receiving a user input and modifying a set of projection constraints on the basis of that user input;
• and
• computing and storing a 3D motion trajectory in the scene coordinate system which optimizes the modified set of projection constraints and which also optimizes a smoothness indicator.