Stabilization of objects within a video sequence

A computer-implemented process for automatically stabilizing a layered representation of an image sequence, comprising using a computing device to:

• acquire an image sequence having a plurality of image frames;
• automatically decompose the image sequence into a generative model, said generative model including a set of model parameters that represent at least one probabilistic object and at least one image layer learned for each image frame;
• automatically regenerating a stabilized layered representation of the image sequence by using the generative model to construct an output image sequence corresponding to one or more of the frames of the input image sequence;
• and
• wherein constructing the output image sequence comprises using the model parameters for performing an inverse transformation and alignment of one or more of the learned probabilistic objects and image layers from one or more sequential frames of the input image sequence for stabilizing those objects and layers relative to new sequential image frames comprising the output image sequence.

A non-transitory computer-readable medium having computer executable instructions for automatically learning and stabilizing layered flexible image sprites in an input image sequence, comprising:

• receiving an image sequence of at least two image frames of a scene;
• automatically learning a probabilistic number of image sprite classes to be identified within the image sequence;
• automatically learning a probabilistic dimensionality of each image sprite class;
• automatically learning a probabilistic number of layers for the image sprite classes;
• automatically learning at least one layered image sprite from the image sequence given the automatically learned number of image sprite classes, image sprite dimensionality, and image layers, wherein each image sprite represents an object in the image sequence;
• automatically constructing a generative model from the automatically learned layered image sprites, wherein the generative model includes a set of model parameters that represent the input sequence;
• and
• using the generative model for reconstructing at least one sequential image frame from at least one of the objects in the image sequence by performing an inverse transformation and alignment of corresponding objects from one or more sequential frames of the image sequence to create an output sequence.