System and Method for Detecting and Tracking Features in Images

Abstract

A system and method for tracking features, e.g., facial features, is provided, which allows for the tracking of features which move in a series of images and whose shape changes nonlinearly due to perspective projection and complex 3D movements. A training set of images is processed to produce clustered shape subspaces corresponding to the set of images, such that non-linear shape manifolds in the images are represented as piecewise, overlapping linear surfaces that are clustered according to similarities in perspectives. A landmark-based training algorithm (e.g., ASM) is applied to the clustered shape subspaces to train a model of the clustered shape subspaces and to create training data. A subsequent image is processed using the training data to identify features in the target image by creating an initial shape, superimposing the initial shape on the target image, and then iteratively deforming the shape in accordance with the model until a final shape is produced corresponding to a feature in the target image.

Dependencies are inferred from the claim text.