Principle component analysis of images for the automatic location of control points
AssigneeInterval Research Corporation
InventorsMichele Covell, Christoph Bregler
Life of this patent
Estimating the term…
Loading patent…
AssigneeInterval Research Corporation
InventorsMichele Covell, Christoph Bregler
Estimating the term…
The identification of hidden data, such as feature-based control points in an image, from a set of observable data, such as the image, is achieved through a two-stage approach. The first stage involves a learning process, in which a number of sample data sets, e.g. images, are analyzed to identify the correspondence between observable data, such as visual aspects of the image, and the desired hidden data, such as the control points. Two models are created. A feature appearance-only model is created from aligned examples of the feature in the observed data. In addition, each labeled data set is processed to generate a coupled model of the aligned observed data and the associated hidden data. In the image processing embodiment, these two models might be affine manifold models of an object's appearance and of the coupling between that appearance and a set of locations on the object's surface. In the second stage of the process, the modeled feature is located in an unmarked, unaligned data set, using the feature appearance-only model. This location is used as an alignment point and the coupled model is then applied to the aligned data, giving an estimate of the hidden data values for that data set. In the image processing example, the object's appearance model is compared to different image locations. The matching locations are then used as alignment points for estimating the locations on the object's surface from the appearance in that aligned image and form the coupled model.
A method for determining continuous-valued hidden data from observable data, comprising the steps of:
The method of claim further including the steps of selecting a plurality of said representative sets of data, using hidden data in said plurality of data sets to automatically generate interpolated data sets that are based on said plurality of data sets and that contain observable data, and including said interpolated data sets in the plurality of representative data sets that are analyzed to generate said first model.
The method for establishing a relationship between at least two unlabelled images, comprising the steps of:
A method for establishing a relationship between at least two unlabelled images, comprising the steps of:
A method for indexing data into a multi-faceted model using a single-faceted global manifold model to which the data relates, comprising the steps of:
A model for aligning observed data to a manifold model, comprising the steps of:
Dependencies are inferred from the claim text.