US 6,492,986 B1 · Method for human face shape and motion estimation based on integrating optical flow and deformable models

Abstract

A method and apparatus for human face shape and motion estimation based on integrating optical flow and deformable models is disclosed. The optical flow, constraint equation provides a non-holonomic constraint on the motion of the deformable model. Forces computed from edges and optical flow are used simultaneously. When this dynamic system is solved, a model-based least-squares solution for the optical flow is obtained and improved estimation results are achieved. The use of a 3-D model reduces or eliminates problems associated with optical flow computation. This approach instantiates a general methodology for treating visual cues as constraints on deformable models. The model uses a small number of parameters to describe a rich variety of face shapes and facial expressions.

Claims18

Dependent claims

A method for human face shape and motion estimation comprising the steps of:

receiving an image of a face;
developing a deformable face model of the face, the model having a plurality of parameters and a three-dimensioned velocity, each parameter having a velocity;
incorporating optical flow as a constraint in the model by providing a system of optical flow constraints in terms of the parameters of the model, the optical flow constraints including image velocities which are identified with a projection of the three-dimensional velocity of the model;
incorporating edge forces on the model by determining likely locations of edges in the image;
and
combining the optical flow constraints with the edge forces.

3 more elements

Dependencies are inferred from the claim text.

Method for human face shape and motion estimation based on integrating optical flow and deformable models

Life of this patent

Method for human face shape and motion estimation based on integrating optical flow and deformable models

Life of this patent

Abstract

Claims18