Method for tracking facial features in a video sequence
AssigneeCanon Kabushiki Kaisha
InventorFabrice Lestideau
Life of this patent
Estimating the term…
Abstract
A method (100) of tracking facial features in a video sequence is disclosed. The method receives (110) as input facial features for tracking in a first frame of the video sequence. The video sequence is also segmented (120) using spatiotemporal segmentation to provide a sequence of associated two-dimensional segments, with a first segment in the sequence of associated two-dimensional segments including the facial features for tracking. Candidate facial features are then identified (140) in at least a second two-dimensional segment in the sequence of associated segments. Method (100) then verifies (155) which of the candidate facial features correspond with the facial features for tracking. Method (100) also recovers lost facial features by using known geometric relations between facial features.
Claims12
A method of tracking facial features in a video sequence, said method comprising the steps of:
- (a) receiving facial features for tracking in a first frame of said video sequence;
- (b) spatiotemporally segmenting said video sequence to provide a sequence of associated two-dimensional segments, a first two-dimensional segment in said sequence of associated two-dimensional segments including said facial features for tracking;
- (c) identifying candidate facial features in a second two-dimensional segment in a second frame of said video sequence, said second two-dimensional segment being one of said sequence of associated two-dimensional segments;
- and
- (d) verifying which of said candidate facial features correspond with said facial features for tracking.
A method as claimed in 1 wherein step (d) measures the correspondence between said candidate facial features and said facial features for tracking.
An apparatus for tracking facial features in a video sequence, said apparatus comprising:
- means for receiving facial features for tracking in a first frame of said video sequence;
- means for spatiotemporally segmenting said video sequence to provide a sequence of associated two-dimensional segments, a first two-dimensional segment in said sequence of associated two-dimensional segments including said facial features for tracking;
- means for identifying candidate facial features in a second two-dimensional segment in a second frame of said video sequence, said second two-dimensional segment being one of said sequence of associated two-dimensional segments;
- and
- means for verifying which of said candidate facial features correspond with said facial features for tracking.
A program stored on a memory medium for tracking facial features in a video sequence, said program comprising:
- code for receiving facial features for tracking in a first frame of said video sequence;
- code for spatiotemporally segmenting said video sequence to provide a sequence of associated two-dimensional segments, a first two-dimensional segment in said sequence of associated two-dimensional segments including said facial features for tracking;
- code for identifying candidate facial features in at least a second two-dimensional segment in a second frame of said video sequence, said second two-dimensional segment being one of said sequences of associated two-dimensional segments;
- and
- code for verifying which of said candidate facial features correspond with said facial features for tracking.
Dependencies are inferred from the claim text.