Back to results
US 2003/0212552 A1Published application
Face recognition procedure useful for audiovisual speech recognition
OwnerLu Hong Liang, Xiaobo Pi +3inventors
InventorsLu Hong Liang, Xiaobo Pi, Xiaoxing Liu, Crusoe Mao, Ara V. Nefian
Life of this patent
Estimating the term…
Abstract
A visual feature extraction method includes application of multiclass linear discriminant analysis to the mouth region. Lip position can be accurately determined and used in conjunction with synchronous or asynchronous audio data to enhance speech recognition probabilities.
Claims24
A visual feature extraction method comprising
- segmenting a mouth region from the detected face,
- finding the contour of the lips, and widowing the mouth region to emphasize the region inside the lip contour,
- applying the two dimensional discrete cosine transform on blocks within the mouth region,
- applying multiclass linear discriminant analysis to the windowed mouth region.
1 more element
An article comprising a computer readable medium to store computer executable instructions, the instructions defined to cause a computer to
- detect a face in video data,
- segment a mouth region in the detected face,
- apply multiclass linear discriminant analysis to the mouth region.
A speech recognition system comprising
- an audiovisual capture module to respectively provide a first data stream of speech data and a second data stream of video data,
- a visual feature extraction module that detects a face in the second data stream of video data, discriminates a mouth region in the detected face, and applies multiclass linear discriminant analysis to the mouth region, and
- a speech recognition module that applies a two stream coupled hidden Markov model to the first data stream of speech data and the second video data stream processed by the visual feature extraction module.
Dependencies are inferred from the claim text.