Authenticating a user by correlating speech and corresponding lip shape

A system, comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the memory includes an authentication module to:
• process an audiovisual of a user requesting authentication to generate a speech vector quantization sequence and a corresponding lip vector quantization sequence of the user;
• evaluate a likelihood of the speech vector quantization sequence and the corresponding lip vector quantization sequence to be from an authentic user based on co-occurrence probability distributions of consecutive speech vector quantization code words within a lip frame in the lip vector quantization sequence at a particular time, and weighted by probability distribution of vector quantization indices of speech and lip features corresponding to the user as indexed in a codebook;
• and
• authenticate the user, if upon evaluation, a likelihood of the user requesting authentication being the authentic user is more than a predefined threshold.

A method of authentication by correlating speech and corresponding lip shape of a user, comprising:

• capturing an audiovisual of a user requesting authentication;
• processing the audiovisual to generate a speech vector quantization (VQ) sequence and a corresponding lip shape VQ sequence of the user, wherein the speech VQ sequence includes speech VQ code word indices and the lip VQ sequence includes lip shape VQ code word indices respectively;
• evaluating a likelihood the speech VQ code word indices and the lip shape VQ code word indices with probability distributions of consecutive speech VQ code word indices within a lip shape VQ code word indices weighed by probabilities of speech and lip vector quantization sequence at a particular time, and weighted by probability distribution of vector quantization indices of speech and lip features corresponding to the user as indexed in a codebook;
• and
• authenticating the user, if upon evaluation, the likelihood of the user requesting authentication being an authentic user is more than a predefined threshold.