US 10,650,259 B2Granted

Human face recognition method and recognition system based on lip movement information and voice information

AssigneeTencent Technology (Shenzhen) Company Limited

InventorsChengjie Wang, Jilin Li, Hui Ni, Yongjian Wu, Feiyue Huang

Life of this patent

Estimating the term…

Loading patent…

Abstract

The embodiment of the present invention provides a human face recognition method and recognition system. The method includes that: a human face recognition request is acquired, and a statement is randomly generated according to the human face recognition request; audio data and video data returned by a user in response to the statement are acquired; corresponding voice information is acquired according to the audio data; corresponding lip movement information is acquired according to the video data; and when the lip movement information and the voice information satisfy a preset rule, the human face recognition request is permitted. By performing fit goodness matching between the lip movement information and voice information in a video for dynamic human face recognition, an attack by human face recognition with a real photo may be effectively avoided, and higher security is achieved.

Claims18

Dependent claims

A human face recognition method performed at an apparatus having one or more processors and one or more memories for storing instructions to be executed by the one or more processors, wherein the method comprises:

acquiring a human face recognition request, and randomly generating a statement according to the human face recognition request;
acquiring audio data and video data returned by a user in response to the statement;
acquiring voice information corresponding to the audio data;
judging whether a content of the statement is consistent with the voice information;
in response to judging that the content of the statement is inconsistent with the voice information, prompting that the human face recognition request is not permitted;
and
in response to judging that the content of the statement is consistent with the voice information;
acquiring lip movement information corresponding to the video data;
judging whether a fit goodness between the lip movement information and the voice information is higher than a fit goodness threshold value;
in response to judging that the fit goodness is not higher than the fit goodness threshold value, prompting that the human face recognition request is not permitted;
and
in response to judging that the fit goodness is higher than the fit goodness threshold value, permitting the human face recognition request.

9 more elements

A human face recognition system, wherein the system comprises:

one or more processors;
and
one or more memories having instructions stored thereon, wherein the instructions, when executed by the one or more processors, cause the one or more processors to perform:
acquiring a human face recognition request, and randomly generating a statement according to the human face recognition request;
acquiring audio data and video data returned by a user in response to the statement;
acquiring voice information corresponding to the audio data;
judging whether a content of the statement is consistent with the voice information;
in response to judging that the content of the statement is inconsistent with the voice information, prompting that the human face recognition request is not permitted;
and
in response to judging that the content of the statement is consistent with the voice information;
acquiring lip movement information corresponding to the video data;
judging whether a fit goodness between the lip movement information and the voice information is higher than a fit goodness threshold value;
in response to judging that the fit goodness is not higher than the fit goodness threshold value, prompting that the human face recognition request is not permitted;
and
in response to judging that the fit goodness is higher than the fit goodness threshold value, permitting the human face recognition request.

12 more elements

A non-transitory computer readable storage medium storing instructions, the instructions, when being executed by a processor, cause the processor to perform:

acquiring a human face recognition request, and randomly generating a statement according to the human face recognition request;
acquiring audio data and video data returned by a user in response to the statement;
acquiring voice information corresponding to the audio data;
judging whether a content of the statement is consistent with the voice information;
in response to judging that the content of the statement is inconsistent with the voice information, prompting that the human face recognition request is not permitted;
and
in response to judging that the content of the statement is consistent with the voice information;
acquiring lip movement information corresponding to the video data;
judging whether a fit goodness between the lip movement information and the voice information is higher than a fit goodness threshold value;
in response to judging that the fit goodness is not higher than the fit goodness threshold value, prompting that the human face recognition request is not permitted;
and
in response to judging that the fit goodness is higher than the fit goodness threshold value, permitting the human face recognition request.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/644,043Filed 7 Jul 2017 · continuation
Priority: CN 2015 1 031947011 Jun 2015
Published: US 2017/0308739 A126 Oct 2017
Granted: 12 May 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification12 codes

G10L 25/51
Specially adapted for particular use: for comparison or discrimination
G06F 21/32
User authentication: using biometric data, e.g. fingerprints, iris scans or voiceprints
G06V 10/507
By performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity…
G06V 40/161
Human faces, e.g. facial parts, sketches or expressions: detection; Localisation; Normalisation