# US 10,482,230 B2 · Face-controlled liveness verification > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,230 B2 - Document ID: US10482230B2 - Status: Granted - Kind: B2 - Application number: 16/124,121 - Filed: 2018-09-06 - Published: 2019-01-03 - Granted: 2019-11-19 - Earliest claimed: 2015-12-29 - Assignees: Sensory, Incorporated - Applicants: Sensory, Incorporated - Inventors: Matthew Wilder - Web page: https://patentgrep.com/patent/US10482230B2 ## CPC - G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints - G06F 21/36: by graphic or iconic representation - G06V 40/166: {using acquisition arrangements} - G06V 40/45: {Detection of the body part being alive} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Techniques for implementing face-controlled liveness verification are provided. In one embodiment, a computing device can present, to a user, a sequential series of targets on a graphical user interface (GUI) of the computing device, where each target is a visual element designed to direct the user's attention to a location in the GUI. The computing device can further determine whether the user has successfully hit each target, where the determining comprises tracking movement of a virtual pointer controlled by the user's gaze or face pose and checking whether the user has moved the virtual pointer over each target. If the user has successfully hit each target, the computing device can conclude that the user is a live subject. ## Claims ### Claim 1 A method comprising: receiving, by a computing device from a user, an indication that the user wishes to access a secured resource on the computing device; attempting, by the computing device, to authenticate the user based on first biometric data presented by the user to a biometric-based authentication system of the computing device; and if the attempting to authenticate the user is successful: presenting, by the computing device in a graphical user interface (GUI), a first visual target in a sequence of visual targets, the first visual target being presented at a random location in the GUI; determining, by the computing device, whether the user has directed his or her gaze at the first visual target for a predetermined period of time; if the user has directed his or her gaze at the first visual target for the predetermined period of time: changing, by the computing device, a color of the first visual target in the GUI; attempting, by the computing device, to re-authenticate the user based on second biometric data presented by the user to the biometric-based authentication system of the computing device; and if the attempting to re-authenticate the user is successful, repeating the presenting and the determining steps for a next visual target in the sequence of visual targets. ### Claim 2 (depends on 1) The method of claim 1 further comprising: if the attempting to authenticate the user is unsuccessful, denying the user access to the secured resource. ### Claim 3 (depends on 2) The method of claim 2 further comprising: if the attempting to re-authenticate the user is unsuccessful, denying the user access to the secured resource. ### Claim 4 (depends on 1) The method of claim 1 further comprising, prior to presenting the first visual target: directing the user to look at a reference point in the GUI; capturing one or more images of a face of the user while the user is looking at the reference point; extracting one or more facial features from the one or more images; and determining, based on the one or more extracted facial features, a reference frame for the user, the reference frame indicating a direction of gaze of the user when looking at the reference point. ### Claim 5 (depends on 4) The method of claim 4 wherein determining whether the user has directed his or her gaze at the first visual target for the predetermined period of time comprises: capturing one or more further images of the user's face; and comparing a direction of gaze of the user in each of the one or more further images against the direction of gaze in the reference frame in order to determine how far and in which direction the user has moved his or her gaze from the reference point. ### Claim 6 (depends on 1) The method of claim 1 wherein the first biometric data comprises both face biometric data and voice biometric data. ### Claim 7 (depends on 6) The method of claim 6 wherein the second biometric data comprises only face biometric data. ### Claim 8 (depends on 1) The method of claim 1 wherein if the user is able to direct his or her gaze at every visual target in the sequence of visual targets for the predetermined period of time, and if the user is successfully re-authenticated after directing his or her gaze at every visual target, the computing device is configured to conclude that the user is a live subject and grant the user access to the secured resource. ### Claim 9 (depends on 1) The method of claim 1 where a total number of visual targets in the sequence of visual targets is selected at random. ### Claim 10 (depends on 1) The method of claim 1 wherein a total number of visual targets in the sequence of targets is selected based on a degree of security associated with the secured resource. ### Claim 11 (depends on 10) The method of claim 10 wherein the secured resource is a secured application or file on the computing device. ### Claim 12 (depends on 1) The method of claim 1 wherein the method is performed during a face enrollment process for the user. ### Claim 13 (depends on 12) The method of claim 12 further comprising, while the user is attempting to directed his or her gaze at the first visual target: capturing one or more images of the user's face; and adding the one or more captured images to a face enrollment template for the user. ### Claim 14 (depends on 1) The method of claim 1 wherein the first visual target corresponds to a secret known to the user. ### Claim 15 (depends on 1) The method of claim 1 wherein each visual target in the sequence of visual targets is rectangular in shape. ### Claim 16 (depends on 1) The method of claim 1 wherein the GUI includes a window displaying a real-time view of the user's face. ### Claim 17 (depends on 16) The method of claim 16 wherein each visual target in the sequence of visual targets is presented at a random location on a periphery of the window. ### Claim 18 A non-transitory computer readable medium having stored thereon program code executable by a processor of a computing device, the program code embodying a method comprising: receiving, from a user, an indication that the user wishes to access a secured resource on the computing device; attempting to authenticate the user based on first biometric data presented by the user to a biometric-based authentication system of the computing device; and if the attempting to authenticate the user is successful: presenting, in a graphical user interface (GUI), a first visual target in a sequence of visual targets, the first visual target being presented at a random location in the GUI; determining whether the user has directed his or her gaze at the first visual target for a predetermined period of time; if the user has directed his or her gaze at the first visual target for the predetermined period of time: changing a color of the first visual target in the GUI; attempting to re-authenticate the user based on second biometric data presented by the user to the biometric-based authentication system of the computing device; and if the attempting to re-authenticate the user is successful, repeating the presenting and the determining steps for a next visual target in the sequence of visual targets. ### Claim 19 A computing device comprising: a camera; a display; a biometric-based authentication subsystem; a processor; and a memory having stored thereon program code which, when executed by the processor, causes the processor to: receive, from a user, an indication that the user wishes to access a secured resource on the computing device; attempt to authenticate the user based on first biometric data presented by the user to the biometric-based authentication subsystem; and if the attempting to authenticate the user is successful: present, via the display, a first visual target in a sequence of visual targets, the first visual target being presented at a random location in the display; determine, using the camera, whether the user has directed his or her gaze at the first visual target for a predetermined period of time; if the user has directed his or her gaze at the first visual target for the predetermined period of time: change a color of the first visual target in the GUI; attempt to re-authenticate the user based on second biometric data presented by the user to the biometric-based authentication subsystem; and if the attempting to re-authenticate the user is successful, repeat the presenting and the determining steps for a next visual target in the sequence of visual targets.