# US 2021/0334570 A1 · Liveness detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334570 A1
- Document ID: US20210334570A1
- Status: Published application
- Kind: A1
- Application number: 17/372,748
- Filed: 2021-07-12
- Published: 2021-10-28
- Earliest claimed: 2018-06-11
- Inventors: LAURENCE HAMID; STEPHEN BORZA
- Web page: https://patentgrep.com/patent/US20210334570A1

## CPC

- G06V 40/45: {Detection of the body part being alive}
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06V 20/64: Three-dimensional [3D] objects
- G06V 40/168: {Feature extraction; Face representation}
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/172: {Classification, e.g. identification}
- G06F 2221/2133: Verifying human interaction, e.g., Captcha
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Biometrics are increasingly used to provide authentication and/or verification of a user in many security and financial applications for example. However, “spoof attacks” through presentation of biometric artefacts that are “false” allow attackers to fool these biometric verification systems. Accordingly, it would be beneficial to further differentiate the acquired biometric characteristics into feature spaces relating to live and non-living biometrics to prevent non-living biometric credentials triggering biometric verification. The inventors have established a variety of “liveness” detection methodologies which can block either low complexity spoofs or more advanced spoofs. Such techniques may provide for monitoring of responses to challenges discretely or in combination with additional aspects such as the timing of user's responses, depth detection within acquired images, comparison of other images from other cameras with database data etc.

## Claims

### Claim 1

A method comprising:
executing a process to establish whether a user associated with at least one of a verification process, an authorisation process and an authentication process is physically present or their presence is being simulated.

### Claim 2 (depends on 1)

The method according to claim 1, wherein
the process comprises:
acquiring data from an electronic device associated with the user when performing the at least one of a verification process, an authorisation process and an authentication process, the data comprising:
an identity of the electronic device;
geo-location data of the electronic device;
one or more other identities, each other identity associated with an other electronic device associated with the electronic device; and
one or more network identities, each network identity associated with an identity of a network or an element of network infrastructure associated with the electronic device;
acquiring other data from an electronic device associated with the user when performing the at least one of a verification process, an authorisation process and an authentication process, the other data comprising responses to one or more liveness challenges provided to the user performing the at least one of a verification process, an authorisation process and an authentication process;
performing a determination of whether the user is physically present in performing the performing the at least one of a verification process, an authorisation process and an authentication process in dependence upon:
whether the data from the electronic device matches one or more items of data stored relating to a registered user within a database, the items of stored data comprising data relating a registration process performed by a registered user relating to at least one of the verification process, the authorisation process and the authentication process:
an identity of another electronic device employed by the registered user when the user completed the registration process;
geo-location data of the another electronic device when the registered user completed the registration process;
one or more further identities, each further identity associated with a further electronic device associated with the another electronic device when the registered user completed the registration process; and
one or more other network identities, each other identity associated with an identity of a network or an element of network infrastructure associated with the electronic device when the registered user completed the registration process; and
whether the other data from the electronic device relating to the one or more liveness challenges matches other stored data relating to the registered user with the database, the other stored data comprising responses to a plurality of liveness challenges previously provided by the registered user upon the another electronic device employed by the registered user when the registered user completed the registration process where the one or more liveness challenges form part of the plurality of liveness challenges.

### Claim 3 (depends on 2)

The method according to claim 2, wherein
the one or more liveness challenges are selected from the group comprising:
biometric data acquisition;
one or more haptic challenges;
one or more acquisitions of sensor data from one or more sensors associated with the user;
one or more sense based responses provided by the user to one or more sense based triggers;
one or more memory challenges; and
one or more challenges presented though one or more non-electronic paths.

### Claim 4 (depends on 2)

The method according to claim 2, wherein
the other stored data comprising responses to a plurality of liveness challenges previously provided by the registered user was acquired through a process comprising the steps of:
providing to the another electronic device associated with the registered user the plurality of challenges where:
each challenge of the plurality of challenges was generated by a remote system for presentation to the registered user via one or more output interfaces of the another electronic device; and
the another electronic device comprises a microprocessor, a network interface according to a predetermined standard for communicating to the remote system via a communications network, and a plurality of interfaces, each interface at least one of an output interface of the another electronic device for providing data to the registered user and an input interface of the another electronic device for receiving data from the registered user;
receiving from the another electronic device via one or more input interfaces of the another electronic device a plurality of second inputs, each second input comprising a predetermined portion of a response to a presented challenge of the plurality of challenges; and
processing the plurality of second inputs to establish a plurality of responses to the plurality of challenges and storing the plurality of second inputs as part of the other stored data in the database where each stored response of the plurality of responses is associated with a specific challenge of the plurality of challenges.

### Claim 5 (depends on 2)

The method according to claim 2, wherein
the plurality of challenges presented to the registered user comprised M challenges;
each of the M challenges was provided N times to the registered user; and
the registered user's responses to the M challenges provided N times were processed to establish a lower time limit and an upper time limit; wherein
responses provided upon the electronic device relating to the one or more liveness challenges are deemed invalid if provided in response to presentation of a liveness challenge of the one or more liveness challenges either before the lower time limit or after the upper time limit.

### Claim 6 (depends on 2)

The method according to claim 2, wherein
the user can register multiple times, each registration associated with at least one of a different electronic device and a different physical location.

### Claim 7 (depends on 2)

The method according to claim 2, wherein
the other data comprising responses to the one or more liveness challenges was acquired through a process comprising the steps of:
providing to the electronic device associated with the user the plurality of challenges where:
each challenge of the plurality of challenges was generated by a remote system for presentation to the user via one or more output interfaces of the electronic device; and
the electronic device comprises a microprocessor, a network interface according to a predetermined standard for communicating to the remote system via a communications network, and a plurality of interfaces, each interface at least one of an output interface of the electronic device for providing data to the user and an input interface of the electronic device for receiving data from the user;
receiving from the electronic device user via one or more input interfaces a plurality of second inputs, each second input comprising a predetermined portion of a response to a presented challenge of the plurality of challenges; and
processing the plurality of second inputs to establish a plurality of responses to the plurality of challenges and storing the plurality of second inputs as part of the other stored data in the database where each stored response of the plurality of responses is associated with a specific challenge of the plurality of challenges.

### Claim 8 (depends on 7)

The method according to claim 7, wherein
the plurality of challenges presented to the registered user comprised M challenges;
each of the M challenges was provided N times to the registered user; and
the registered user's responses to the M challenges provided N times were processed to establish a lower time limit and an upper time limit; wherein
responses provided upon the electronic device relating to the one or more liveness challenges are deemed invalid if provided in response to presentation of a liveness challenge of the one or more liveness challenges either before the lower time limit or after the upper time limit.

### Claim 9 (depends on 1)

The method according to claim 1, wherein
the process comprises comparing responses received in response to one or more liveness challenges from a user against responses provided by a registered user to a plurality of liveness challenges when the registered user completed a registration process for the at least one of a verification process, an authorisation process and an authentication process;
the one or more liveness challenges form part of the plurality of liveness challenges;
each challenge of the plurality of challenges presented to the registered user during registration comprised M challenges;
each of the M challenges was provided N times to the registered user; and
the registered user's responses to the M challenges provided N times were processed to establish a lower time limit and an upper time limit; wherein
responses provided by the user relating to the one or more liveness challenges are deemed invalid if provided in response to presentation of a liveness challenge of the one or more liveness challenges either before the lower time limit or after the upper time limit.

### Claim 10 (depends on 1)

The method according to claim 1, wherein
the process comprises comparing responses received in response to each liveness challenge of one or more liveness challenges from the user against the associated liveness challenge of one or more liveness challenges; and
the response for each liveness challenge of the one or more liveness challenges is established in dependence upon processing data acquired from at least one of a motion sensor, an accelerometer, and an image processor; wherein
each liveness challenge of the one or more liveness challenges comprises one or more tasks performed by the user, each task selected from a group comprising:
raising an arm;
lowering another arm;
turning their head;
blinking;
opening and shutting their eyes; and
opening and shutting their mouth.

### Claim 11 (depends on 1)

The method according to claim 1, wherein
the process comprises comparing responses received in response to each liveness challenge of one or more liveness challenges from the user against the associated liveness challenge of one or more liveness challenges; and
the response for each liveness challenge of the one or more liveness challenges is established in dependence upon processing data acquired from at least one of a motion sensor, an accelerometer, and an image processor; wherein
each liveness challenge of the one or more liveness challenges comprises one or more tasks performed by the user, each task selected from a group comprising:
performing one or more motions of an arm associated with a hand of the user holding the electronic device;
turning the electronic device to a predetermined angle;
reciting text presented to the user upon the electronic device whilst performing a predetermined action with the electronic device.

### Claim 12 (depends on 1)

The method according to claim 1, wherein
the process comprises:
acquiring image data from a first camera associated with the electronic device, the first camera disposed upon a first surface of the electronic device facing the user whilst they are presented with and responds to one or more challenges of a series of liveness challenges;
acquiring other image data from a second camera associated with a second surface of the electronic device distal to the first surface and facing away from the user whilst they are presented with and responds to one or more challenges of a series of liveness challenges;
performing a first comparison of the acquired image data with stored first image data acquired with a third camera disposed upon a third surface of another electronic device facing a registered user whilst the registered user was presented with and responded to a plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process;
performing a second comparison the acquired other image data with stored second image data acquired with a fourth camera disposed upon a fourth surface of another electronic device distal to the third surface facing away from the registered user whilst the registered user was presented with and responded to a plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process; and
determining whether the user is physically present in dependence upon the first comparison and the second comparison.

### Claim 13 (depends on 1)

The method according to claim 1, wherein
the process comprises:
acquiring audio data from a microphone associated with the electronic device whilst the user is presented with and responds to one or more challenges of a series of liveness challenges;
performing a comparison of the acquired audio data with stored audio data acquired with another microphone associated with another electronic device employed whilst a registered user was presented with and responded to a plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process;
determining whether the user is physically present in dependence upon at least the comparison.

### Claim 14 (depends on 13)

The method according to claim 13, wherein
the comparison relates to background noise.

### Claim 15 (depends on 13)

The method according to claim 13, wherein
the one or more challenges of the series of liveness challenges is provided to the user as audio content upon a device having a predetermined identity;
the predetermined identity was established by polling another device which provided other audio content to the registered user for a subset of the plurality of liveness challenges; and
the device is one of a headset, a pair of headphones or an earpiece which was associated with another electronic device when the registered user was presented the plurality of liveness challenges.

### Claim 16 (depends on 1)

The method according to claim 1, wherein
the process comprises:
acquiring biometric sensor associated with the electronic device whilst the user is presented with and responds to a series of liveness challenges;
performing a comparison of the acquired biometric sensor with stored biometric data acquired with another biometric sensor associated with another electronic device employed whilst a registered user was presented with and responded to a plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process;
determining whether the user is physically present in dependence upon at least the comparison.

### Claim 17 (depends on 16)

The method according to claim 16, wherein
a liveness challenge of the plurality of liveness challenges which also forms part of the series of liveness challenges provoked fear within the registered user when presented; and
the liveness challenge of the plurality of liveness challenges invoking fear is embedded within the series of liveness challenges; and
the acquired biometric sensor data employed within the comparison is established within a predetermined period of time from presenting the liveness challenge of the plurality of liveness challenges which provoked fear within the registered user.

### Claim 18 (depends on 1)

The method according to claim 1, wherein
the process comprises:
acquiring historical location data retrieved from the electronic device whilst the user is presented with and responds to a series of liveness challenges;
performing a comparison of the acquired location data with stored historical location data acquired from the another electronic device a registered user used when presented with and responded to a plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process;
determining whether the user is physically present in dependence upon at least the comparison.

### Claim 19 (depends on 18)

The method according to claim 18, wherein
the stored historical location data was acquired with another process which acquired location data from the another electronic device at pseudo-random time intervals established by the another process over a period of time;
the historical location data was acquired over another period of time of which a portion overlaps the period of time.

### Claim 20 (depends on 1)

The method according to claim 1, wherein
the process comprises:
providing a sheet of sense trigger elements to a user, each sense trigger element comprising:
an identity; and
either a first material for elucidating a gustatory perception response of a user or a second material for elucidating an olfactory response of the user;
providing to the user via an output interface of an electronic device associated with the user an element identity;
receiving from the user via an input interface of the electronic device a response established by the user in response to their either tasting the first material within the sense trigger element having its identity matching the element identity or smelling the second material within the sense trigger element having its identity matching the element identity.

### Claim 21 (depends on 1)

The method according to claim 1, wherein
the process comprises:
providing to the user a series of memory challenges;
obtaining responses from the user to the series of memory challenges;
comparing the obtained responses with data relating to a registered user to whom the series of memory challenges relate; wherein
the registered user completed a registration process for the at least one of the verification process, the authorisation process and the authentication process;
each memory challenge of the plurality of memory challenges relates to an aspect of the registered user associated with a post to a social media;
the aspect is one of:
an identity of a place, an identity of an event or an identity of an individual at a predetermined point in time established from content posted by the registered user to a social network or social media; or
an identity of a place, an identity of an event or an identity of an individual at a predetermined point in time established from content posted by another user to a social network or social media which identifies the registered user within the content posted.

### Claim 22 (depends on 1)

The method according to claim 1, wherein
the process comprises:
acquiring image data from a camera associated with the electronic device whilst the user is presented with and responds to a challenge of a series of liveness challenges;
processing the acquired image data with an image processing process;
performing a comparison of the acquired image data with stored image data acquired with another camera associated with another electronic device employed whilst a registered user was presented with and responded to another challenge of the plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process; and
determining whether the user is physically present in dependence upon at least the comparison;
the stored image data was processed with the image processing process;
the acquired image data comprises a first image of a face of the user and a second image of the user's face where the first image and second image have different orientations of the camera with respect to the user's face;
the stored image data was generated by processing a first image of a face of the registered user and a second image of the registered user's face where the first image and second image have different orientations of another camera with respect to the registered user's face; and
the image processing process establishes differences in vectors generated by mapping pixels between an initial image and a subsequent image arising from parallax.

### Claim 23 (depends on 22)

The method according to claim 22, wherein
the vectors are employed to identify background features.

### Claim 24 (depends on 1)

The method according to claim 1, wherein
the process comprises:
acquiring image data from a first camera associated with the electronic device, the first camera disposed upon a first surface of the electronic device facing the user whilst they are presented with and responds to one or more challenges of a series of liveness challenges;
acquiring other image data from a second camera associated with a second surface of the electronic device distal to the first surface and facing away from the user whilst they are presented with and responds to one or more challenges of a series of liveness challenges;
processing the acquired image data and the other image data with an image processing process;
performing a first comparison of the processed acquired image data with stored first image data acquired with a third camera disposed upon a third surface of another electronic device facing a registered user whilst the registered user was presented with and responded to a plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process;
performing a second comparison the processed acquired other image data with stored second image data acquired with a fourth camera disposed upon a fourth surface of another electronic device distal to the third surface facing away from the registered user whilst the registered user was presented with and responded to a plurality of liveness challenges during a registration process for the at least one of the verification process, the authorisation process and the authentication process; and
determining whether the user is physically present in dependence upon the first comparison and the second comparison;
the stored first image data and stored second image data were processed with the image processing process;
the acquired image data comprises a first image of a face of the user and a second image of the user's face where the first image and second image have different orientations of the first camera with respect to the user's face;
the acquired other image data comprises a third image acquired with the second camera when the first image of the face of the user was acquired and a fourth image acquired with the second camera when the second image of the face of the user was acquired;
the stored first image data was generated by processing a first image of a face of the registered user and a second image of the registered user's face where the first image and second image have different orientations of the third camera with respect to the registered user's face;
the stored second image data was generated by processing fifth image acquired with the fourth camera when the first image of the face of the registered user was acquired and a sixth image acquired with the fourth camera when the second image of the face of the registered user was acquired; and
the image processing process establishes differences in vectors generated by mapping pixels between an initial image and a subsequent image arising from parallax.

### Claim 25 (depends on 24)

The method according to claim 24, wherein
the vectors are employed to:
identify background features within the acquired image data of the first camera and the stored first data acquired by the third camera; and
identify background features within the acquired image data of the second camera and the stored second data acquired by the fourth camera.
