# US 2016/0253675 A1 · A method and a system for performing 3d-based identity verification of individuals with mobile devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253675 A1
- Document ID: US20160253675A1
- Status: Published application
- Kind: A1
- Application number: 15/030,837
- Filed: 2014-10-24
- Published: 2016-09-01
- Earliest claimed: 2013-10-25
- Assignees: OneVisage SA
- Inventors: Christophe REMILLET
- Web page: https://patentgrep.com/patent/US20160253675A1

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06Q 20/40145: {Biometric identity checks}
- G06F 21/31: User authentication
- G06T 7/579: from motion
- G06T 15/04: Texture mapping
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces}
- G06V 40/40: Spoof detection, e.g. liveness detection
- G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities
- H04N 5/77: between a recording apparatus and a television camera
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G06T 2207/30201: Face
- G06T 2215/16: Using real world measurements to influence rendering
- Y04S 40/20: Information technology specific aspects, e.g. CAD, simulation, modelling, system security
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- Y04S: SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS

## Abstract

A method for verifying the identity of an individual with a mobile device equipped with at least one camera, a graphical display, a wireless communication adapter, and a verification mobile application. The method includes capturing a video of a biometric attribute of the individual through said camera of mobile device (step 120). Then reconstructing with the mobile device in real-time a 3D model of the individual's biometric attribute from the video captured, where the 3D model contains shapes and/or textures, forming thereby a reconstructed 3D model (step 120). And, comparing the reconstructed 3D model with a reference 3D model containing shapes and textures, stored in either the mobile device or remote enrolment database following a previous enrolment phase of the individual with said mobile device, thereby providing a detailed comparison result.

## Claims

### Claim 1

A method for verifying the identity of an individual with a mobile device equipped with at least one camera, a graphical display, a wireless communication adapter, and a verification mobile application, comprising the steps of:
capturing a video of a biometric attribute of the individual through said camera of said mobile device during a movement of said mobile device with respect to said biometric attribute;
reconstructing with said mobile device in real-time a 3D model of the individual's biometric attribute from the video captured, where the 3D model contains shapes and/or textures, forming thereby a reconstructed 3D model;
comparing said reconstructed 3D model with a reference 3D model of said biometric attribute of the same individual, this reference 3D model containing shapes and/or textures, stored in either said mobile device or a remote enrolment database following a previous enrolment phase of said individual with said mobile device, thereby providing a detailed comparison result.

### Claim 2 (depends on 1)

The method of claim 1, wherein
said enrolment phase of said individual comprises the steps of:
checking the individual's identity by an enrolment agent,
activating the verification mobile application of said individual's mobile device,
capturing with said mobile device a video where the individual is panning the mobile device around the biometric attribute and/or making a movement with the corresponding limb in front of the mobile camera,
reconstructing with said mobile device in real time from said captured video a reference 3D model with shapes and/or textures of the biometric attribute, creating thereby a reference 3D model of said selected biometric attribute of the individual, and
storing said reference 3D model in either said mobile device or remote database.

### Claim 3 (depends on 1)

The method of claim 1, wherein said individual's biometric attribute is defined by biometric and/or non-biometric sub-attributes, and wherein said detailed comparison result comprise a plurality of detailed matching scores corresponding to the shape and/or to the texture of the reconstructed biometric and/or non-biometric sub-attributes with respect to the reference 3D model part of the same biometric and/or non-biometric sub-attributes, each matching score including a rating score for the matching between the shape of the reconstructed biometric and/or non-biometric sub-attributes with respect to the shape of the reference 3D model part of the same biometric and/or non-biometric sub-attributes and/or a rating score for the matching between the texture of the reconstructed biometric and/or non-biometric sub-attributes with respect to the texture of the reference 3D model part of the same biometric and/or non-biometric sub-attributes.

### Claim 4 (depends on 2)

The method of claim 2, further comprising during the enrolment phase:
the step of proposing a plurality of biometric attributes like the face, left hand, left arm, right hand, right arm, left ear, right ear, left foot, right foot, and which can be selected by the individual for identity verification purposes in accordance with his own privacy criteria, the steps of selecting one or more biometric attributes the individual agrees to use for identity verification and capturing a video for each selected biometric attribute, creating thereby reference 3D models of said selected biometric attributes of the individual.

### Claim 5 (depends on 2)

The method of claim 2, further comprising:
the step of supervising the enrolment phase of the individual by an authorized agent which can directly and remotely monitor the individual actions on his mobile device by establishing a video communication and where the authorized agent can give self-scanning instructions and recommendations to the individual to execute a panning movement of his biometric attribute(s).

### Claim 6 (depends on 2)

The method of claim 2, further comprising:
the step of establishing a secure communication during
a) the enrolment phase, between the individual's mobile device and the authorized agent's desktop through an identity verification server, and
b) during any identity verification phase, between the individual's mobile device and an identity verification server equipped with said enrolment database.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
the step of creating an account in the enrolment database with:
a) a unique mobile identifier used to open a secure communication path between the individual's mobile device and said identity verification server, and
b) a unique user alias identifier which is used to open a secure communication path between an originator transaction server and the identity verification server, which unique alias identifier is totally independent from the unique mobile identifier for security reasons

### Claim 8 (depends on 7)

The method of claim 7 further comprising the step of using said unique mobile identifier to notify the presence awareness of the verification mobile application to the identity verification server, said identity verification server being able to
a) wake-up and immediately notify the verification mobile application that an identity verification request occurred, and
b) detect the mobile verification application is off line and notify the originator transaction server the individual needs to launch or install the mobile verification application by sending an message to the mobile device.

### Claim 9 (depends on 7)

The method of claim 7, further comprising the steps of:
a) modifying said account in said enrolment database when the individual is replacing his mobile device by a new one, said identity verification server deleting or archiving the previous unique identifier and 3D model data if applicable, and
b) creating a new unique mobile identifier when the individual is registering a new mobile device, the individual being required to self-scan his biometric attributes again to record new reference 3D models in either said mobile device or said enrolment database.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
the step of detecting the body limb being exposed by the individual in front of the camera when the video capture starts.

### Claim 11 (depends on 4)

The method of claim 4, wherein said mobile device is equipped with a front camera and a rear camera, wherein at least two biometric attributes are selected and wherein
a) the front camera is used to capture a video of the individual's face as biometric attribute or part of the face as biometric sub-attribute determined by an identity verification server,
b) the rear camera is used to self-scan another biometric attribute or other biometric attributes like the left-hand, left arm, right hand, right arm, left foot, right foot, left ear and/or right ear

### Claim 12 (depends on 1)

The method of claim 1, wherein before capturing a video of a biometric attribute, it further comprises the step of proposing to the individual a self-scanning methodology with no imposed gestures or facial expressions, comprising a pan movement of said mobile device around the biometric attribute with six degrees of freedom and/or a movement with six degrees of freedom of the biometric attribute in front of the mobile device

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
the step of auto-adapting the reference 3D model by taking into account individual's appearance changes over the time by recording shapes and textures differences measured between the reference 3D model stored in said enrolment database and a selection of reconstructed 3D models.

### Claim 14 (depends on 1)

The method of claim 1, further comprising
the separate scanning with said mobile device of objects being worn by the individual as non-biometric sub-attributes, forming a reference 3D model of each non-biometric sub-attributes that can be superimposed to the reference 3D model of a corresponding biometric attribute captured during enrolment phase or updated after the enrolment phase, when making a reconstructed 3D model from the video captured during an identity verification phase

### Claim 15 (depends on 1)

The method of any of claim 1, further comprising a spoofing check by:
using the captured raw video of said biometric attribute or some fragments of the captured raw video and determining if the same scanning video sequence occurred in previously captured video of the same biometric attribute

### Claim 16 (depends on 1)

The method of claim 1, further comprising a spoofing check by:
during the comparison step between the reconstructed 3D model and the reference 3D model, recording the variance of the reconstructed 3D model within a predetermined range of time, where the variance for each shape and/or texture is computed and compared to a predetermined maximum acceptable magnitude range.

### Claim 17 (depends on 1)

The method of claim 1, further comprising:
the step of detecting inadequate video capture situations by analysing the luminance in the very first video frames captured by said camera of the mobile device, such as when the camera is exposed in front of the sun, and giving a feedback information to the mobile device through said verification mobile application.

### Claim 18

A system for verifying the identity of an individual comprising:
a mobile device equipped with at least one camera, a graphical display, a wireless communication adapter and a verification mobile application,
an originator transaction server, such as a financial transaction server, and
an identity verification server with a remote database,
said originator transaction server being able to send a verification request to said identity verification server, said identity verification server being able to inform the individual about said verification request for the transaction identity verification server by means of the identity verification server sending a message to said individual's mobile device, and said mobile device being able to implement a verification method, by means of said verification mobile application, said verification method comprising the steps of:
capturing a video of a biometric attribute of the individual through said camera of said mobile device during a movement of said mobile device with respect to said biometric attribute;
reconstructing with said mobile device in real-time a 3D model of the individual's biometric attribute from the video captured, where the 3D model contains shapes and/or textures, forming thereby a reconstructed 3D model;
comparing said reconstructed 3D model with a reference 3D model of said biometric attribute of the same individual, this reference 3D model containing shapes and/or textures, stored in either said mobile device or said remote database following a previous enrolment phase of said individual with said mobile device, thereby providing a detailed comparison result.

### Claim 19 (depends on 18)

The system of claim 18, further comprising:
a software mechanism which allows for the originator transaction server to display information or interact with the individual in a confidential way through the verification mobile application, where neither the verification mobile application nor the identity verification server can get an access to the contents of the information sent by the originator transaction server.

### Claim 20

A method for protecting a transaction for an originator transaction service by implementing a biometric recognition of an individual through his personal mobile device equipped with a verification mobile application and at least one camera, using reference 3D model stored either in said mobile device or in a remote database, including the following steps:
sending a verification request from said originator transaction service to an identity verification server,
establishing a secure communication session between the verification mobile application of the individual's mobile device and the identity verification server,
informing the individual about said verification request for the transaction by means of the identity verification server sending a message to said individual's mobile device,
implementing with said individual's mobile device a method for verifying the identity of an individual comprising the steps of:
capturing a video of a biometric attribute of the individual through said camera of said mobile device during a movement of said mobile device with respect to said biometric attribute;
reconstructing with said mobile device in real-time a 3D model of the individual's biometric attribute from the video captured, where the 3D model contains shapes and/or textures, forming thereby a reconstructed 3D model;
comparing said reconstructed 3D model with a reference 3D model of said biometric attribute of the same individual, this reference 3D model containing shapes and/or textures, stored in either said mobile device or said remote database following a previous enrolment phase of said individual with said mobile device, thereby providing a detailed comparison result,
sending the 3D models detailed comparison result to the originator transaction service which requested an identity verification of the individual to perform a transaction, and
receiving a reply from originator transaction service either approval to execute the transaction or rejecting to execute the transaction or requesting to implement again with said individual's mobile device said method for verifying the identity of an individual with the same or a different biometric attribute.
