Person identification and imposter detection using footfall generated seismic signals
AssigneeIndian Institute of Technology Delhi
InventorsSubrat Kar, Bodhibrata Mukhopadhyay, Sahil Anchal
Life of this patent
Estimating the term…
Abstract
A smart device, biometric authentication system and a corresponding method thereof for person identification and imposter detection has been disclosed. The method comprises detection and extraction of seismic signals generated from corresponding footfalls, by means of unsupervised learning based detection and extraction module (USLEEM) and detection and identification of imposter and/or registered users respectively by means of an identification module.
Claims9
A method for person identification and imposter detection, the method, executed by a smart device, comprising:
- during a training phase;
- detecting, by at least one sensing module of the smart device, a plurality of seismic signals generated from behavioral properties of a person, wherein the behavioral properties of the person comprise at least a footfall signature of the person, the footfall signature associated to corresponding footfalls of the person, by means of unsupervised learning based detection and extraction module (USLEEM) to generate a seismic event;
- converting, by an analog-to-digital converter module of the smart device, the detected plurality of seismic signals, the plurality of seismic signals being analog signals, into digital signals;
- splitting, by an event extraction module of the smart device, each digital seismic signal of plurality of digital seismic signals into N equal segments;
- extracting, for the each digital signal of the plurality of digital signals, by the event extraction module, first feature vectors (FE-I) corresponding to time domain and frequency domain features from each segment of the N equal segments;
- clustering, by the event extraction module, each of the first feature vectors (FE-I) between clustered events without using predefined thresholds, using a Gaussian Mixture Model (GMM), wherein one cluster represents footfall events, and another cluster represents noise events, to form at least one trained GMM based model capable of distinguishing the footfall events from the noise events based on one or more statistical properties;
- multiplying the each segment of the N equal segments classified as the footfall events with a Gaussian window centered at segment's peak amplitude to obtain smooth and spectrally consistent footfall signals;
- extracting, from the each resulting smooth and spectrally consistent footfall signal, second feature vectors (FE-II), corresponding to refined time domain and frequency domain features, to further train:
- a plurality of one-class learning models, each trained with the second feature vectors (FE-II) of an individual registered user to enable imposter detection by modelling only user specific class;
- and
- a multi-class learning model using the second feature vectors (FE-II) to associate footfall signatures with corresponding registered users;
- and
- storing the trained GMM based model;
- during a live phase;
- detecting, by the sensing module, a plurality of new seismic signals generated from one or more footfalls during a user activity, the plurality of new seismic signals being analog signals;
- converting, by the analog-to-digital converter module, each of the detected plurality of new analog seismic signals into new digital signals;
- splitting, by the event extraction module of the smart device, each new digital seismic signal of plurality of new digital seismic signals into N equal segments;
- extracting, for the each new digital signal of the plurality of new digital signals, by the event extraction module, first feature vectors (FE-I) corresponding to time domain and frequency domain features from each segment of the N equal segments;
- clustering, using the trained GMM based model, each segment of the N equal segments as a footfall event or a noise event based on the each of the first feature vectors (FE-I);
- multiplying the each segment of the N equal segments classified as the footfall events with a Gaussian window centered at segment's peak amplitude to obtain smooth and spectrally consistent footfall signals;
- extracting, from the each resulting smooth and spectrally consistent footfall signal, second featured vectors (FE-II), corresponding to refined time domain and frequency domain features;
- feeding each of the second featured vectors (FE-II) to the trained plurality of one-class models;
- detecting, by the trained plurality of one-class learning models, an imposter, when the each of the second feature vectors (FE-II) are identified as outliers by the all trained plurality of one-class learning models, to return a binary output of −1;
- and
- identifying, by the multi-class learning model, a registered user, from when the each of the second feature vectors (FE-II) are classified into predefined user class corresponding to the registered user.
A smart device for person identification and imposter detection, wherein the smart device comprises:
- at least one sensing module to detect a plurality of seismic signals generated from behavioral properties of a person, wherein the behavioral properties of the person comprise at least a footfall signature of the person, the footfall signature associated to corresponding footfalls of the person to generate a seismic event;
- an analog-to-digital converter module to convert the detected plurality of seismic signals, the plurality of seismic signals being analog signals, into digital signals:
- an event extraction module to:
- split each digital seismic signal, of plurality of digital seismic signals, into N equal segments;
- extract, for the each digital signal of the plurality of digital signals, first feature vectors (FE-I) corresponding to time domain and frequency domain features from each segment of the N equal segments;
- cluster, each of the first feature vectors (FE-I) between clustered events without using predefined thresholds, using a Gaussian Mixture Model (GMM), wherein one cluster represents footfall events, and another cluster represents noise events, to form at least one trained GMM based model capable of distinguishing the footfall events from the noise events based on one or more statistical properties;
- multiply the each segment of the N equal segments classified as the footfall events with a Gaussian window centered at segment's peak amplitude to obtain smooth and spectrally consistent footfall signals;
- extract, from the each resulting smooth and spectrally consistent footfall signal, second feature vectors (FE-II), corresponding to refined time domain and frequency domain features, to further train:
- a plurality of one-class learning models, each trained with the second feature vectors (FE-II) of an individual registered user to enable imposter detection by modelling only user specific class;
- and
- a multi-class learning model using the second feature vectors (FE-II) to associate footfall signatures with corresponding registered users;
- and
- store the trained GMM based model;
- and
- an identification module to detect an imposter and/or to identify a registered user during a live phase comprising user activity, wherein the imposter is detected if each of second feature vectors (FE-II) obtained during the user activity are identified as outliers by the all trained plurality of one-class learning models, and wherein if the each of the second feature vectors (FE-II) obtained during the user activity are not identified as outliers by any of the all trained plurality of one-class learning models, the registered user is identified by the multi-class learning model, wherein the each of the second feature vectors (FE-II) are classified into predefined user class corresponding to the registered user.
A biometric authentication system for person identification and imposter detection, the biometric authentication system comprising:
- an array of smart devices distributed over a pre-determined zone;
- and
- a central controller communicably coupled to the array of smart devices, wherein each smart device of the array of smart devices comprises:
- at least one sensing module to detect a plurality of seismic signals generated from behavioral properties of a person, wherein the behavioral properties of the person comprise at least a footfall signature of the person, the footfall signature associated to corresponding footfalls of the person to generate a seismic event;
- an analog-to-digital converter module to convert the detected plurality of seismic signals, the plurality of seismic signals being analog signals, into digital signals;
- an event extraction module to:
- split each digital seismic signal, of plurality of digital seismic signals, into N equal segments;
- extract, for the each digital signal of the plurality of digital signals, first feature vectors (FE-I) corresponding to time domain and frequency domain features from each segment of the N equal segments;
- cluster, each of the first feature vectors (FE-I) between clustered events without using predefined thresholds, using a Gaussian Mixture Model (GMM), wherein one cluster represents footfall events, and another cluster represents noise events, to form at least one trained GMM based model capable of distinguishing the footfall events from the noise events based on one or more statistical properties;
- multiply the each segment of the N equal segments classified as the footfall events with a Gaussian window centered at segment's peak amplitude to obtain smooth and spectrally consistent footfall signals;
- extract, from the each resulting smooth and spectrally consistent footfall signal, second feature vectors (FE-II), corresponding to refined time domain and frequency domain features, to further train:
- a plurality of one-class learning models, each trained with the second feature vectors (FE-II) of an individual registered user to enable imposter detection by modelling only user specific class;
- and
- a multi-class learning model using the second feature vectors (FE-II) to associate footfall signatures with corresponding registered users;
- and
- store the trained GMM based model;
- and
- an identification module to detect an imposter and/or to identify a registered user during a live phase comprising user activity, wherein the imposter is detected if each of second feature vectors (FE-II) obtained during the user activity are identified as outliers by the all trained plurality of one-class learning models, and wherein if the each of the second feature vectors (FE-II) obtained during the user activity are not identified as outliers by any of the all trained plurality of one-class learning models, the registered user is identified by the multi-class learning model, wherein the each of the second feature vectors (FE-II) are classified into predefined user class corresponding to the registered user.
Dependencies are inferred from the claim text.