# US 12,216,749 B2 · Using facial skin micromovements to identify a user > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,749 B2 - Document ID: US12216749B2 - Status: Granted - Kind: B2 - Application number: 18/504,852 - Filed: 2023-11-08 - Published: 2024-02-29 - Granted: 2025-02-04 - Earliest claimed: 2021-08-04 - Assignees: Q (Cue) Ltd. - Applicants: Q (Cue) Ltd. - Inventors: Aviad Maizels; Yonatan Wexler; Avi Barliya - Web page: https://patentgrep.com/patent/US12216749B2 ## CPC - G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints - A61B 5/0064: {Body surface scanning} - A61B 5/117: Identification of persons (methods or arrangements for recognising patterns, e.g. fingerprints, G06F18/00, G06V40/00; identification of persons by analysing their voice or speech G10L17/00) - A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety} - A61B 5/6803: {Head-worn items, e.g. helmets, masks, headphones or goggles} - G06F 9/541: {via adapters, e.g. between incompatible applications} - G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30) - G06V 40/166: {using acquisition arrangements} - G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships} - G06V 40/172: {Classification, e.g. identification} - G06V 40/176: {Dynamic expression} - G06V 40/40: Spoof detection, e.g. liveness detection - G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities - G10L 13/02: Methods for producing synthetic speech; Speech synthesisers - G10L 15/08: Speech classification or search - G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence) - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/25: using position of the lips, movement of the lips or face analysis - H04R 1/028: {associated with devices performing functions other than acoustics, e.g. electric candles} - H04R 1/10: Earpieces; Attachments therefor {; Earphones; Monophonic headphones (H04R1/28 takes precedence; stereophonic headphones H04R5/033)} - G10L 2015/088: {Word spotting} - G10L 2015/223: {Execution procedure of a spoken command} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract Head mountable systems, methods, and non-transitory computer readable media including instructions for identifying individuals using facial skin micromovements are disclosed. An example head mountable system may include a wearable housing, a coherent light source, a detector, and at least one processor. The at least one processor may analyze reflection signals from the detector to determine specific facial skin micromovements of an individual wearing the head mountable system. Thereafter, the at least one processor may access memory correlating a plurality of facial skin micromovements with the individual, and search for a match between the determined specific facial skin micromovements and at least one of the plurality of facial skin micromovements in the memory. If a match is identified, the processor may initiate a first action; and if a match is not identified, the at least one processor may initiate a second action different from the first action. ## Claims ### Claim 1 A head mountable system for identifying individuals using facial skin micromovements, the head mountable system comprising: a wearable housing configured to be worn on a head of an individual; at least one light source associated with the wearable housing and configured to project light towards a facial region of the head; at least one detector associated with the wearable housing and configured to receive light reflections from the facial region and to output associated reflection signals; at least one processor configured to: analyze the reflection signals to determine specific facial skin micromovements of the individual, the specific facial skin micromovements resulting from vocalization or prevocalization of a sequence of phonemes by the individual; access memory correlating a plurality of reference facial skin micromovements with the individual, wherein the plurality of reference facial skin micromovements is associated with differing phonemes previously vocalized or previously prevocalized by the individual; search for a match between the determined specific facial skin micromovements and at least one of the plurality of reference facial skin micromovements in the memory; if a match is identified, initiate a first action; and if a match is not identified, initiate a second action different from the first action. ### Claim 2 (depends on 1) The head mountable system of claim 1, wherein the first action institutes at least one predetermined setting associated with the individual. ### Claim 3 (depends on 1) The head mountable system of claim 1, wherein the first action unlocks a computing device, and the second action includes presentation of a message indicating that the computing device remains locked. ### Claim 4 (depends on 1) The head mountable system of claim 1, wherein the first action provides personal information, and the second action provides public information. ### Claim 5 (depends on 1) The head mountable system of claim 1, wherein the first action authorizes a transaction, and the second action provides information indicating that the transaction is not authorized. ### Claim 6 (depends on 1) The head mountable system of claim 1, wherein the first action permits access to an application, and the second action prevents access to the application. ### Claim 7 (depends on 1) The head mountable system of claim 1, wherein at least some of the specific facial skin micromovements in the facial region are micromovements of less than 100 microns. ### Claim 8 (depends on 1) The head mountable system of claim 1, wherein the specific facial skin micromovements correspond to muscle recruitment during prevocalization of the sequence of phonemes. ### Claim 9 (depends on 1) The head mountable system of claim 1, wherein the specific facial skin micromovements correspond to muscle recruitment during pronunciation of the sequence of phonemes being at least one word. ### Claim 10 (depends on 9) The head mountable system of claim 9, wherein the at least one word corresponds to a password. ### Claim 11 (depends on 1) The head mountable system of claim 1, wherein the memory is configured to correlate a plurality of reference facial skin movements with a plurality of individuals, and wherein the at least one processor is configured to distinguish the plurality of individuals from each other based on reflection signals unique to each of the plurality of individuals. ### Claim 12 (depends on 1) The head mountable system of claim 1, further comprising an integrated audio output and wherein at least one of the first action or at least one of the second action includes outputting audio via the audio output. ### Claim 13 (depends on 1) The head mountable system of claim 1, wherein the match is identified upon determination by the at least one processor of a certainty level. ### Claim 14 (depends on 13) The head mountable system of claim 13, wherein when the certainty level is initially not reached, the at least one processor is configured to analyze additional reflection signals to determine additional facial skin micromovements, and to arrive at the certainty level based at least in part on analysis of the additional reflection signals. ### Claim 15 (depends on 1) The head mountable system of claim 1, wherein, when the instantaneous certainty level is below a threshold, the at least one processor is configured to stop the first action and initiate an associated action. ### Claim 16 (depends on 1) The head mountable system of claim 1, wherein initiating the first action is associated with an event, and the at least one processor is configured to continuously compare the new facial skin micromovements during the event. ### Claim 17 A method for identifying individuals using facial skin micromovements, the method comprising: operating a wearable light source configured to project light towards a facial region a head of an individual; operating at least one detector configured to receive light reflections from the facial region and to output associated reflection signals; analyzing the reflection signals to determine specific facial skin micromovements of the individual, the specific facial skin micromovements resulting from vocalization or prevocalization of a sequence of phonemes by the individual; accessing memory correlating a plurality of reference facial skin micromovements with the individual, wherein the plurality of reference facial skin micromovements is associated with differing phonemes previously vocalized or previously prevocalized by the individual; searching for match between the determined specific facial skin micromovements and at least one of the plurality of reference facial skin micromovements in the memory; if a match is identified, initiate a first action; and if a match is not identified, initiate a second action different from the first action. ### Claim 18 A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for identifying individuals using facial skin micromovements, the operations comprising: operating a wearable light source configured to project light towards a facial region a head of an individual; operating at least one detector configured to receive light reflections from the facial region and to output associated reflection signals; analyzing the reflection signals to determine specific facial skin micromovements of the individual, the specific facial skin micromovements resulting from vocalization or prevocalization of a sequence of phonemes by the individual; accessing memory correlating a plurality of reference facial skin micromovements with the individual, wherein the plurality of reference facial skin micromovements is associated with differing phonemes previously vocalized or previously prevocalized by the individual; searching for match between the determined specific facial skin micromovements and at least one of the plurality of reference facial skin micromovements in the memory; if a match is identified, initiate a first action; and if a match is not identified, initiate a second action different from the first action. ### Claim 19 (depends on 1) The head mountable system of claim 1, wherein the at least one processor is further configured to stop the first action by initiating the second action. ### Claim 20 (depends on 1) The head mountable system of claim 1, wherein initiating the first action is associated with an online activity, and the at least one processor is further configured to after initiating the first action, comparing at least one new facial skin micromovement with the plurality of facial skin micromovements to determine an instantaneous level of certainty stop the online activity when the instantaneous certainty level is below a threshold.