# US 2017/0257366 A1 · Optoelectronic systems and method for operating the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0257366 A1 - Document ID: US20170257366A1 - Status: Published application - Kind: A1 - Application number: 15/447,341 - Filed: 2017-03-02 - Published: 2017-09-07 - Earliest claimed: 2016-03-03 - Assignees: Heptagon Micro Optics Pte. Ltd. - Applicants: Heptagon Micro Optics Pte. Ltd. - Inventors: Yibin Tian; Hendrik Volkerink - Web page: https://patentgrep.com/patent/US20170257366A1 ## CPC - H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)} - G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints - G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings - G06V 40/169: {Holistic features and representations, i.e. based on the facial image taken as a whole} - G06V 40/172: {Classification, e.g. identification} - G06V 40/40: Spoof detection, e.g. liveness detection - G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities - H04L 63/0853: {using an additional device, e.g. smartcard, SIM or a different communication terminal (cryptographic mechanisms or cryptographic arrangements for entity authentication involving additional secure or trusted devices H04L9/3234)} - G06V 2201/121: using special illumination - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Optoelectronic systems include an array of optoelectronic modules and a computational unit. The array of optoelectronic modules and the computational unit are operable to collect data of a user of the optoelectronic system. The data can be used, for example, to authenticate the identity of the user by being used in multiple user authentication protocols. In some instances, facial recognition data can be augmented with three-dimensional data of the user and can be combined with iris recognition data to authenticate the identity of the user. Such optoelectronic systems can comprise hardware authentication systems external to auxiliary devices such as tablet computers and laptop computers. ## Claims ### Claim 1 An optoelectronic system comprising an array of optoelectronic modules, the array of optoelectronic modules comprising: an infrared-sensitive intensity imager, an auxiliary infrared-sensitive intensity imager, a spectral illuminator, a modulation illuminator, a demodulation imager, a diffuse illuminator, a visible light-sensitive imager, and a computational unit; wherein each of the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and the visible light-sensitive imager is communicatively coupled to the computational unit via a respective coupling; and the computational unit includes a processor and a non-transitory computer readable medium, the non-transitory computer readable medium comprising machine readable instructions stored thereon that, when executed by the processor, cause the processor to operate the optoelectronic system. ### Claim 2 (depends on 1) The optoelectronic system of claim 1 wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor to initialize the optoelectronic system, execute a proximity protocol, and alter power to the modulated light illuminator, spectral illuminator, and/or diffuse illuminator. ### Claim 3 (depends on 1) The optoelectronic system of claim 1 wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor to execute a first user authentication protocol, the first user authentication protocol including a gaze tracking protocol, an iris recognition protocol, a facial recognition protocol, and/or any of the aforementioned user authentication protocols enhanced by data collected using the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and/or the visible light-sensitive imager. ### Claim 4 (depends on 3) The optoelectronic system of claim 3 wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor to execute a second user authentication protocol, the second user authentication protocol including a gaze tracking protocol, an iris recognition protocol, a facial recognition protocol, and/or any of the aforementioned user authentication protocols enhanced by data collected using the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and/or the visible light-sensitive imager. ### Claim 5 (depends on 4) The optoelectronic system of claim 4 wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor to execute a third user authentication protocol, the third user authentication protocol including a gaze tracking protocol, an iris recognition protocol, a facial recognition protocol, and/or any of the aforementioned user authentication protocols enhanced by data collected using the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and/or the visible light-sensitive imager. ### Claim 6 (depends on 3) The optoelectronic system as in claim 3, in which the data collected using the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and/or the visible light-sensitive imager includes distance data, three-dimensional data, and/or user eye color data. ### Claim 7 (depends on 3) The optoelectronic system as in claim 3, wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor to alter the power to the modulation illuminator, the spectral illuminator, and/or the diffuse illuminator. ### Claim 8 (depends on 3) The optoelectronic system as in claim 3, wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor to grant access to an auxiliary device. ### Claim 9 (depends on 8) The optoelectronic system of claim 8 wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor grant access to an additional auxiliary device. ### Claim 10 (depends on 8) The optoelectronic system of claim 8 wherein the non-transitory computer readable medium stores instructions thereon that when executed by the processor cause the processor to compile user-specific data. ### Claim 11 (depends on 9) The optoelectronic system of claim 9 wherein the non-transitory computer-readable medium stores instructions thereon that when executed by the processor cause the processor to compile user-specific data. ### Claim 12 (depends on 10) The optoelectronic system of claim 10 wherein the non-transitory computer-readable medium stores instructions thereon that when executed by the processor cause the processor to construct a user profile using the user-specific data. ### Claim 13 (depends on 11) The optoelectronic system of claim 11 wherein the non-transitory computer-readable medium stores instructions thereon that when executed by the processor cause the processor to construct a user profile using the user-specific data. ### Claim 14 (depends on 12) The optoelectronic system of claim 12 wherein the non-transitory computer-readable medium stores instructions thereon that when executed by the processor cause the processor to alter the operation of the auxiliary device using the user profile. ### Claim 15 (depends on 13) The optoelectronic system of claim 13 wherein the non-transitory computer-readable medium stores instructions thereon that when executed by the processor cause the processor to alter the operation of the auxiliary device using the user profile. ### Claim 16 A method for operating an optoelectronic system, the method comprising: initializing an optoelectronic system, the optoelectronic system including an infrared-sensitive intensity imager, an auxiliary infrared-sensitive intensity imager, a spectral illuminator, a modulation illuminator, a demodulation imager, a diffuse illuminator, a visible light-sensitive imager, and a computational unit; and executing a first user authentication protocol, the first user authentication protocol including a gaze tracking protocol, an iris recognition protocol, a facial recognition protocol, and/or any of the aforementioned user authentication protocols enhanced by data collected using the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and/or the visible light-sensitive imager. ### Claim 17 (depends on 16) The method for operating an optoelectronic system of claim 16, the method further comprising: executing a proximity protocol, and altering power to the modulation illuminator, the spectral illuminator, and/or the diffuse illuminator. ### Claim 18 (depends on 16) The method for operating an optoelectronic system of claim 16, the method further comprising: executing a second user authentication protocol including a gaze tracking protocol, an iris recognition protocol, a facial recognition protocol, and/or any of the aforementioned user authentication protocols enhanced by data collected using the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and/or the visible light-sensitive imager. ### Claim 19 (depends on 18) The method for operating an optoelectronic system of claim 18, the method further comprising: executing a third user authentication protocol including a gaze tracking protocol, an iris recognition protocol, a facial recognition protocol, and/or any of the aforementioned user authentication protocols enhanced by data collected using the infrared-sensitive intensity imager, the auxiliary infrared-sensitive intensity imager, the spectral illuminator, the modulation illuminator, the demodulation imager, the diffuse illuminator, and/or the visible light-sensitive imager. ### Claim 20 (depends on 16) The method for operating an optoelectronic system as in claim 16, wherein the method further comprises granting access to an auxiliary device. ### Claim 21 (depends on 20) The method for operating an optoelectronic system of claim 20, the method further comprising granting access to an additional auxiliary device. ### Claim 22 (depends on 16) The method for operating an optoelectronic system as in claim 16, wherein the method further comprises compiling user-specific data. ### Claim 23 (depends on 22) The method for operating an optoelectronic system of claim 22, the method further comprising constructing a user profile using the user-specific data. ### Claim 24 (depends on 20) The method for operating an optoelectronic system of claim 20, the method further comprising compiling user-specific data and constructing a user profile based on the user specific data, and altering the auxiliary device operation using the user profile. ### Claim 25 (depends on 21) The method for operating an optoelectronic system of claim 21, the method further comprising compiling user-specific data and constructing a user profile based on the user specific data, and altering the additional auxiliary device operation using the user profile.