# US 2020/0401221 A1 · Eye gesture tracking > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401221 A1 - Document ID: US20200401221A1 - Status: Published application - Kind: A1 - Application number: 17/007,958 - Filed: 2020-08-31 - Published: 2020-12-24 - Earliest claimed: 2015-08-04 - Assignees: Artilux, Inc. - Applicants: Artilux, Inc. - Inventors: Yun-Chung Na; Chien-Lung Chen; Han-Din Liu; Shu-Lu Chen - Web page: https://patentgrep.com/patent/US20200401221A1 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 7/514: from specularities - G06T 7/74: {involving reference images or patches} - G06V 40/193: {Preprocessing; Feature extraction} - H10F 39/014: {of CMOS image sensors} - H10F 39/024: {of coatings or optical elements} - H10F 39/026: {Wafer-level processing} - H10F 39/182: {Colour image sensors} - H10F 39/184: {Infrared image sensors} - H10F 39/8023: {Disposition of the elements in pixels, e.g. smaller elements in the centre of the imager compared to larger elements at the periphery} - H10F 39/8053: {Colour filters} - H10F 39/8063: {Microlenses} - H10F 39/807: {Pixel isolation structures} - H10F 39/811: {Interconnections} - G06T 2207/30201: Face - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION ## Abstract Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for eye gesture recognition. In one aspect, a method includes obtaining an electrical signal that represents a measurement, by a photodetector, of an optical signal reflected from an eye and determining a depth map of the eye based on phase differences between the electrical signal generated by the photodetector and a reference signal. Further, the method includes determining gaze information that represents a gaze of the eye based on the depth map and providing output data representing the gaze information. ## Claims ### Claim 1 (canceled) ### Claim 2 A system comprising: a plurality of tunable optical elements; one or more photodetectors configured to receive light reflected from a user of the system and to generate one or more electrical signals based on the received light; and one or more processors electrically coupled to the plurality of tunable optical elements and the one or more photodetectors, the one or more processors configured to: obtain time-of-flight information corresponding to phase differences between a reference signal and the one or more electrical signals generated by the one or more photo detector s; determine a depth map of the user that comprises a depth map of an eye of the user based on the time-of-flight information; determine, based on the depth map of the user, action information that corresponds to an action of the user; and provide one or more outputs for adjusting one or more of the plurality of tunable optical elements based on the action information. ### Claim 3 (depends on 2) The system of claim 2, further comprising a display device configured to display an image based on the one or more outputs provided by the one or more processors. ### Claim 4 (depends on 3) The system of claim 3, wherein the image displayed by the display device is controlled by a subset of the plurality of tunable optical elements. ### Claim 5 (depends on 3) The system of claim 3, wherein the display device and the one or more photodetectors are packaged as two separate hardware devices. ### Claim 6 (depends on 3) The system of claim 3, wherein the display device and the one or more photodetectors are packaged as one integrated hardware device. ### Claim 7 (depends on 2) The system of claim 2, wherein the tunable optical elements comprise tunable lenses or mirrors. ### Claim 8 (depends on 2) The system of claim 2, wherein the action of the user comprises an eye gaze of the user. ### Claim 9 (depends on 2) The system of claim 2, wherein the one or more processors are configured to provide one or more outputs for adjusting focal lengths of the plurality of tunable optical elements. ### Claim 10 (depends on 2) The system of claim 2, wherein the one or more photodetectors are configured to filter the received light to remove a part of wavelengths of the received light. ### Claim 11 (depends on 2) The system of claim 2, wherein the received light is a modulation signal with 50% duty cycle. ### Claim 12 (depends on 2) The system of claim 2, wherein each photodetector comprises a time-of-flight pixel and two sets of transistors. ### Claim 13 (depends on 12) The system of claim 12, wherein each set of the two sets of transistors comprises a resistor, a source-follower transistor and a selection transistor. ### Claim 14 (depends on 12) The system of claim 12, wherein the time-of-flight pixel is a dual-switching time-of-flight pixel. ### Claim 15 (depends on 12) The system of claim 12, wherein the time-of-flight pixel is configured to implement a demodulation function by dual-switching transistors. ### Claim 16 (depends on 12) The system of claim 12, wherein the time-of-flight pixel comprises a light-absorption layer including germanium. ### Claim 17 A tracking method, comprising: generating, by one or more photodetectors, one or more electrical signals in response to light reflected from a user and received by the one or more photodetectors; obtaining, by a computing system having one or more processors electrically coupled to a plurality of tunable optical elements and the one or more photodetectors, time-of-flight information corresponding to phase differences between a reference signal and the one or more electrical signals generated by the one or more photodetectors; determining, by the computing system, a depth map of the user based on the time-of-flight information, the depth map of the user comprising a depth map of an eye of the user; determining, by the computing system and based on the depth map, action information that corresponds to an action of the user; and providing, by the computing system, one or more outputs for adjusting one or more of the plurality of tunable optical elements based on the action information. ### Claim 18 (depends on 17) The method of claim 17, further comprising: displaying an image using a display device based on the one or more outputs provided by the one or more processors. ### Claim 19 (depends on 18) The method of claim 18, wherein the image displayed by the display device is controlled by a subset of the plurality of tunable optical elements. ### Claim 20 (depends on 18) The method of claim 18, wherein the display device and the one or more photodetectors are integrated in a hardware package. ### Claim 21 A system comprising: a display; one or more photodetectors configured to receive light reflected from a user of the system and to generate one or more electrical signals based on the received light; and one or more processors electrically coupled to the display and the one or more photodetectors, the one or more processors configured to: obtain time-of-flight information corresponding to phase differences between a reference signal and the one or more electrical signals generated by the one or more photo detector s; determine a depth map of the user comprising a depth map of an eye of the user based on the time-of-flight information; determine, based on the depth map of the user, action information that corresponds to an action of the user; and provide one or more outputs for adjusting the display based on the action information.