# US 10,307,053 B2 · Method for calibrating a head-mounted eye tracking device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,307,053 B2 - Document ID: US10307053B2 - Status: Granted - Kind: B2 - Application number: 15/103,000 - Filed: 2014-12-16 - Published: 2016-10-20 - Granted: 2019-06-04 - Earliest claimed: 2013-12-17 - Assignees: Essilor International - Applicants: Essilor International - Inventors: Romain Fayolle - Web page: https://patentgrep.com/patent/US10307053B2 ## CPC - A61B 3/113: for determining or recording eye movement - A61B 3/0091: {Fixation targets for viewing direction} - G02B 5/1866: {Transmission gratings characterised by their structure, e.g. step profile, contours of substrate or grooves, pitch variations, materials (G02B5/1809, G02B5/1828, G02B5/1833, G02B5/1838 and G02B5/1847 take precedence)} - G02C 11/10: {Electronic devices other than hearing aids} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - A61B 2560/0238: Means for recording calibration data - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Method for calibrating a head-mounted eye tracking device, the method comprising: all acquisition step (S3), during which eye data relating to the position of the eye of the wearer are acquired by the eye tracking device while having the wearer of the head-mounted eye tracking device look in a direction of reference with regard to the spectacle lens mount, an association step (S4) during which the eye data acquired during the acquisition step are associated with the gaze direction corresponding to the direction of reference, a recording step (S5), during which the associated eye data and the gaze direction are recorded—wherein the head-mounted mounted eye tracking device comprises a spectacle frame in which ophthalmic lenses are mounted and the gazing direction corresponding to the direction of reference is determined based on the dioptric function of the ophthalmic lenses. ## Claims ### Claim 1 A method for calibrating a head-mounted eye tracking device, the method comprising: acquiring eye data relating to a position of an eye of a wearer using at least one camera arranged on a spectacle frame of the head-mounted eye tracking device while having the wearer of the head-mounted eye tracking device look in a direction of reference; associating the eye data acquired during the acquiring with a gaze direction corresponding to the direction of reference using a processor of the head-mounted eye tracking device; recording the associated eye data and the gaze direction in a memory of the head-mounted eye tracking device, providing a calibration support comprising at least a visual reference element to the wearer wearing the head-mounted eye tracking device; and placing the calibration support between at least one eye of the wearer and a visual environment of the wearer in a known position relative to the wearer's eye and to the head-mounted eye tracking device so as to define with the visual reference element the direction of reference, wherein the head-mounted eye tracking device comprises ophthalmic lenses mounted on the spectacle frame of the head-mounted eye tracking device, and the gazing direction corresponding to the direction of reference is determined based on a dioptric function of the ophthalmic lenses, and wherein, during the placing, the calibration support is placed on at least one surface of at least one of the ophthalmic lenses and the gazing direction corresponding to the visual reference element is determined based on the dioptric function of the ophthalmic lenses. ### Claim 2 (depends on 1) The method according to claim 1, wherein the acquiring, the associating, and the recording are repeated. ### Claim 3 (depends on 1) The method according to claim 1, wherein the acquiring, the associating, and the recording step are repeated with at least one of the wearer gazing in a different direction of reference and at a different gazing distance. ### Claim 4 (depends on 1) The method according to claim 1, wherein the head-mounted eye tracking device comprises at least a visual reference element in the form of a microstructured pattern designed to diffract an incident light beam towards the wearer's eye under specific lightning conditions. ### Claim 5 (depends on 1) The method according to claim 1, wherein the calibration support comprises a plurality of visual reference elements, and the associating and recording are repeated for each visual reference element. ### Claim 6 (depends on 1) The method according to claim 1, wherein the calibration support is transparent to visible light, and the at least one visual reference element is a microstructured pattern designed to diffract an incident light beam towards the wearer's eye. ### Claim 7 (depends on 1) The method according to claim 1, wherein the calibration support is opaque to light. ### Claim 8 (depends on 1) The method according to claim 1, wherein a switchable light source is attached to at least one opening in the calibration support, and is configured to highlight the visual reference element during the acquiring. ### Claim 9 (depends on 1) The method according to claim 1, wherein during the placing the calibration support is placed on at least one surface of at least one of the ophthalmic lenses and the gazing direction corresponding to the reference element is determined based on a dioptric function of the ophthalmic lenses. ### Claim 10 (depends on 1) The method according to claim 1, wherein the calibration support comprises an optical system generating a virtual image, and wherein a virtual display device is used to generate the at least one visual reference element. ### Claim 11 (depends on 1) The method according to claim 1, wherein the method further comprises determining an eye tracking position during which a relative position of the head-mounted eye tracking device relative to a face of the wearer when being worn by the wearer is determined. ### Claim 12 (depends on 11) The method according to claim 11, the method further comprising: determining a deviation from an initial position of the relative position of the face of the wearer with respect to the head-mounted eye tracking device; and adjusting an eye tracking function based on the deviation determined during the determining of the deviation, wherein the initial position corresponds to the relative position of the face of the wearer with respect to the head-mounted eye tracking device during calibration. ### Claim 13 (depends on 12) The method according to claim 12, wherein the determining of the deviation and the adjusting are repeated every 30 seconds. ### Claim 14 (depends on 12) The method according to claim 12, wherein during the determining of the deviation, a distance between the eye and the eye tracking device and the relative position of a center of rotation of the eye with respect to the head-mounted eye tracking device are determined. ### Claim 15 (depends on 14) The method according to claim 14, wherein the head-mounted eye tracking device further comprises at least two light sources configured to illuminate at least one eye of the wearer, and wherein the distance between the eye and the head-mounted eye tracking device is determined based on a shape formed by reflections of the light sources on a cornea of the eye of the wearer illuminated by the light sources. ### Claim 16 A computer program product stored on a non-transitory computer readable medium comprising stored sequences of instructions that are accessible to a processor and which, when executed by the processor, causes the processor to carry out the following: acquiring eye data relating to a position of an eye of a wearer using at least one camera arranged on a spectacle frame of a head-mounted eye tracking device while having the wearer of the head-mounted eye tracking device look in a direction of reference; associating the eye data acquired during the associating with a gaze direction corresponding to the direction of reference using a processor of the head-mounted eye tracking device; recording the associated eye data and the gaze direction in a memory of the head-mounted eye tracking device; providing a calibration support comprising at least a visual reference element to the wearer wearing the head-mounted eye tracking device; and placing the calibration support between at least one eye of the wearer and a visual environment of the wearer in a known position relative to the wearer's eye and to the head-mounted eye tracking device so as to define with the visual reference element the direction of reference, wherein the at least one visual reference element is an optical opening in the calibration support, and wherein the head-mounted eye tracking device comprises ophthalmic lenses mounted on the spectacle frame of the head-mounted eye tracking device, and the gazing direction corresponding to the direction of reference is determined based on a dioptric function of the ophthalmic lenses wherein, during the placing, the calibration support is placed on at least one surface of at least one of the ophthalmic lenses and the gazing direction corresponding to the visual reference element is determined based on the dioptric function of the ophthalmic lenses. ### Claim 17 (depends on 16) The computer program product according to claim 16, wherein the stored sequences of instructions that are accessible to the processor and which, when executed by the processor, causes the processor to further carry out the following: determining a deviation from an initial position of a relative position of a face of the wearer with respect to the head-mounted eye tracking device; and adjusting an eye tracking function based on the deviation determined during the determining of the deviation, wherein the initial position corresponds to the relative position of the face of the wearer with respect to the head-mounted eye tracking device during calibration.