# US 10,375,283 B2 · Portable eye tracking device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,283 B2 - Document ID: US10375283B2 - Status: Granted - Kind: B2 - Application number: 15/650,445 - Filed: 2017-07-14 - Published: 2018-05-10 - Granted: 2019-08-06 - Earliest claimed: 2013-09-03 - Assignees: Tobii AB - Applicants: Tobii AB - Inventors: Simon Gustafsson; Anders Kingbäck; Markus Cederlund - Web page: https://patentgrep.com/patent/US10375283B2 ## CPC - A61B 3/113: for determining or recording eye movement - G02B 27/017: {Head mounted} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 7/74: {involving reference images or patches} - H04N 23/56: provided with illuminating means - H04R 1/32: for obtaining desired directional characteristic only {(specially adapted for hearing aids H04R25/40)} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G06T 2207/10152: Varying illumination - G06T 2207/30201: Face - H04R 2201/40: Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, and a control unit. The frame may be adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the at least one image sensor, and calibrate at least one illuminator, at least one image sensor, or an algorithm of the control unit. ## Claims ### Claim 1 A wearable device comprising: at least one illuminator configured to illuminate at least a portion of at least one eye of a user when activated; and at least one image sensor configured to provide first image data representative of images of the at least one eye of the user; and one or more processors configured to: activate, selectively, the at least one illuminator; receive the first image data from the at least one image sensor; calibrate, based at least in part on the first image data, an algorithm executable by the one or more processors to determine a gaze direction of the user; determine whether the algorithm has reduced in accuracy; receive second image data from at least two image sensors in response to determining the algorithm has reduced in accuracy; and determine a gaze direction for the user, based at least in part on the algorithm and at least one of the first image data or the second image data. ### Claim 2 (depends on 1) The wearable device of claim 1, further comprising: a camera facing away from the user to capture scene image data representing images of at least a portion of a user's field of view. ### Claim 3 (depends on 2) The wearable device of claim 2, wherein the one or more processors are further configured to: determine a gaze target area based at least in part on the scene image data. ### Claim 4 (depends on 2) The wearable device of claim 2, wherein the one or more processors are further configured to: determine, automatically, a pattern or item within the scene image data; and calibrate, based at least in part on the pattern or item within the scene image data, the algorithm. ### Claim 5 (depends on 1) The wearable device of claim 1, further comprising a positioning device; and wherein the one or more processors being configured to determine whether the algorithm has reduced in accuracy is based on data from the positioning device. ### Claim 6 (depends on 1) The wearable device of claim 1, wherein the one or more processors are further configured to calibrate the at least one illuminator or the at least one image sensor. ### Claim 7 (depends on 1) The wearable device of claim 1, wherein calibrating the algorithm comprises changing a value of a parameter used in the algorithm. ### Claim 8 A method comprising: illuminating, with at least one illuminator, at least a portion of at least one eye of a user; collecting, with at least one image sensor, first image data representative of an image of the at least one eye of the user while the at least one eye of the user is illuminated; calibrating, based at least in part on the first image data, at least one illuminator, at least one image sensor, or an algorithm executable to determine a gaze direction of the user; determining, using a processor, that the algorithm has reduced in accuracy; collecting, with at least two image sensors, second image data representative of a set of images of the at least one eye of the user while the at least one eye of the user is illuminated in response to determining the algorithm has reduced in accuracy; and determining a gaze direction of the user, based on at least the first image data or the second image data. ### Claim 9 (depends on 8) The method of claim 8, further comprising: collecting surrounding image data representative of a field of view of a user. ### Claim 10 (depends on 9) The method of claim 9, further comprising: determining, based at least in part on the surrounding image data and the gaze direction, a gaze target. ### Claim 11 (depends on 9) The method of claim 9, further comprising: determining whether the surrounding image data contains a pattern or item. ### Claim 12 (depends on 11) The method of claim 11, further comprising: calibrating the algorithm based at least in part on the determination that the surrounding image data contains a pattern or item. ### Claim 13 (depends on 9) The method of claim 9, further comprising: calibrating the algorithm based at least in part on the surrounding image data. ### Claim 14 (depends on 8) The method of claim 8, further comprising: collecting position data or motion data from a sensor on a wearable device; and wherein determining that the algorithm has reduced in accuracy is based on at least the position data or the motion data. ### Claim 15 A non-transitory computer-readable medium having instructions stored thereon executable by a computing device to cause the computing device to perform operations comprising: illuminate, with at least one illuminator, at least one portion of one eye of a user; collect, with at least one image sensor, first image data corresponding to an image of the at least one portion of one eye of the user while illuminated; calibrate, based at least in part on the image data, at least one illuminator, at least one image sensor, or an algorithm executable by the computing device to determine a gaze direction of the user; determine whether the algorithm has reduced in accuracy; collect, with at least two image sensors, second image data corresponding to a set of images of the at least one portion of one eye of the user while illuminated; and determine a gaze direction for the user based at least in part on at least the first image data or the second image data. ### Claim 16 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the instructions are further executable to: collect, by a scene camera, scene image data corresponding to a user's field of view. ### Claim 17 (depends on 16) The non-transitory computer-readable medium of claim 16, wherein calibrating the algorithm is further based on the scene image data. ### Claim 18 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein calibrating the algorithm comprises altering a parameter value of the algorithm. ### Claim 19 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the instructions are further executable to: collect position data or motion data from a sensor; and wherein determining whether the algorithm as reduced in accuracy is based at least in part on the position data of the motion data. ### Claim 20 (depends on 16) The non-transitory computer-readable medium of claim 16, wherein the instructions are further executable to: determine, automatically, a pattern or item within the scene image data; and calibrate, based at least in part on the pattern or item within the scene image data, the algorithm. ### Claim 21 (depends on 5) The wearable device of claim 5, wherein the data from the positioning device comprises motion data relating to a movement of the wearable device.