# US 10,310,597 B2 · Portable eye tracking device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,310,597 B2 - Document ID: US10310597B2 - Status: Granted - Kind: B2 - Application number: 15/277,225 - Filed: 2016-09-27 - Published: 2017-01-19 - Granted: 2019-06-04 - Earliest claimed: 2013-09-03 - Assignees: Tobii AB - Applicants: Tobii AB - Inventors: Ralf Biedert; Robin Thunström; Jonas Andersson - Web page: https://patentgrep.com/patent/US10310597B2 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - A61B 3/113: for determining or recording eye movement - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/017: {Head mounted} - G02B 27/0172: {characterised by optical features} - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 7/74: {involving reference images or patches} - H04R 1/32: for obtaining desired directional characteristic only {(specially adapted for hearing aids H04R25/40)} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G06T 2207/10152: Varying illumination - G06T 2207/30201: Face - H04R 2201/40: Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, a movement sensor, and a control unit. The frame may be a frame adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The movement sensor may be configured to detect movement of the frame. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the image sensors, and receive information from the movement sensor. ## Claims ### Claim 1 A method for calibrating a gaze detection system, wherein the method comprises: displaying a plurality of multipurpose virtual objects as part of an interactive virtual experience in a virtual reality environment on a display of a wearable device worn by a user; selecting a multipurpose virtual object of the plurality of multipurpose virtual objects based at least in part on a determination that the user is anticipated to interact with the multipurpose virtual object during the interactive virtual experience; detecting a user interaction of the user with the multipurpose virtual object during the interactive virtual experience; determining that the user interaction of the user with the multipurpose virtual object causes a change to the multipurpose virtual object; and responsive to determining that the user interaction of the user with the multipurpose virtual object causes the change to the multipurpose virtual object, initiating, during the interactive virtual experience, a calibration process of the gaze detection system, the calibration process comprising: determining a gaze direction of the user relative to the multipurpose virtual object with the gaze detection system of the wearable device; and calibrating the gaze detection system based at least in part on the gaze direction. ### Claim 2 (depends on 1) The method for calibrating a gaze detection system of claim 1, wherein: the method further comprises receiving an input; and calibrating the gaze detection system occurs in response to the input. ### Claim 3 (depends on 2) The method for calibrating a gaze detection system of claim 2, wherein the input comprises: an input from a hand held controller. ### Claim 4 (depends on 2) The method for calibrating a gaze detection system of claim 2, wherein the input comprises: an interaction by the user with the multipurpose virtual object that moves the multipurpose virtual object closer to a particular portion of a virtual body of the user in the virtual reality environment. ### Claim 5 (depends on 2) The method for calibrating a gaze detection system of claim 2, wherein the input comprises: the gaze direction remaining consistent for a predetermined amount of time. ### Claim 6 (depends on 1) The method for calibrating a gaze detection system of claim 1, wherein: the multipurpose virtual object comprises a salient feature; and determining the gaze direction of the user relative to the multipurpose virtual object comprises determining the gaze direction of the user relative to the salient feature. ### Claim 7 (depends on 1) The method for calibrating a gaze detection system of claim 1, wherein determining that the user interaction of the user with the multipurpose virtual object causes the change to the multipurpose virtual object comprises: determining that the user has picked up the multipurpose virtual object in the virtual reality environment. ### Claim 8 (depends on 1) The method for calibrating a gaze detection system of claim 1, wherein determining that the user interaction of the user with the multipurpose virtual object causes the change to the multipurpose virtual object comprises: determining that the user has moved the multipurpose virtual object in the virtual reality environment. ### Claim 9 (depends on 8) The method for calibrating a gaze detection system of claim 8, wherein the determining that the user has moved the multipurpose virtual object comprises: determining that the user has moved the multipurpose virtual object closer to a particular portion of a virtual body of the user in the virtual reality environment. ### Claim 10 (depends on 1) The method for calibrating a gaze detection system of claim 1, wherein the multipurpose virtual object is used in the virtual reality environment for one or more purposes in addition to the calibration process. ### Claim 11 (depends on 1) The method for calibrating a gaze detection system of claim 1, wherein the calibration process is a recalibration process. ### Claim 12 (depends on 1) The method for calibrating a gaze detection system of claim 1, wherein a first purpose of the multipurpose virtual object is for the calibration process of the gaze detection system and a second purpose of the multipurpose virtual object is for the interactive virtual experience other than the calibration process. ### Claim 13 A non-transitory machine-readable medium having instructions stored thereon for calibrating a gaze detection system, wherein the instructions are executable by at least one processor to at least: displaying a plurality of multipurpose virtual objects as part of an interactive virtual experience in a virtual reality environment on a display of a wearable device worn by a user; selecting a multipurpose virtual object of the plurality of multipurpose virtual objects based at least in part on a determination that the user is anticipated to interact with the multipurpose virtual object during the interactive virtual experience; detect a user interaction of the user with the multipurpose virtual object during the interactive virtual experience; determine that the user interaction of the user with the multipurpose virtual object causes a change to the multipurpose virtual object; and responsive to determining that the user interaction of the user with the multipurpose virtual object causes the change to the multipurpose virtual object, initiate, during the interactive virtual experience, a calibration process of the gaze detection system, the calibration process comprising: determine a gaze direction of the user relative to the multipurpose virtual object with the gaze detection system of the wearable device; and calibrate the gaze detection system based at least in part on the gaze direction. ### Claim 14 (depends on 13) The non-transitory machine-readable medium of claim 13, wherein the instructions are further executable to at least: receive an input, wherein calibrating the gaze detection system occurs in response to the input. ### Claim 15 (depends on 14) The non-transitory machine-readable medium of claim 14, wherein the input comprises: the gaze direction remaining consistent for a predetermined amount of time. ### Claim 16 (depends on 13) The non-transitory machine-readable medium of claim 13, wherein: the multipurpose virtual object comprises a salient feature; and determining the gaze direction of the user relative to the multipurpose virtual object comprises determining the gaze direction of the user relative to the salient feature. ### Claim 17 (depends on 13) The non-transitory machine-readable medium of claim 13, wherein determining that the user interaction of the user with the multipurpose virtual object causes the change to the multipurpose virtual object comprises: determining that the user has picked up the multipurpose virtual object in the virtual reality environment. ### Claim 18 A system for determining a gaze direction of a user, wherein the system comprises: a wearable device having a display and a gaze detection system; and one or more processors configured to at least: display a plurality of multipurpose virtual objects as part of an interactive virtual experience in a virtual reality environment on the display; select a multipurpose virtual object of the plurality of multipurpose virtual objects based at least in part on a determination that the user is anticipated to interact with the multipurpose virtual object during the interactive virtual experience; detect a user interaction of a user with the multipurpose virtual object during the interactive virtual experience; determine that the user interaction of the user with the multipurpose virtual object causes a change to the multipurpose virtual object; in response to determining that the user interaction of the user with the multipurpose virtual object causes the change to the multipurpose virtual object, initiate, during the interactive virtual experience, a calibration process of the gaze detection system, the calibration process comprising: determining a gaze direction of the user relative to the multipurpose virtual object with the gaze detection system; and calibrating the gaze detection system based at least in part on the gaze direction. ### Claim 19 (depends on 18) The system of claim 18, wherein: the multipurpose virtual object comprises a salient feature; and determining the gaze direction of the user relative to the multipurpose virtual object comprises determining the gaze direction of the user relative to the salient feature. ### Claim 20 (depends on 18) The system of claim 18, wherein determining that the user interaction of the user with the multipurpose virtual object causes the change to the multipurpose virtual object comprises: determining that the user has picked up the multipurpose virtual object in the virtual reality environment.