# US 8,786,953 B2 · User interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,786,953 B2 - Document ID: US8786953B2 - Status: Granted - Kind: B2 - Application number: 14/071,974 - Filed: 2013-11-05 - Published: 2014-02-27 - Granted: 2014-07-22 - Earliest claimed: 2011-11-22 - Assignees: Google Inc. - Applicants: Google Inc. - Inventors: Aaron Joseph Wheeler; Luis Ricardo Prada Gomez; Hayes Solos Raffle - Web page: https://patentgrep.com/patent/US8786953B2 ## CPC - G02B 27/0172: {characterised by optical features} - A61B 3/113: for determining or recording eye movement - G01S 17/66: Tracking systems using electromagnetic waves other than radio waves - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/017: {Head mounted} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/0485: Scrolling or panning - G06V 40/19: Sensors therefor - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD. ## Claims ### Claim 1 A method comprising: displaying images on a display, the display having a central axis; determining a gaze axis with respect to the central axis; determining a target object in the displayed images based on the gaze axis; and adjusting the displayed images on the display to move the target object towards the central axis. ### Claim 2 (depends on 1) The method of claim 1, wherein determining the gaze axis comprises: obtaining an eye pupil image; determining the gaze axis from the eye pupil image. ### Claim 3 (depends on 1) The method of claim 1, wherein determining the gaze axis comprises: obtaining a plurality of eye pupil images; and determining the gaze axis from the plurality of eye pupil images. ### Claim 4 (depends on 1) The method of claim 1, wherein adjusting the displayed images on the display comprises: moving the target object at a tracking rate. ### Claim 5 (depends on 4) The method of claim 4, wherein adjusting the displayed images on the display further comprises: adjusting the tracking rate based on a difference between the gaze axis and the central axis. ### Claim 6 A method comprising: displaying images on a display, the display having a central axis; determining a gaze axis with respect to the central axis; determining a target object in the displayed images based on the gaze axis; recording data based on the central axis, the gaze axis, the target object, and the displayed images; and adjusting the displayed images on the display based on the recorded data, wherein adjusting the displayed images on the display based on the recorded data comprises controlling movement of the displayed images on the display. ### Claim 7 (depends on 6) The method of claim 6, further comprising: determining a user interface preference based on the recorded data; adjusting the displayed images on the display based on the user interface preference. ### Claim 8 (depends on 6) The method of claim 6, wherein controlling movement of the displayed images on the display comprises controlling a rate of text scrolling. ### Claim 9 A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions, the functions comprising: controlling a display to display images, the display having a central axis; determining a gaze axis with respect to the central axis; determining a target object in the displayed images based on the gaze axis; and controlling the display to adjust the displayed images so as to move the target object towards the central axis. ### Claim 10 (depends on 9) The non-transitory computer readable medium of claim 9, wherein determining a gaze axis comprises: obtaining an eye pupil image; determining the gaze axis from the eye pupil image. ### Claim 11 (depends on 9) The non-transitory computer readable medium of claim 9, wherein determining the gaze axis comprises: obtaining a plurality of eye pupil images; and determining a gaze axis from the plurality of eye pupil images. ### Claim 12 (depends on 9) The non-transitory computer readable medium of claim 9, wherein controlling the display to adjust the displayed images comprises moving the target object at a tracking rate. ### Claim 13 (depends on 12) The non-transitory computer readable medium of claim 12, wherein controlling the display to adjust the displayed images further comprises adjusting the tracking rate based on a difference between the gaze axis and the central axis. ### Claim 14 (depends on 9) The non-transitory computer readable medium of claim 9, wherein the functions further comprise: recording data based on the central axis, the gaze axis, the target object, and the displayed images, and adjusting the displayed images on the display based on the recorded data.