# US 11,908,434 B2 · Image correction due to deformation of components of a viewing device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,434 B2 - Document ID: US11908434B2 - Status: Granted - Kind: B2 - Application number: 17/501,348 - Filed: 2021-10-14 - Published: 2022-03-03 - Granted: 2024-02-20 - Earliest claimed: 2018-03-15 - Assignees: Magic Leap, Inc. - Applicants: Magic Leap, Inc. - Inventors: Adam Neustein - Web page: https://patentgrep.com/patent/US11908434B2 ## CPC - G09G 5/38: with means for controlling the display position - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/147: using display panels - G06T 7/73: using feature-based methods - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - G09G 5/373: for modifying the size of the graphic pattern - H04N 13/327: Calibration thereof - H04N 13/344: with head-mounted left-right displays - H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G06T 2207/30201: Face - G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen - G09G 2320/0693: Calibration of display systems - G09G 2340/04: Changes in size, position or resolution of an image - G09G 2340/045: Zooming at least part of an image, i.e. enlarging it or shrinking it - G09G 2340/0464: Positioning - G09G 2354/00: Aspects of interface with display user - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A display assembly displays a virtual object in a select location wherein an eye viewing the virtual object has an expected gaze direction. Deformation of the display assembly is detected. The deformation causes the virtual object to be viewable in an altered location wherein the eye has altered gaze direction. The virtual object may be displayed in a corrected location wherein the eye viewing the virtual object in the correct location has a corrected gaze direction that is moved closer to the expected gaze direction than the altered gaze direction. ## Claims ### Claim 1 A method of displaying rendered content comprising: displaying, with a display assembly, a virtual object in a select location on the display assembly wherein an eye viewing the virtual object has an expected gaze direction; altering, with an attention generation unit, the display of the virtual object and attract a user's attention to the virtual object; detecting a measured gaze direction of the eye with an eye tracking camera of the display assembly; and detecting a deformation of the eye tracking camera of the display assembly, wherein the deformation of the eye tracking camera causes the virtual object to be viewable in an altered location wherein the eye has an altered gaze direction when detecting the measured gaze direction of the eye with the eye tracking camera. ### Claim 2 (depends on 1) The method of claim 1, further comprising: displaying, with a display assembly, the virtual object in a corrected location wherein the eye viewing the virtual object in the corrected location has a corrected gaze direction that is moved toward the expected gaze direction from the altered gaze direction. ### Claim 3 (depends on 1) The method of claim 1, wherein the display assembly includes: an optical display, the deformation being a deformation of the optical display. ### Claim 4 (depends on 3) The method of claim 3, wherein the optical display deforms in a display deformation direction and the altered gaze angle is moved relative to an initial gaze angle in the display deformation direction. ### Claim 5 (depends on 4) The method of claim 4, wherein the optical display is transparent and the virtual object is viewable by the eye at a location on a side of the optical display opposing the eye. ### Claim 6 (depends on 3) The method of claim 3, wherein the eye tracking camera that captures light reflected from the eye, further comprising calculating the altered gaze based on the light captured by the eye tracking camera. ### Claim 7 (depends on 1) The method of claim 1, wherein: a change from an initial gaze direction to the altered gaze direction is in a first direction and the change in the gaze angle direction due to the deformation of the eye tracking camera is in a first direction and the first and second directions are less than 90 degrees relative to one another, and the eye viewing the virtual object in the corrected location has a corrected gaze direction that is moved closer to the initial gaze direction than the altered gaze direction. ### Claim 8 (depends on 7) The method of claim 7, wherein: the change from the initial gaze direction to the altered gaze direction is in a first direction and the change in the gaze angle direction due to the deformation of the eye tracking camera is in a first direction and the first and second directions are more than 90 degrees relative to one another. ### Claim 9 (depends on 8) The method of claim 8, further comprising: displaying the object without moving the object from the altered location. ### Claim 10 (depends on 8) The method of claim 8, further comprising: displaying the object in a corrected location wherein the eye viewing the object in the corrected location has a corrected gaze direction that is moved closer to the initial gaze direction than the altered gaze direction. ### Claim 11 (depends on 10) The method of claim 10, further comprising: detecting a change in the gaze angle due to the deformation of the eye tracking camera; determining the change in the gaze angle due to the deformation of the display assembly by deducting the change in the gaze angle due to the deformation of the eye tracking camera from the change in the gaze angle; and displaying the object in a corrected location wherein the eye viewing the object in the corrected location has a corrected gaze direction that is moved in a direction opposite to the change in the gaze angle due to the deformation of the display assembly. ### Claim 12 (depends on 1) The method of claim 1, further comprising: taking multiple measurements; calculating multiple gaze angles, each gaze angle for a respective one of the measurements; and determining the altered gaze angle based on the multiple gaze angles. ### Claim 13 (depends on 1) The method of claim 1, wherein the attention generation unit attracts attention by changing a color of the virtual object. ### Claim 14 (depends on 1) The method of claim 1, wherein the attention generation unit attracts attention to the object by reducing a size of the virtual object.