# US 12,216,820 B2 · Head mounted display with visual condition compensation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,820 B2 - Document ID: US12216820B2 - Status: Granted - Kind: B2 - Application number: 18/673,291 - Filed: 2024-05-23 - Published: 2024-09-19 - Granted: 2025-02-04 - Earliest claimed: 2022-08-12 - Assignees: Penumbra, Inc. - Applicants: Penumbra, Inc. - Inventors: William Ka-Pui Yee; Jeffrey Peter Bellinghausen - Web page: https://patentgrep.com/patent/US12216820B2 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - A61B 3/0025: {characterised by electronic signal processing, e.g. eye models} - A61B 3/103: for determining refraction, e.g. refractometers or skiascopes - A61B 3/113: for determining or recording eye movement - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G09G 3/003: {to produce spatial visual effects} - G09G 2320/0626: for control of overall brightness - G09G 2320/066: for control of contrast - G09G 2340/045: Zooming at least part of an image, i.e. enlarging it or shrinking it - G09G 2354/00: Aspects of interface with display user - G09G 2380/08: Biomedical applications - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A method for compensating for a visual impairment in a virtual reality environment, by multiple computer systems associated with a head mounted display, including, rendering an initial image for display in a virtual reality environment, determining a first visual adjustment to the HMD based on an input received by the HMD, the input being associated with a visual impairment of a user of the HMD, determining that the first visual adjustment does not satisfy a threshold measure of compensation for the visual impairment of the user, determining a second visual adjustment to the HMD, and rendering an adjusted image for display in the virtual reality environment based on the first visual adjustment and the second visual adjustment. ## Claims ### Claim 1 A method comprising, by one or more computing systems associated with a head mounted display (HMD): rendering an initial image for display in a virtual reality environment; determining a first visual adjustment to the HMD based on an input received by the HMD, the input being associated with a visual impairment of a user of the HMD; determining that the first visual adjustment does not satisfy a threshold measure of compensation for the visual impairment of the user; determining a second visual adjustment to the HMD; and rendering an adjusted image for display in the virtual reality environment based on the first visual adjustment and the second visual adjustment. ### Claim 2 (depends on 1) The method of claim 1, wherein one or more of the first visual adjustment and the second visual adjustment comprises one or more adjustments to one or more image properties. ### Claim 3 (depends on 2) The method of claim 2, wherein the image properties comprise an image zoom, an image perspective, an image brightness, an image sharpness, and an image contrast. ### Claim 4 (depends on 1) The method of claim 1, wherein one or more of the first visual adjustment and the second visual adjustment comprise one or more adjustments to one or more optical lenses of the HMD. ### Claim 5 (depends on 4) The method of claim 4, wherein the adjustments to the optical lenses comprise altering a position of one or more of the optical lenses. ### Claim 6 (depends on 4) The method of claim 4, wherein the adjustments to the optical lenses comprise altering a shape of one or more of the optical lenses. ### Claim 7 (depends on 6) The method of claim 6, wherein altering the shape of one or more of the optical lenses comprises altering a curvature of one or more of the optical lenses. ### Claim 8 (depends on 4) The method of claim 4, wherein the adjustments to the optical lenses comprise altering an index of refraction of one or more of the optical lenses. ### Claim 9 (depends on 1) The method of claim 1, wherein the first visual adjustment is a different type of adjustment from the second visual adjustment. ### Claim 10 (depends on 1) The method of claim 1, wherein the initial image is rendered having an image quality associated with unimpaired vision. ### Claim 11 (depends on 1) The method of claim 1, further comprising: rendering a visual prompt associated with the initial image for display in the virtual reality environment. ### Claim 12 (depends on 11) The method of claim 11, wherein the input received by the HMD is further associated with the visual prompt. ### Claim 13 (depends on 1) The method of claim 1, wherein the input received by the HMD comprises one or more user inputs received by the HMD. ### Claim 14 (depends on 13) The method of claim 13, wherein one or more of the user inputs comprise one or more eye positions of the user detected by the HMD. ### Claim 15 (depends on 13) The method of claim 13, wherein one or more of the user inputs comprise one or more audio commands detected by the HMD. ### Claim 16 (depends on 13) The method of claim 13, wherein one or more of the user inputs comprise one or more body movements detected by the HMD. ### Claim 17 (depends on 1) The method of claim 1, wherein the second visual adjustment to the HMD is determined based on a second input received by the HMD. ### Claim 18 (depends on 17) The method of claim 17, wherein the second input received by the HMD comprises one or more user inputs received by the HMD. ### Claim 19 A computer system comprising: a plurality of sensors; one or more computing systems associated with a head mounted display (HMD); and one or more computer-readable non-transitory storage media embodying software that is operable when executed to: render an initial image for display in a virtual reality environment; determine a first visual adjustment to the HMD based on an input received by the HMD, the input being associated with a visual impairment of a user of the HMD; determine that the first visual adjustment does not satisfy a threshold measure of compensation for the visual impairment of the user; determine a second visual adjustment to the HMD; and render an adjusted image for display in the virtual reality environment based on the first visual adjustment and the second visual adjustment. ### Claim 20 One or more computer-readable non-transitory storage media embodying software that is operable when executed by one or more computing systems associated with a head mounted display (HMD) to: render an initial image for display in a virtual reality environment; determine a first visual adjustment to the HMD based on an input received by the HMD, the input being associated with a visual impairment of a user of the HMD; determine that the first visual adjustment does not satisfy a threshold measure of compensation for the visual impairment of the user; determine a second visual adjustment to the HMD; and render an adjusted image for display in the virtual reality environment based on the first visual adjustment and the second visual adjustment.