# US 12,001,605 B2 · Head mounted display with visual condition compensation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,001,605 B2 - Document ID: US12001605B2 - Status: Granted - Kind: B2 - Application number: 18/185,254 - Filed: 2023-03-16 - Published: 2024-02-15 - Granted: 2024-06-04 - Earliest claimed: 2022-08-12 - Assignees: Penumbra, Inc. - Applicants: Penumbra, Inc. - Inventors: William Ka-Pui Yee; Jeffrey Peter Bellinghausen - Web page: https://patentgrep.com/patent/US12001605B2 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - A61B 3/0025: {characterised by electronic signal processing, e.g. eye models} - A61B 3/103: for determining refraction, e.g. refractometers or skiascopes - A61B 3/113: for determining or recording eye movement - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G09G 3/003: {to produce spatial visual effects} - G09G 2320/0626: for control of overall brightness - G09G 2320/066: for control of contrast - G09G 2340/045: Zooming at least part of an image, i.e. enlarging it or shrinking it - G09G 2354/00: Aspects of interface with display user - G09G 2380/08: Biomedical applications - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A method for compensating for a visual impairment in a virtual reality environment, by multiple computer systems associated with a head mounted display, including, rendering an image for display in a virtual reality environment, identifying, based at least in part on an input received by the head mounted display, a visual impairment associated with a user of the head mounted display, determining one or more visual adjustments to the head mounted display based on the identified visual impairment, and rendering an adjusted image for display in the virtual reality environment based on the one or more visual adjustments. ## Claims ### Claim 1 A method comprising, by one or more computing systems associated with a head mounted display (HMD): rendering an initial image for display in a virtual reality environment, wherein the initial image is rendered having an image quality associated with unimpaired vision; identifying, based at least in part on an input received by the HMD, a visual impairment associated with a user of the HMD; determining one or more visual adjustments to the HMD based on the identified visual impairment; and rendering an adjusted image for display in the virtual reality environment based on the one or more visual adjustments. ### Claim 2 (depends on 1) The method of claim 1, wherein the input received by the HMD comprises one or more user inputs received by the HMD. ### Claim 3 (depends on 2) The method of claim 2, wherein one or more of the user inputs comprise one or more eye positions of a user detected by the HMD. ### Claim 4 (depends on 3) The method of claim 3, wherein one or more of the user inputs are further based on a detection of one or more of eye movements based on the one or more detected eye positions. ### Claim 5 (depends on 3) The method of claim 3, wherein one or more of the user inputs are further based on a detection of a focal point based on the one or more detected eye positions. ### Claim 6 (depends on 3) The method of claim 3, wherein one or more of the detected eye positions are associated with a visual prompt displayed in the virtual reality environment. ### Claim 7 (depends on 3) The method of claim 3, further comprising: comparing one or more of the detected eye positions to one or more reference eye positions; and identifying the visual impairment based on the comparison of the detected eye positions and the reference eye positions. ### Claim 8 (depends on 7) The method of claim 7, wherein identifying the visual impairment is further based on a detection of one or more eye movements based on the one or more detected eye positions. ### Claim 9 (depends on 7) The method of claim 7, wherein identifying the visual impairment is further based on a detection of a focal point based on the one or more detected eye positions. ### Claim 10 (depends on 2) The method of claim 2, wherein one or more of the user inputs comprise one or more audio commands detected by the HMD. ### Claim 11 (depends on 2) The method of claim 2, wherein one or more of the user inputs comprise one or more body movements detected by the HMD. ### Claim 12 (depends on 1) The method of claim 1, wherein the visual impairment comprises one or more of nearsightedness, farsightedness, and an astigmatism. ### Claim 13 (depends on 1) The method of claim 1, wherein one or more of the visual adjustments to the HMD comprise one or more adjustments to the initial image displayed in the virtual reality environment. ### Claim 14 (depends on 13) The method of claim 13, wherein one or more of the adjustments to the initial image are associated with one or more of an image zoom, an image perspective, an image brightness, an image sharpness, and an image contrast. ### Claim 15 (depends on 1) The method of claim 1, wherein the one or more visual adjustments to the HMD comprise one or more adjustments to one or more optical lenses of the HMD. ### Claim 16 (depends on 15) The method of claim 15, wherein one or more of the adjustments to the optical lenses comprise altering a position of one or more of the optical lenses. ### Claim 17 (depends on 15) The method of claim 15, wherein one or more of the adjustments to the optical lenses comprise altering a shape of one or more of the optical lenses. ### Claim 18 (depends on 17) The method of claim 17, wherein altering the shape of one or more of the optical lenses comprises altering a curvature of one or more of the optical lenses. ### Claim 19 (depends on 15) The method of claim 15, wherein one or more of the adjustments to the optical lenses comprise altering an index of refraction of one or more of the optical lenses. ### Claim 20 (depends on 1) The method of claim 1, further comprising: determining one or more second visual adjustments to the HMD based on the identified visual impairment and one or more second inputs received by the HMD, wherein the one or more second inputs are received in response to the adjusted image displayed in the virtual reality environment, and wherein the one or more second visual adjustments correspond to a measure of visual compensation associated with a second adjusted image. ### Claim 21 A computer system comprising: a plurality of sensors; one or more computing systems associated with a head mounted display (HMD); and one or more computer-readable non-transitory storage media embodying software that is operable when executed to: render an initial image for display in a virtual reality environment, wherein the initial image is rendered having an image quality associated with unimpaired vision; identify, based at least in part on an input received by the HMD, a visual impairment associated with a user of the HMD; determine one or more visual adjustments to the HMD based on the identified visual impairment; and render an adjusted image for display in the virtual reality environment based on the one or more visual adjustments. ### Claim 22 One or more computer-readable non-transitory storage media embodying software that is operable when executed by one or more computing systems associated with a head mounted display (HMD) to: render an initial image for display in a virtual reality environment, wherein the initial image is rendered having an image quality associated with unimpaired vision; identify, based at least in part on an input received by the HMD, a visual impairment associated with a user of the HMD; determine one or more visual adjustments to the HMD based on the identified visual impairment; and render an adjusted image for display in the virtual reality environment based on the one or more visual adjustments.