# US 10,481,684 B2 · System and method for foveated image generation using an optical combiner > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,481,684 B2 - Document ID: US10481684B2 - Status: Granted - Kind: B2 - Application number: 15/815,485 - Filed: 2017-11-16 - Published: 2018-06-14 - Granted: 2019-11-19 - Earliest claimed: 2016-12-09 - Assignees: NVIDIA Corporation - Applicants: NVIDIA Corporation - Inventors: Ward Lopes; Kaan Aksit - Web page: https://patentgrep.com/patent/US10481684B2 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - A61B 3/0008: {provided with illuminating means (A61B3/117, A61B3/14 take precedence)} - A61B 3/0041: {characterised by display arrangements} - A61B 3/113: for determining or recording eye movement - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/0103: {comprising holographic elements} - G02B 27/0172: {characterised by optical features} - G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) - G06V 40/19: Sensors therefor - G02B 2027/0105: {Holograms with particular structures} - G02B 2027/0174: {holographic} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method, computer readable medium, and system are disclosed for generating foveal images. The method includes the steps of redirecting first light rays towards an eye, where the first light rays are redirected by an optical combiner and produce a peripheral image and generating second light rays by a light engine. The second light rays are redirected towards the eye, where the second light rays intersect a first region of the optical combiner and converge at a nodal point within the eye and produce an inset foveal image positioned within at least a portion of the peripheral image. An origin of the second light rays is offset to intersect a second region of the optical combiner in response to a change in a gaze direction of the eye. ## Claims ### Claim 1 A display system, comprising: an optical combiner configured to: redirect a first set of light rays towards an eye, wherein the redirected first set of light rays produce a peripheral image; and redirect a second set of light rays towards the eye, wherein the redirected second light rays produce an inset foveal image positioned within at least a portion of the peripheral image; and a light engine configured to generate the second set of light rays to intersect a first region of the optical combiner and converge at a nodal point within 1 mm of a rotational center the eye and, in response to a change in a gaze direction of the eye, to offset an origin of the second set of light rays to move the intersection of the second set of light rays with the optical combiner from the first region to a second region of the optical combiner. ### Claim 2 (depends on 1) The display system of claim 1, wherein the offset comprises a lateral shift of the light engine. ### Claim 3 (depends on 1) The display system of claim 1, wherein the redirected first set of light rays converge at a second nodal point within the eye. ### Claim 4 (depends on 3) The display system of claim 3, wherein the second nodal point is on a retina of the eye. ### Claim 5 (depends on 3) The display system of claim 3, wherein the second nodal point is between the nodal point and a pupil of the eye. ### Claim 6 (depends on 1) The display system of claim 1, wherein the redirected first set of light rays converge at the nodal point. ### Claim 7 (depends on 1) The display system of claim 1, wherein the optical combiner comprises a single-layer holographic optical element configured to redirect the first and second sets of light rays and transmit other light rays. ### Claim 8 (depends on 1) The display system of claim 1, wherein the optical combiner comprises a holographic optical element having a first layer configured to redirect the first set of light rays and transmit other light rays and a second layer configured to redirect the second set of light rays and transmit the first set of light rays and the other light rays. ### Claim 9 (depends on 1) The display system of claim 1, wherein the light engine comprises a single projector configured to output the first set of light rays during a first duration of time and output the second set of light rays during a second duration of time that does not overlap with the first duration of time. ### Claim 10 (depends on 1) The display system of claim 1, wherein the light engine comprises a first projector configured to output the first set of light rays and a second projector configured to output the second set of light rays. ### Claim 11 (depends on 1) The display system of claim 1, the nodal point is the rotational center of the eye. ### Claim 12 (depends on 1) The display system of claim 1, wherein the redirected first set of light rays converge at a second nodal point within the eye and the peripheral image appears at a different distance from the eye compared with the inset foveal image. ### Claim 13 (depends on 12) The display system of claim 12, wherein the optical combiner is further configured to redirect the first set of light rays from a first region centered at a first point and redirect the second set of light rays from a second region centered at a second point that is within 8 mm of the first point. ### Claim 14 (depends on 1) The display system of claim 1, wherein the redirected first set of light rays are within a first pre-determined wavelength range associated with a first color channel and converge at a second nodal point within the eye and the redirected second set of light rays are within a second pre-determined wavelength range associated with the first color channel. ### Claim 15 (depends on 1) The display system of claim 1, where the first set of light rays are a first wavelength and the second set of light rays are a second wavelength. ### Claim 16 A computer-implemented method, comprising: redirecting a first set of light rays towards an eye, wherein the first set of light rays are redirected by an optical combiner and produce a peripheral image; generating a second set of light rays by a light engine to intersect a first region of the optical combiner; redirecting the second set of light rays towards the eye, wherein the second set of light rays converge at a nodal point within 1 mm of a rotational center the eye and produce an inset foveal image positioned within at least a portion of the peripheral image; and offsetting an origin of the second set of light rays by the light engine to move the intersection of the second set of light rays with the optical combiner from the first region to a second region of the optical combiner in response to a change in a gaze direction of the eye. ### Claim 17 (depends on 16) The computer-implemented method of claim 16, wherein the offset comprises a lateral shift of the light engine. ### Claim 18 (depends on 16) The computer-implemented method of claim 16, wherein the redirected first set of light rays converge at a second nodal point within the eye. ### Claim 19 (depends on 16) The computer-implemented method of claim 16, wherein the redirected first set of light rays converge at the nodal point. ### Claim 20 A non-transitory, computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform steps comprising: redirecting a first set of light rays towards an eye, wherein the first set of light rays are redirected by an optical combiner and produce a peripheral image; generating a second set of light rays by a light engine to intersect a first region of the optical combiner; redirecting the second set of light rays towards the eye, wherein the second set of light rays converge at a nodal point within 1 mm of a rotational center of the eye and produce an inset foveal image positioned within at least a portion of the peripheral image; and offsetting an origin of the second set of light rays by the light engine to move the intersection of the second set of light rays with the optical combiner from the first region to a second region of the optical combiner in response to a change in a gaze direction of the eye.