Vision correction display device, eye-tracking system and method to compensate for visual impairments
AssigneeRabbit Eyes B.V.
InventorsLennard GOEDKNEGT, Richard MENDES, Alexander M. J. SPAANS
Life of this patent
Estimating the term…
Abstract
The invention relates to a display device for displaying an image for a user having a visual impairment. The display device comprises a pixelated display, a processor, an eye-tracking system and a microlens array. The invention is also related to a method for displaying an image for a user having a visual impairment on a display device. The invention is further related to a user having a visual impairment and a computer program for performing the method of the invention.
Claims25
Display device (1) adapted for displaying an image (2) for a user having a visual impairment, the display device (1) comprising:
- a pixelated display (3) comprising an array of pixels (4), each pixel comprising a number of subpixels, and wherein the pixelated display (3) is operable to display the image (2) to an eye (5) of the user located at a viewing location relative to a position of the pixelated display (3);
- a processor (6) for operating the pixels (4) of the pixelated display (3) to display the image (2) on the pixelated display (3) wherein the processor (6) is operable to store information on the eye (5) of the user focal length of the eye;
- an eye-tracking system (7) adapted for determining changes in the viewing location of the eye (5) of the user relative to the position of the pixelated display (3), wherein, preferably, the processor is configured for determining the change in viewing location of the eye of the user based on the change in viewing location detected by the eye-tracking system;
- and
- a microlens array (8) provided on the pixelated display (3), wherein the microlens array (8) comprises microlenses (9) that are arranged in a two-dimensional plane oriented parallel to the pixelated display (3), wherein the microlens array (8) covers, preferably completely covers, the pixelated display (3), and wherein the microlens array (8) is configured to project light emitted by the pixelated display (3) towards the eye (5) of the user in the viewing location,
- characterized in that
- the processor (6) is configured for determining a first location of a virtual image plane (10), corresponding to a first viewing location of the eye (5) of the user, by comparing the focal length of the eye of the user to the first viewing location, wherein a virtual image (11) is located on the virtual image plane (10) which virtual image (11) corresponds to an image (2) to be displayed on the pixelated display (3), wherein the virtual image (11) determines values of virtual pixels (12) of the virtual image plane (10),
- wherein the processor (6) is configured for relating a subpixel (13) of the pixelated display (3) to a corresponding first virtual pixel (14) of the virtual image plane (10) by determining between the corresponding subpixel (13), the microlens array (8), the retina of the eye (5) of the user, and the first virtual pixel (14) a light path (15) of a light ray emitted by the corresponding subpixel (13),
- wherein the processor (6) is further configured for determining a first value of the corresponding subpixel (13) of the pixelated display (3) by comparing the value of the corresponding subpixel (13) to the value of the first virtual pixel (14),
- wherein the processor (6) is configured to operate the corresponding subpixel (13) of the display (3) based on the respective first value when the eye (5) of the user is in the first viewing location,
- wherein the processor (6) is configured for determining a second location of the virtual image plane (10), corresponding to a second viewing location of the eye (5) of the user, when the eye tracking system (7) determines a change in the viewing location of the eye (5) of the user from the first viewing location to the second viewing location,
- wherein the processor (6) is further configured to relate the corresponding subpixel (13) of the pixelated display (3) to a second virtual pixel (16) of the virtual image plane (10) when the virtual image plane (10) is in the second location,
- wherein the processor (6) is further configured for determining a second value of the corresponding subpixel (13) of the pixelated display (3) by comparing the value of the corresponding subpixel (13) to a value of the second virtual pixel (16);
- and
- wherein the processor (6) is configured to operate the corresponding subpixel (13) of the display (3) based on the second value when the eye (5) of the user is in the second viewing location.
Display device (1) according to one or more of the preceding claims, wherein the display device (1) is adapted to provide a feedback, e.g. a haptic feedback, to the user, e.g. prompting the user to change the position of the pixelated display (3).
Display device (1) according to one or more of the preceding claims, wherein the eye-tracking system (7) is further adapted for tracking a gaze of the eye (5) of the user for determining at which part of the pixelated display (3) the user is gazing.
Display device (1) according to one or more of the preceding claims, wherein a microlens width and/or a microlens height is equal or smaller than a pitch of 8 subpixels (13) of the pixelated display (3).
Display device (1) according to one or more of the preceding claims, wherein the display device (1) is further provided with an optical gap layer (17), which is provided between the pixelated display (3) and the microlens array (8), wherein the optical gap layer (17) defines an optical gap (18) between the pixelated display (3) and the microlens array (8).
Display device (1) according to one or more of the preceding claims, wherein the microlenses (9) are rectangular microlenses (9).
Display device (1) according to one or more of the preceding claims, wherein the microlenses (9) are square microlenses (9).
Display device (1) according to one or more of the preceding claims, wherein the display device (1) further comprises a protection layer (19) which is placed on top of the microlens array (8).
Display device (1) according to one or more of the preceding claims, wherein the pixelated display (3) is provided in a smart phone case.
Method for displaying an image (2) for a user having a visual impairment wherein use is made of a display device (1) according to one or more of the preceding claims, wherein the display device (1) comprises:
- a pixelated display (3) comprising an array of pixels (4), each pixel comprising a number of subpixels, and wherein the pixelated display (3) is operable to display the image (2) to an eye (5) of the user located at a viewing location relative to a position of the pixelated display (3);
- a processor (6) for operating the pixels (4) of the pixelated display (3) to display the image (2) on the pixelated display (3) wherein the processor (6) is operable to store information on the eye (5) of the user focal length of the eye;
- an eye-tracking system (7) adapted for determining changes in the viewing location of the eye (5) of the user relative to the position of the pixelated display (3), wherein, preferably, the processor is configured for determining the change in viewing location of the eye of the user based on the change in viewing location detected by the eye-tracking system;
- and
- a microlens array (8) provided on the pixelated display (3), wherein the microlens array (8) comprises microlenses (9) that are arranged in a two-dimensional plane oriented parallel to the pixelated display (3), wherein the microlens array (8) covers, preferably completely covers, the pixelated display (3), and wherein the microlens array (8) is configured to project light emitted by the pixelated display (3) towards the eye (5) of the user in the viewing location,
- wherein the processor (6) is configured for determining a first location of a virtual image plane (10), corresponding to a first viewing location of the eye (5) of the user, by comparing the focal length of the eye of the user to the first viewing location, wherein a virtual image (11) is located on the virtual image plane (10) which virtual image (11) corresponds to an image (2) to be displayed on the pixelated display (3), wherein the virtual image (11) determines values of virtual pixels (12) of the virtual image plane (10),
- wherein the processor (6) is configured for relating a subpixel (13) of the pixelated display (3) to a corresponding first virtual pixel (14) of the virtual image plane (10) by determining between the corresponding subpixel (13), the microlens array (8), the retina of the eye (5) of the user, and the first virtual pixel (14) a light path (15) of a light ray emitted by the corresponding subpixel (13),
- wherein the processor (6) is further configured for determining a first value of the corresponding subpixel (13) of the pixelated display (3) by comparing the value of the corresponding subpixel (13) to the value of the first virtual pixel (14),
- wherein the processor (6) is configured to operate the corresponding subpixel (13) of the display (3) based on the respective first value when the eye (5) of the user is in the first viewing location,
- wherein the processor (6) is configured for determining a second location of the virtual image plane (10), corresponding to a second viewing location of the eye (5) of the user, when the eye tracking system (7) determines a change in the viewing location of the eye (5) of the user from the first viewing location to the second viewing location,
- wherein the processor (6) is further configured to relate the corresponding subpixel (13) of the pixelated display (3) to a second virtual pixel (16) of the virtual image plane (10) when the virtual image plane (10) is in the second location,
- wherein the processor (6) is further configured for determining a second value of the corresponding subpixel (13) of the pixelated display (3) by comparing the value of the corresponding subpixel (13) to a value of the second virtual pixel (16);
- and
- wherein the processor (6) is configured to operate the corresponding subpixel (13) of the display (3) based on the second value when the eye (5) of the user is in the second viewing location.
Dependencies are inferred from the claim text.