Systems and Methods for Head-Mounted Display Adapted to Human Visual Mechanism
AssigneeLinear Algebra Technologies Limited
InventorsBrendan BARRY, David MOLONEY
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for rendering of a dual eye-specific display. The system tracks the user's eye movements and/or positions, in some implementations, based on electroencephalography (EEG) of the user, to correctly label the central (foveal) and peripheral (extra-foveal) areas of the display. Foveal data is fully rendered while extra-foveal data is reduced in resolution and, in some implementations, shared between the two displays.
Claims20
A head-mounted display device with eye-tracking of a user's two eyes, comprising:
- a first display for the left eye;
- a second display for the right eye;
- a memory, coupled to the first display and the second display, comprising a first frame buffer for the first display and a second frame buffer for the second display, wherein the first frame buffer comprises a first foveal frame buffer and a first extra-foveal frame buffer and the second frame buffer comprises a second foveal frame buffer and a second extra-foveal frame buffer;
- and
- one or more processors, coupled to the memory, configured to:
- receive eye-tracking information of the user wearing the head mounted display, wherein the eye-tracking information comprises at least one of an eye movement and an eye position of the user,
- determine, based on the eye-tracking information, a first foveal region of the first display, a first extra-foveal region of the first display, a second foveal region of the second display, and a second extra-foveal region of the second display, and
- load, into the memory, first foveal region pixels of the first foveal region, first extra-foveal region pixels of the first extra-foveal region, second foveal region pixels of the second foveal region, second extra-foveal region pixels of the second extra-foveal region,
- wherein:
- the first foveal region pixels are represented with full resolution and loaded into the first foveal frame buffer,
- the first extra-foveal region pixels are represented with reduced resolution and loaded into the first extra-foveal frame buffer,
- the second foveal region pixels are represented with full resolution and loaded into the second foveal frame buffer, and
- the second extra-foveal region pixels are represented with reduced resolution and loaded into the second extra-foveal frame buffer.
A method for a head-mounted display device with eye-tracking of a user's two eyes, comprising:
- receiving eye-tracking information of the user wearing the head mounted display, wherein the eye-tracking information comprises at least one of an eye movement and an eye position of the user;
- determining, based on the eye-tracking information, a first foveal region of a first display for the left eye, a first extra-foveal region of the first display, a second foveal region of a second display for the right eye, and a second extra-foveal region of the second display;
- loading, into a first foveal frame buffer of a first frame buffer for the first display, first foveal region pixels that are represented with full resolution of the first foveal region;
- loading, into a first extra-foveal frame buffer of the first frame buffer for the first display, first extra-foveal region pixels that are represented with reduced resolution of the first extra-foveal region;
- loading, into a second foveal frame buffer of a second frame buffer for the second display, second foveal region pixels that are represented with full resolution of the second foveal region;
- and
- loading, into a second extra-foveal frame buffer of the second frame buffer for the second display, second extra-foveal region pixels that are represented with reduced resolution of the second extra-foveal region.
A non-transitory computer readable medium storing a computer-readable program for a head mounted display device with eye-tracking of a user's two eyes, comprising
- computer-readable instructions to receive eye-tracking information of the user wearing the head mounted display, wherein the eye-tracking information comprises at least one of an eye movement and an eye position of the user;
- computer-readable instructions to determine, based on the eye-tracking information, a first foveal region of a first display for the left eye, a first extra-foveal region of the first display, a second foveal region of a second display for the right eye, and a second extra-foveal region of the second display;
- and
- computer-readable instructions to load, into a first foveal frame buffer of a first frame buffer for the first display, first foveal region pixels that are represented with full resolution of the first foveal region;
- computer-readable instructions to load, into a first extra-foveal frame buffer of the first frame buffer for the first display, first extra-foveal region pixels that are represented with reduced resolution of the first extra-foveal region;
- computer-readable instructions to load, into a second foveal frame buffer of a second frame buffer for the second display, second foveal region pixels that are represented with full resolution of the second foveal region;
- and
- computer-readable instructions to load, into a second extra-foveal frame buffer of the second frame buffer for the second display, second extra-foveal region pixels that are represented with reduced resolution of the second extra-foveal region.
Dependencies are inferred from the claim text.