Computer-implemented system and method for providing vr/ar visual experiences to users by pupil-directed retinal projection in near-eye displays

A computer-implemented method for providing optimized visual experiences to one or more users by projecting one or more virtual images onto one or more eyes in near-eye displays, the computer-implemented method comprising:

• generating, by one or more light sources, one or more light signals, wherein the one or more light signals are transmitted to one or more directed physical pixels using one or more light transmission techniques, and wherein the one or more transmission techniques comprise at least one of:
• radiation indicating free-space optical propagation and optical fibers and waveguides;
• adjusting, by a light intensity modulator, an intensity of the one or more light signals by changing a voltage;
• directing, by a beam steerer and guidance module comprising at least one of:
• a micro-electro-mechanical mirror array, an optical phased array, and a spatial light modulator, the one or more light signals at one or more angles towards the one or more eyes of the one or more users for projecting a number of virtual pixels of the one or more virtual images onto a pupil of the one or more eyes of the one or more users;
• and
• directing, by the beam steerer and guidance module, the one or more light signals from two or more directed physical pixels at the one or more angles onto one or more sub-areas of a pupil for projecting a single virtual pixel on a retina, which causes changing a focal effort in lens muscles to simulate natural accommodation cues and mitigate vergence-accommodation conflict in virtual reality (VR) and augmented reality (AR) environments;
• and
• configuring the one or more directed physical pixels on one or more glasses, wherein each directed physical pixel of the one or more directed physical pixels is configured to scan a pre-defined area of the one or more virtual images covering a number of virtual pixels at a pre-determined rate per second,
• wherein each directed physical pixel is configured to project the number of virtual pixels by utilizing real-time tracking of a position and size of the pupil and dynamically modulating an emission angle of the one or more light signals, for optimized alignment with the retina,
• wherein the one or more directed physical pixels with the real-time tracking of the pupil, are configured to provide automatic adjustments to virtual contents, ensuring accurate alignment of images with a field of view of the one or more users while identifying a vergence-accommodation conflict,
• wherein the one or more glasses with the one or more directed physical pixels, are configured to act as one or more prescription glasses for at least one of:
• providing one or more views of AR and VR images, and correcting at least one of:
• farsightedness, nearsightedness, astigmatism, strabismus, and one or more refractive errors, and
• wherein the one or more directed physical pixels are configured to be synchronized with the pre-defined area of the one or more virtual images using one or more processors to project the one or more virtual images onto the one or more eyes in near-eye displays by covering one or more areas corresponding to a position and size of, the pupil of the one or more eyes of the one or more users.

A non-transitory computer-readable storage medium having instructions stored therein that when executed by one or more hardware processors, cause the one or more hardware processors to execute operations of:

• generating, by one or more light sources, one or more light signals, wherein the one or more light signals are transmitted to one or more directed physical pixels using one or more light transmission techniques, and wherein the one or more transmission techniques comprise at least one of:
• radiation indicating free-space optical propagation and optical fibers and waveguides;
• adjusting, by a light intensity modulator, an intensity of the one or more light signals by changing a voltage;
• directing, by a beam steerer and guidance module comprising at least one of:
• a micro-electro-mechanical mirror array, an optical phased array, and a spatial light modulator, the one or more light signals at one or more angles towards the one or more eyes of the one or more users for projecting a number of virtual pixels of the one or more virtual images onto a pupil of the one or more eyes of the one or more users;
• and
• directing, by the beam steerer and guidance module, the one or more light signals from two or more directed physical pixels at the one or more angles onto one or more sub-areas of a pupil for projecting a single virtual pixel on a retina, which causes changing a focal effort in lens muscles to simulate natural accommodation cues and mitigate vergence-accommodation conflict in virtual reality (VR) and augmented reality (AR) environments;
• and
• configuring the one or more directed physical pixels on one or more glasses, wherein each directed physical pixel of the one or more directed physical pixels is configured to scan a pre-defined area of the one or more virtual images covering a number of virtual pixels at a pre-determined rate per second,
• wherein each directed physical pixel is configured to project the number of virtual pixels by utilizing real-time tracking of a position and size of the pupil and dynamically modulating an emission angle of the one or more light signals, for optimized alignment with the retina,
• wherein the one or more directed physical pixels with the real-time tracking of the pupil, are configured to provide automatic adjustments to virtual contents, ensuring accurate alignment of images with a field of view of the one or more users while identifying a vergence-accommodation conflict,
• wherein the one or more glasses with the one or more directed physical pixels, are configured to act as one or more prescription glasses for at least one of:
• providing one or more views of AR and VR images, and correcting at least one of:
• farsightedness, nearsightedness, astigmatism, strabismus, and one or more refractive errors, and
• wherein the one or more directed physical pixels are configured to be synchronized with the pre-defined area of the one or more virtual images using one or more processors to project the one or more virtual images onto the one or more eyes in near-eye displays by covering one or more areas corresponding to a position and size of, the pupil of the one or more eyes of the one or more users.