Virtual reality and augmented reality display system for near-eye display devices

A computer-implemented method, comprising, at a processor of a portable controller device:

• responsive to receiving user launch requests, launching first and second applications;
• receiving first image data from the first application and second image data from the second application, wherein the first image data is pre-rendered into a first texture, and the second image data is not pre-rendered;
• responsive to determining that the first image data is pre-rendered, forgoing converting the first image data into the first texture;
• responsive to determining the second image data is not pre-rendered, converting the second image data into a second texture;
• generating a superframe comprising the first and second textures and metadata comprising a first position and first dimension for the first texture and a second position and second dimension for the second texture;
• providing the superframe to a near-eye display device configured to (i) receive the superframe and (ii) display the first and second textures in accordance with the metadata.

A non-transitory computer-readable storage medium having an executable stored thereon, which, when executed by a processor of a portable controller device, causes the processor to:

• responsive to receiving user launch requests, launch first and second applications;
• receive first image data from the first application and second image data from the second application, wherein the first image data is pre-rendered into a first texture, and the second image data is not pre-rendered;
• responsive to determining that the first image data is pre-rendered, forgoing converting the first image data into the first textures;
• responsive to determining the second image data is not pre-rendered, converting the second image data into a second texture;
• generate a superframe comprising the first and second textures and metadata comprising a first position and first dimension for the first textures and a second position and second dimension for the second texture;
• provide the superframe to a near-eye display device configured to (i) receive the superframe and (ii) display the first and second textures in accordance with the metadata.