# US 12,001,021 B2 · Virtual and augmented reality systems and methods having unequal numbers of component color images distributed across depth planes > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,001,021 B2 - Document ID: US12001021B2 - Status: Granted - Kind: B2 - Application number: 17/942,634 - Filed: 2022-09-12 - Published: 2023-01-05 - Granted: 2024-06-04 - Earliest claimed: 2016-01-07 - Assignees: Magic Leap, Inc. - Applicants: Magic Leap, Inc. - Inventors: Brian T. Schowengerdt; Hong Hua; Hui-Chuan Cheng; Christophe Peroz - Web page: https://patentgrep.com/patent/US12001021B2 ## CPC - G02B 27/0172: {characterised by optical features} - G02B 5/18: Diffraction gratings {(holographic optical elements G02B5/32, G03H; integrally combined with optical fibres G02B6/02057; for coupling light guides G02B6/34; integrally combined with optical integrated light guides G02B6/12; grating systems G02B27/44)} - G02B 6/0035: {provided on the surface of the light guide or in the bulk of it} - G02B 6/0076: {Stacked arrangements of multiple light guides of the same or different cross-sectional area} - G02B 26/103: {having movable or deformable optical fibres, light guides or waveguides as scanning elements (light guides per se G02B6/00)} - G06T 5/70: Denoising; Smoothing - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06V 40/19: Sensors therefor - G06V 40/193: {Preprocessing; Feature extraction} - G02B 2027/0112: {comprising device for genereting colour display} - G02B 2027/0125: {Field-of-view increase by wavefront division} - G02B 2027/0127: {comprising devices increasing the depth of field} - G02B 2027/0132: {comprising binocular systems} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0185: {Displaying image at variable distance} - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract In a display system configured to display images at multiple depth planes, images perceived to be substantially full color or multi-colored may be formed using component color images that are distributed in unequal numbers across a plurality of depth planes. The distribution of component color images across the depth planes may vary based on color. In some embodiments, a display system includes a stack of waveguides that each output light of a particular color, with some colors having fewer numbers of associated waveguides than other colors. The stack of waveguides may include multiple pluralities of different numbers of waveguides, each plurality configured to produce an image by outputting light corresponding to a particular color. A display controller can introduce blur and/or change pixel size for images to be presented for at least one depth plane, based on the contents of images. ## Claims ### Claim 1 A display system comprising: a display configured to output a plurality of component color images, the component color images corresponding to a plurality of depth planes, and a controller configured to introduce, based on the contents of an image to be displayed for at least one of the depth planes, one or more of the following to the component color images: blur; and a change in pixel size. ### Claim 2 (depends on 1) The display system of claim 1, wherein the controller is configured to vary an amount of blur introduced into the component color image based upon a component color of the component color image. ### Claim 3 (depends on 2) The display system of claim 2, wherein the controller is configured to provide relatively large amounts of blur or relatively large pixel sizes to component color images for component colors having relatively large depths of field. ### Claim 4 (depends on 2) The display system of claim 2, wherein the component color images comprise red images, green images, and blue images, and wherein the controller is configured to provide the highest amount of blur to the blue images. ### Claim 5 (depends on 4) The display system of claim 4, wherein the controller is configured to provide no blur to the green images. ### Claim 6 (depends on 1) The display system of claim 1, wherein the controller is configured to change pixel size by providing different component color images with different pixel resolutions. ### Claim 7 (depends on 1) The display system of claim 1, wherein the display is a scanning fiber display comprising a plurality of optical fibers configured to output light of different component colors to form associated component color images. ### Claim 8 (depends on 7) The display system of claim 7, wherein different optical fibers of the scanning fiber display are configured to output light of different associated component colors, wherein the different optical fibers for different component colors have different sizes for outputting light with different effective spot sizes corresponding to different pixel sizes. ### Claim 9 (depends on 8) The display system of claim 8, wherein a smallest of the effective spot sizes corresponds to an optical fiber for outputting green light. ### Claim 10 (depends on 1) The display system of claim 1, wherein the display is configured to selectively output light for forming the plurality of component color images with different amounts of wavefront divergence corresponding to different depth planes. ### Claim 11 (depends on 1) The display system of claim 1, wherein the display is a head-mounted display. ### Claim 12 (depends on 11) The display system of claim 11, wherein the display comprises a waveguide configured to incouple image information and to outcouple the image information to an eye of a viewer. ### Claim 13 (depends on 12) The display system of claim 12, wherein the waveguide is one of a plurality of waveguides forming a stack of waveguides, wherein the stack of waveguides comprises: a first plurality of waveguides each configured to output light of a dedicated first color to form component color images of the first color; a second plurality of waveguides each configured to output light of a dedicated second color to form component color images of the second color, wherein the second color is different from the first color; and a third plurality of waveguides each configured to output light of a dedicated third color to form component color images of the third color, wherein the third color is different from the first and second colors. ### Claim 14 (depends on 13) The display system of claim 13, wherein at least some waveguides of the stack of waveguides comprise light extracting optical elements configured to output light with different amounts of wavefront divergence than other waveguides of the stack of waveguides, wherein the different amounts of wavefront divergence correspond to different depth planes. ### Claim 15 (depends on 14) The system of claim 14, wherein the light extracting optical elements comprise diffraction gratings.