# US 2016/0259168 A1 · Sparse projection for a virtual reality system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0259168 A1 - Document ID: US20160259168A1 - Status: Published application - Kind: A1 - Application number: 15/060,686 - Filed: 2016-03-04 - Published: 2016-09-08 - Earliest claimed: 2015-03-04 - Assignees: Oculus VR, LLC - Applicants: Oculus Vr, LLC - Inventors: Dov KATZ; Palmer Freeman LUCKEY; Samuel Redmond D'AMICO; Evan M. RICHARDS; Shizhe SHEN; Jennifer Leigh DOLSON - Web page: https://patentgrep.com/patent/US20160259168A1 ## CPC - G02B 27/0172: {characterised by optical features} - G02B 27/017: {Head mounted} - G03B 21/14: Details - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0174: {holographic} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A virtual reality (VR) includes a sparse projection system configured to generate a plurality of clusters using one or more diffractive optical elements. Each generated cluster has a unique configuration that corresponds to a unique location in a virtual mapping of a local area. The sparse projection system projects the generated clusters throughout the local area. A VR console receives a series of images of the local area from the imaging device, with at least one image includes at least one cluster. The VR console determines a location of a VR headset within the virtual mapping of the local area based at least in part on a configuration of the at least one cluster included in the series of images. Content is generated based at least in part on the determined location of the VR headset and is provided to the VR headset for presentation. ## Claims ### Claim 1 A system comprising: a sparse projection system configured to: generate a plurality of clusters using one or more diffractive optical elements, each cluster having a unique configuration that corresponds to a unique location in a virtual mapping of a local area, and project the generated clusters throughout the local area; and a virtual reality (VR) headset comprising: an imaging device configured capture a series of images of portions of the local area, at least one image including at least one cluster, and an electronic display configured to output video information based at least in part on the virtual mapping of the local area; and a VR console comprising: a processor; and a memory coupled to the processor and including instructions that, when executed by the processor, cause the processor to: receive the series of images from the imaging device; determine a location of the VR headset within the virtual mapping of the local area based at least in part on a configuration of the at least one cluster; generate content based at least in part on the determined location of the VR headset within the virtual mapping of the local area; and provide the content to the VR headset for presentation by the electronic display. ### Claim 2 (depends on 1) The system of claim 1, wherein a diffractive optical element of the one or more diffractive optical elements, is a computer generated hologram, and the sparse projection system is configured to generate a plurality of clusters by performing an inverse Fourier transform of light output from the diffractive optical element. ### Claim 3 (depends on 1) The system of claim 1, wherein the unique configuration for a given cluster is a combination of a spatial configuration that describes a number and arrangement of illuminated regions within the given cluster and a reflectance type that specifies a band of light used to generate the given cluster. ### Claim 4 (depends on 3) The system of claim 3, wherein the sparse projection system comprises: a source assembly configured to generate a beam of light and an additional beam of light; a projection assembly configured to: generate a set of clusters of the plurality of clusters using a diffractive optical element of the one or more diffractive optical elements and the beam of light, and project the generated set of clusters throughout a portion of the local area; and a second projection assembly configured to: generate an additional set of clusters of the plurality of clusters using an additional diffractive optical element of the one or more diffractive optical elements and the additional beam of light, and project the generated additional set of clusters throughout an additional portion of the local area. ### Claim 5 (depends on 4) The system of claim 4, wherein the beam of light and the additional beam of light have different wavelengths so a reflectance type associated with the set of clusters is different from a reflectance type associated with the additional set of clusters. ### Claim 6 (depends on 5) The system of claim 5, wherein the diffractive optical element and the additional diffractive optical elements are configured so spatial configurations for the first set of clusters are the same as spatial configurations for the additional set of clusters. ### Claim 7 (depends on 4) The system of claim 4, wherein the beam of light and the additional beam of light are configured a reflectance type associated with the set of clusters is the same as a reflectance type associated with the additional set of clusters. ### Claim 8 (depends on 7) The system of claim 7, wherein the diffractive optical element and the additional diffractive optical element are different, so spatial configurations for the set of clusters differ from and spatial configurations for the additional set of clusters. ### Claim 9 A system comprising: a sparse projection system comprising: a source assembly configured to generate one or more beams of light, and a projection assembly configured to: generate a plurality of clusters using a diffractive optical element and a beam of the one or more beams of light, each cluster having a unique configuration that corresponds to a unique location in a virtual mapping of a local area, and project the generated clusters throughout the local area; and a virtual reality (VR) headset comprising an imaging device configured capture a series of images of portions of the local area, at least one image including at least one cluster, and an electronic display configured to output content based at least in part on the virtual mapping of the local area; and a VR console comprising: a processor; and a memory coupled to the processor and including instructions that, when executed by the processor, cause the processor to: receive the series of images from the imaging device; determine a location of the VR headset within the virtual mapping of the local area based at least in part on a configuration of the at least one cluster; generate content based at least in part on the determined location of the VR headset within the virtual mapping of the local area; and provide the content to the VR headset for presentation by the electronic display. ### Claim 10 (depends on 9) The system of claim 9, wherein the diffractive optical element is a computer generated hologram, and the sparse projection system is configured to generate the plurality of clusters by performing an inverse Fourier transform of light output from the diffractive optical element. ### Claim 11 (depends on 9) The system of claim 9, wherein the unique configuration for a given cluster is a combination of a spatial configuration that describes a number and arrangement of illuminated regions within the given cluster and a reflectance type that specifies a band of light used to generate the given cluster. ### Claim 12 (depends on 11) The system of claim 11, wherein the sparse projection system further comprises: an additional projection assembly configured to: generate an additional plurality of clusters using an additional diffractive optical element and an additional beam of light of the one or more beams of light, and project the generated additional plurality of clusters throughout the local area. ### Claim 13 (depends on 12) The system of claim 12, wherein the beam of light and the additional beam of light are different wavelengths such that a reflectance type associated with the plurality of clusters is different from a reflectance type associated with the additional plurality of clusters. ### Claim 14 (depends on 13) The system of claim 13, wherein the diffractive optical element and the additional diffractive optical element are the same, so spatial configurations for the plurality of clusters and spatial configurations for the additional plurality of clusters are the same. ### Claim 15 (depends on 12) The system of claim 12, wherein the beam of light and the additional beam of light are the same such that a reflectance type associated with the set of clusters is the same as a reflectance type associated with the additional set of clusters. ### Claim 16 (depends on 15) The system of claim 15, wherein the diffractive optical element and the additional diffractive optical element are different, so spatial configurations for the plurality of clusters and spatial configurations for the additional plurality of clusters are different. ### Claim 17 A system comprising: a sparse projection system comprising: a source assembly configured to generate one or more beams of light, and a projection assembly configured to: generate a plurality of clusters using a diffractive optical element and a beam of the one or more beams of light, each cluster having a unique configuration that corresponds to a unique location in a virtual mapping of a local area, and project the generated clusters throughout the local area; and a VR console comprising: a processor; and a memory coupled to the processor and including instructions that, when executed by the processor, cause the processor to: receive the series of images from an imaging device, at least one image including at least one cluster; determine a location of a VR headset within the virtual mapping of the local area based at least in part on a configuration of the at least one cluster; generate content based at least in part on the determined location of the VR headset within the virtual mapping of the local area; and provide the content to the VR headset for presentation by the electronic display. ### Claim 18 (depends on 17) The system of claim 17, wherein a diffractive optical element of the one or more diffractive optical elements is a computer generated hologram, and the sparse projection system is configured to generate the plurality of clusters by taking an inverse Fourier transform of light output from the diffractive optical element. ### Claim 19 (depends on 17) The system of claim 17, wherein the sparse projection system further comprises: a source assembly configured to generate the beam of light and an additional beam of light; a projection assembly configured to: generate a set of clusters of the plurality of clusters using a diffractive optical element of the one or more diffractive optical elements and the beam of light, and project the generated set of clusters throughout a portion of the local area; and an additional projection assembly configured to: generate an additional set of clusters of the plurality of clusters using an additional diffractive optical element of the one or more diffractive optical elements and the additional beam of light, and project the generated additional set of clusters throughout an additional portion of the local area. ### Claim 20 (depends on 17) The system of claim 17, wherein the unique configuration for a given cluster is a combination of a spatial configuration that describes a number and arrangement of illuminated regions within the given cluster and a reflectance type that specifies a band of light used to generate the given cluster.