# US 8,570,372 B2 · Three-dimensional imager and projection device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,570,372 B2 - Document ID: US8570372B2 - Status: Granted - Kind: B2 - Application number: 13/458,956 - Filed: 2012-04-27 - Published: 2012-11-01 - Granted: 2013-10-29 - Earliest claimed: 2011-04-29 - Applicants: Austin Russell - Inventors: Austin Russell - Web page: https://patentgrep.com/patent/US8570372B2 ## CPC - G09G 3/025: {with scanning or deflecting the beams in two directions or dimensions} - G02B 27/017: {Head mounted} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor - H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects - H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02C 11/10: {Electronic devices other than hearing aids} - G03B 21/26: Projecting separately subsidiary matter simultaneously with main image - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00) - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) ## Abstract The systems and methods described herein include a device that can scan the surrounding environment and construct a 3D image, map, or representation of the surrounding environment using, for example, invisible light projected into the environment. In some implementations, the device can also project into the surrounding environment one or more visible radiation pattern patterns (e.g., a virtual object, text, graphics, images, symbols, color patterns, etc.) that are based at least in part on the 3D map of the surrounding environment. ## Claims ### Claim 1 A device comprising: one or more cameras, the one or more cameras being configured to detect visible light and invisible light from one or more fields of view, and to create one or more visible light images and one or more invisible light images of the one or more fields of view; one or more projectors, the one or more projectors being configured to project at least invisible light into at least one of the one or more fields of view; and one or more processors, the one or more processors being configured to control the one or more projectors to project one or more invisible light patterns into at least one of the one or more fields of view; analyze the one or more invisible light images detected by the one or more cameras in order to generate depth data indicative of the depth of at least one item in at least one of the one or more fields of view; combine the one or more visible light images and the depth data to create three-dimensional data of at least one of the one or more fields of view; identify an object in the one or more fields of view, wherein the object comprises an electronic device; identify the location of the object using the three-dimensional data; and control the one or more projectors to project light into a subset of volumetric space in at least one of the one or more fields of view in order to power the electronic device by wirelessly transferring energy to the electronic device via a beam of light based upon the identified location. ### Claim 2 (depends on 1) The device of claim 1, wherein the one or more cameras and the one or more projectors substantially share an overlapping field of view. ### Claim 3 (depends on 2) The device of claim 2, wherein the one or more projectors are configured to project coherent light. ### Claim 4 (depends on 3) The device of claim 3, wherein the one or more projectors are configured to project a substantially collimated beam of invisible light into the overlapping field of view, and to scan the beam of invisible light across the overlapping field of view to create the invisible light pattern. ### Claim 5 (depends on 4) The device of claim 4, wherein the invisible light comprises infrared light. ### Claim 6 (depends on 1) The device of claim 1, wherein the invisible light comprises terahertz, RF, or microwave light. ### Claim 7 (depends on 1) The device of claim 1, wherein the three-dimensional data comprises a texture mapping of the one or more visible light images onto the depth data. ### Claim 8 (depends on 1) The device of claim 1, wherein the one or more processors are further configured to transmit on/off commands to the electronic device via the beam of light. ### Claim 9 (depends on 1) The device of claim 1, wherein the one or more processors are further configured to transmit data to the electronic device via the beam of light. ### Claim 10 (depends on 1) The device of claim 1, wherein the one or more processors are configured to identify the electronic device or its location by executing object recognition software on the three-dimensional data. ### Claim 11 (depends on 1) The device of claim 1, wherein the one or more processors are configured to identify the electronic device or its location using wireless communication feedback from the electronic device. ### Claim 12 (depends on 1) The device of claim 1, wherein the one or more processors are configured to generate the depth data, at least in part, by comparing the one or more projected invisible light patterns to the one or more detected invisible light images. ### Claim 13 (depends on 1) The device of claim 1, wherein the same one or more projectors are configured to project the invisible light patterns and the beam of light used to wirelessly transfer energy to the electronic device. ### Claim 14 A method comprising: detecting visible light and invisible light from one or more fields of view, and creating one or more visible light images and one or more invisible light images of the one or more fields of view using one or more cameras; projecting at least invisible light into at least one of the one or more fields of view using one or more projectors; and performing processing with one or more processors to control the one or more projectors to project one or more invisible light patterns into at least one of the one or more fields of view; analyze the one or more invisible light images detected by the one or more cameras in order to generate depth data indicative of the depth of at least one item in at least one of the one or more fields of view; combine the one or more visible light images and the depth data to create three-dimensional data of at least one of the one or more fields of view; identify an object in the one or more fields of view, wherein the object comprises an electronic device; identify the location of the object using the three-dimensional data, and control the one or more projectors to project light into a subset of volumetric space in at least one of the one or more fields of view in order to power the electronic device by wirelessly transferring energy to the electronic device via a beam of light based upon the identified location. ### Claim 15 (depends on 14) The method of claim 14, wherein the one or more cameras and the one or more projectors substantially share an overlapping field of view. ### Claim 16 (depends on 15) The method of claim 15, wherein the one or more projectors are configured to project coherent light. ### Claim 17 (depends on 16) The method of claim 16, wherein the one or more projectors are configured to project a substantially collimated beam of invisible light into the overlapping field of view, and to scan the beam of invisible light across the overlapping field of view to create the invisible light pattern. ### Claim 18 (depends on 17) The method of claim 17, wherein the invisible light comprises infrared light. ### Claim 19 (depends on 14) The method of claim 14, wherein the invisible light comprises terahertz, RF, or microwave light. ### Claim 20 (depends on 14) The method of claim 14, wherein the three-dimensional data comprises a texture mapping of the one or more visible light images onto the depth data. ### Claim 21 (depends on 14) The method of claim 14, wherein the one or more processors are further configured to transmit on/off commands to the electronic device via the beam of light. ### Claim 22 (depends on 14) The method of claim 14, wherein the one or more processors are further configured to transmit data to the electronic device via the beam of light. ### Claim 23 (depends on 14) The method of claim 14, wherein the one or more processors are configured to identify the electronic device or its location by executing object recognition software on the three-dimensional data. ### Claim 24 (depends on 14) The method of claim 14, wherein the one or more processors are configured to identify the electronic device or its location using wireless communication feedback from the electronic device. ### Claim 25 (depends on 14) The method of claim 14, wherein the one or more processors are configured to generate the depth data, at least in part, by comparing the one or more projected invisible light patterns to the one or more detected invisible light images. ### Claim 26 (depends on 14) The method of claim 14, wherein the same one or more projectors are configured to project the invisible light patterns and the beam of light used to wirelessly transfer energy to the electronic device.