# US 12,118,675 B1 · Augmented reality system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,675 B1 - Document ID: US12118675B1 - Status: Granted - Kind: B1 - Application number: 17/240,447 - Filed: 2021-04-26 - Granted: 2024-10-15 - Earliest claimed: 2020-04-27 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Michael D. Simmonds; James H. Foster; James E. Pedder; Richard J. Topliss; Thomas M. Gregory - Web page: https://patentgrep.com/patent/US12118675B1 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G03B 21/2033: {LED or laser light sources} - H04N 9/3144: {Cooling systems (cooling of liquid crystal cells in general G02F1/133382; cooling of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/16)} - H04N 9/3147: {Multi-projection systems (video walls G06F3/1446)} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A light system that may project virtual content onto surfaces of a room. The system may include one or more low-resolution light-emitting diode (LED) projectors for emitting light representing low-resolution virtual content, and a high-resolution LED projector for emitting light representing high-resolution virtual content. The high-resolution projector may be used to project a 2D image of augmented or virtual reality content being viewed by a person in a room using a device such as a headset or glasses onto a surface of the room so that other persons in the room can view a representation of what the person using the device is seeing. The low-resolution projector(s) may project low-resolution images onto other surfaces in the room, for example the walls and ceiling. The system may also be configured to emit diffuse light to illuminate a room when not emitting light representing virtual content. ## Claims ### Claim 1 A light system, comprising: a controller comprising one or more processors; a first projector comprising: an array of individually addressable light-emitting diodes (LEDs) configured to emit light representing virtual content under direction of the controller; and a focusing lens configured to focus the light emitted by the array of LEDs on a surface in a room to form an image, wherein individual LEDs in the array corresponds to individual pixels in the image; and two or more additional projectors arranged around the first projector, each additional projector comprising: an additional array of individually addressable LEDs configured to emit light representing additional virtual content under direction of the controller; and an additional focusing lens configured to focus the light emitted by the respective additional array of LEDs on at least a portion of a surface in the room to form a respective image, wherein individual LEDs in the respective additional array corresponds to individual pixels in the respective image, and wherein resolution of the respective image formed by the additional projectors is lower than resolution of the image formed by the first projector; and a diffuser mechanism configured to control a presence of inter-pixel gaps in light emitted by the light system and switch the light system among at least two modes, including (a) a display mode wherein the light system emits light representing image content and (b) an illumination mode wherein the light system emits light to illuminate the room when not emitting light that represents the image content, wherein the inter-pixel gaps are not present in the light emitted under the illumination mode. ### Claim 2 (depends on 1) The light system as recited in claim 1, wherein the diffuser mechanism includes a diffuser located between the array of LEDs of the first projector and the focusing lens of the first projector. ### Claim 3 (depends on 1) The light system as recited in claim 1, wherein the controller is configured to enable and disable the diffuser mechanism. ### Claim 4 (depends on 1) The light system as recited in claim 1, wherein the controller, the first projector, and two or more additional projectors are contained within a transparent or semi-transparent enclosure, and wherein the diffuser mechanism is further configured to project image content onto the surface of the enclosure. ### Claim 5 (depends on 1) The light system as recited in claim 1, wherein the images formed on the surfaces of the room by the two or more additional projectors are grayscale images. ### Claim 6 (depends on 1) The light system as recited in claim 1, wherein at least one of the two or more additional projectors further comprises an integrated optical detection system configured to detect objects and surfaces within the room. ### Claim 7 (depends on 6) The light system as recited in claim 6, wherein the optical detection system is further configured to determine depth of the objects or surfaces within the room. ### Claim 8 (depends on 1) The light system as recited in claim 1, wherein the controller, the first projector, and the two or more additional projectors are contained within a transparent or semi-transparent enclosure. ### Claim 9 (depends on 1) The light system as recited in claim 1, wherein the light system further includes a passive heat dissipation mechanism. ### Claim 10 (depends on 9) The light system as recited in claim 9, wherein the passive heat dissipation mechanism includes heat sinks on each of the two or more additional projectors and air vents in the enclosure to allow passive thermal air flow through the light system. ### Claim 11 (depends on 1) The light system as recited in claim 1, further comprising a wireless communication component that enables wireless communication between the controller of the light system and other devices, wherein the virtual content is rendered from a video stream received from another device via the wireless communication. ### Claim 12 (depends on 11) The light system as recited in claim 11, wherein the other device is an augmented reality (AR) or virtual reality (VR) device being used by a person in the room to view virtual content, wherein the image formed by the first projector is a representation of the virtual content being viewed through the AR/VR device. ### Claim 13 (depends on 12) The light system as recited in claim 12, wherein the light system and the AR/VR device are configured to synchronize projection of the virtual content so that the person using the AR/VR device does not view the virtual content being projected by the light system. ### Claim 14 A light system, comprising: a controller comprising one or more processors; a first projector comprising: a first array of individually addressable light-emitting diodes (LEDs) configured to emits light representing virtual content under direction of the controller; and a narrow-angle focusing lens configured to focus the light emitted by the first array of LEDs on a surface in a room to form an image, wherein individual LEDs in the first array corresponds to individual pixels in the image; and a second projector located above the first projector, comprising: a second array of individually addressable LEDs configured to emits light representing additional virtual content under direction of the controller; and a wide-angle focusing lens configured to focus the light emitted by the second array of LEDs on at least a portion of surfaces in the room to form an image, wherein individual LEDs in the second array corresponds to individual pixels in the image, wherein resolution of the image formed by the second projector is lower than resolution of the image formed by the first projector; and a diffuser mechanism configured to control a presence of inter-pixel gaps in light emitted by the light system and switch the light system among at least two modes, including (a) a display mode wherein the light system emits light representing image content and (b) an illumination mode wherein the light system emits light to illuminate the room when not emitting light that represents the image content, wherein the inter-pixel gaps are not present in the light emitted under the illumination mode. ### Claim 15 (depends on 14) The light system as recited in claim 14, wherein the diffuser mechanism includes a diffuser located between the first array of LEDs of the first projector and the narrow-angle focusing lens of the first projector. ### Claim 16 (depends on 14) The light system as recited in claim 14, wherein the controller is configured to enable and disable the diffuser mechanism. ### Claim 17 (depends on 14) The light system as recited in claim 14, wherein the controller, the first projector, and the low-resolution second projector are contained within a transparent or semi-transparent enclosure, and wherein the diffuser mechanism is further configured to project image content onto the surface of the enclosure. ### Claim 18 (depends on 14) The light system as recited in claim 14, wherein the image formed on the surfaces of the room by the second projector is a grayscale image. ### Claim 19 (depends on 14) The light system as recited in claim 14, wherein the second projector further comprises at least one integrated optical detection system configured to detect objects and surfaces within the room. ### Claim 20 A light system, comprising: a controller comprising one or more processors; a foveated projector, comprising: a foveated array of individually addressable light-emitting diodes (LEDs) configured to emit light under direction of the controller, wherein the foveated array of LEDs includes a central array of addressable LEDs for emitting light representing virtual content surrounded by addressable LEDs for emitting light representing additional virtual content; and a wide-angle focusing lens configured to focus the light emitted by the foveated array of LEDs on surfaces in a room to form a first image from the light emitted by the central array of LEDs and to form additional images from the light emitted by the addressable LEDs surrounding the central array, wherein individual LEDs in the central array of LEDs corresponds to individual pixels in the first image, wherein individual LEDs surrounding the central array corresponds to individual pixels in the additional images, and wherein resolution of the first image formed from the light emitted by the central array of LEDs is higher than resolution of the images formed from the light emitted by the addressable LEDs surrounding the central array; and a diffuser mechanism configured to control a presence of inter-pixel gaps in light emitted by the light system and switch the light system among at least two modes, including (a) a display mode wherein the light system emits light representing image content and (b) an illumination mode wherein the light system emits light to illuminate the room when not emitting light that represents the image content, wherein the inter-pixel caps are not present in the light emitted under the illumination mode.