# US 12,002,167 B2 · Virtual, augmented, and mixed reality systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,002,167 B2
- Document ID: US12002167B2
- Status: Granted
- Kind: B2
- Application number: 17/538,103
- Filed: 2021-11-30
- Published: 2022-03-24
- Granted: 2024-06-04
- Earliest claimed: 2019-01-18
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Jose Felix Rodriguez; Ricardo Martinez Perez; Reza Nourai; Robert Blake Taylor
- Web page: https://patentgrep.com/patent/US12002167B2

## CPC

- G06F 1/3265: {Power saving in display device}
- G02B 27/0172: {characterised by optical features}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/147: using display panels
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0185: {Displaying image at variable distance}
- G09G 2330/022: in absence of operation, e.g. no data being entered during a predetermined time
- G09G 2370/04: Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G 2370/10: Use of a protocol of communication by packets in interfaces along the display data pipeline
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A method in a virtual, augmented, or mixed reality system includes a GPU determining/detecting an absence of image data. The method also includes shutting down a portion/component/function of the GPU. The method further includes shutting down a communication link between the GPU and a DB. Moreover, the method includes shutting down a portion/component/function of the DB. In addition, the method includes shutting down a communication link between the DB and a display panel. The further also includes shutting down a portion/component/function of the display panel.

## Claims

### Claim 1

A method in a virtual, augmented, or mixed reality system, comprising:
a GPU determining or detecting an absence of virtual image data in the form of a full dark frame having no virtual images;
shutting down a portion, component, or function of the GPU;
shutting down a communication link between the GPU and a DB;
shutting down a portion, component, or function of the DB;
shutting down a communication link between the DB and a display panel; and
shutting down a portion, component, or function of the display panel.

### Claim 2 (depends on 1)

The method of claim 1, further comprising reorganizing frame data to reduce transfer time.

### Claim 3 (depends on 1)

The method of claim 1, further comprising the GPU sending a STP message to the DB.

### Claim 4 (depends on 3)

The method of claim 3, further comprising the GPU sending the STP message to the DB via AUX messages communicated via an auxiliary channel.

### Claim 5 (depends on 1)

The method of claim 1, wherein shutting down a portion component, or function of the GPU does not comprise shutting down the entire GPU, and the portion, component, or function of the GPU is selected from the group consisting of memory read, compression, and color segmentation.

### Claim 6 (depends on 1)

The method of claim 1, wherein the portion, component, or function of the DB is memory write.

### Claim 7 (depends on 1)

The method of claim 1, wherein the portion, component, or function of the display panel is selected from the group consisting of video RAM and a MIPI receiver.

### Claim 8 (depends on 1)

The method of claim 1, further comprising the GPU sending a wake up signal to the DB.

### Claim 9 (depends on 8)

The method of claim 8, wherein the GPU sends the wake up signal via an AUX communication link.

### Claim 10 (depends on 1)

The method of claim 1, further comprising the GPU sending a wake up signal to the communication link between the GPU and a DB.

### Claim 11 (depends on 1)

The method of claim 1, wherein the portion, component, or function of the GPU, the communication link between the GPU and a DB, the portion, component or function of the DB, the communication link between the DB and a display panel, the portion, component, or function of the display panel are shut down asynchronously.

### Claim 12 (depends on 1)

The method of claim 1, further comprising the DB sending an embedded line control message to the display panel.

### Claim 13

A method in a virtual, augmented, or mixed reality system, comprising:
a GPU obtaining a frame of image data;
the GPU identifying a section of the frame of image data;
a direct memory access controller sending the identified section of the frame of image data to a DB without further processing of the image data;
the GPU determining or detecting an absence of virtual image data in the form of a full dark frame having no virtual images;
shutting down a portion, component, or function of the GPU;
shutting down a portion, component, or function of the DMA;
shutting down a communication link between the GPU and a DB;
shutting down a portion, component, or function of the DB;
shutting down a communication link between the DB and a display panel; and
shutting down a portion, component, or function of the display panel.

### Claim 14 (depends on 13)

The method of claim 13, wherein the section of the frame of image data is a row of non-black image data.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
the GPU sending a wake up signal to the DB.