# US 12,602,105 B2 · Systems and methods for rendering augmented reality content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,105 B2 - Document ID: US12602105B2 - Status: Granted - Kind: B2 - Application number: 18/429,637 - Filed: 2024-02-01 - Published: 2025-08-07 - Granted: 2026-04-14 - Earliest claimed: 2024-02-01 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Dongsheng Bi; Xiaoping Xie - Web page: https://patentgrep.com/patent/US12602105B2 ## CPC - G06F 3/012: {Head tracking input arrangements} - G06T 3/18: Image warping, e.g. rearranging pixels individually - G06T 11/00: Two-dimensional [2D] image generation - G09G 3/001: {using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP)} - G06T 2210/12: Bounding box - G06T 2210/52: Parallel processing - G09G 2340/0435: Change or adaptation of the frame rate of the video stream - G09G 2354/00: Aspects of interface with display user - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A display is disclosed that can receive a process world-locked content and head-locked content for a mixed reality device differently. The Head-locked content, which are not latency sensitive can be buffered at the display at a slower update rate than the world-locked content and can be displayed at a much lower refresh rate. Treating the content separately can help an augmented reality device save power by only having to perform late stage reprojection on the world-locked content. ## Claims ### Claim 1 A system comprising: a processor configured to warp world-locked content to generate warped world-locked content; and a heads-up display including: a pixel driver coupled to a pixel array; a first input configured to receive a first stream of data from the processor corresponding to the warped world-locked content, the warped world-locked content configured to change on the heads-up display based on a movement of the heads-up display; a second input configured to receive a second stream of data corresponding to head-locked content, the head-locked content configured to not change on the heads-up display based on the movement of the heads-up display; and a composer coupled to the first input and the second input and configured to: generate a mask specifying an area including head-locked pixels based on the first stream of data and the second stream of data; and transmit the mask to the pixel driver to configure the pixel driver to control the head-locked pixels in the area of the pixel array differently than world-locked pixels that are not in the area. ### Claim 2 (depends on 1) The system according to claim 1, wherein the pixel driver is further configured to: update the world-locked pixels not in the area of the pixel array according to frames at a first frame rate; and skip updating the head-locked pixels in the area of the pixel array for some of the frames at the first frame rate so that the head-locked pixels in the area are updated at a second frame rate that is less than the first frame rate. ### Claim 3 (depends on 1) The system according to claim 1, wherein the mask is a bounding box containing pixels of the head-locked content. ### Claim 4 (depends on 1) The system according to claim 1, wherein: the first stream includes a first attribute for the world-locked pixels; and the second stream includes a second attribute for the head-locked pixels. ### Claim 5 (depends on 4) The system according to claim 4, wherein the composer is further configured to: generate a first layer based on the first attribute, the first layer corresponding to the world-locked content; generate a second layer based on the second attribute, the second layer corresponding to the head-locked content; and combine the first layer and the second layer to generate a frame for display. ### Claim 6 (depends on 1) The system according to claim 1, wherein the pixel driver is configured by the mask to skip updating the head-locked pixels to reduce a frame rate of the head-locked content. ### Claim 7 (depends on 1) The system according to claim 1, wherein the pixel driver is configured by the mask to drive some adjacent head-locked pixels identically to reduce a resolution of the head-locked content. ### Claim 8 (depends on 1) The system according to claim 1, wherein the pixel driver is configured by the mask to drive some adjacent head-locked pixels identically to increase a compression gain of the head-locked content. ### Claim 9 A method comprising: warping world-locked content to generate warped world-locked content using a processor of an augmented-reality device; receiving, from the processor, a first stream of data corresponding to the warped world-locked content at a composer of a heads-up display of the augmented-reality device, the warped world-locked content configured to change on the heads-up display based on a movement of the heads-up display; receiving a second stream of data corresponding to head-locked content at the composer of the heads-up display, the head-locked content configured to not change on the heads-up display based on the movement of the heads-up display; generating, using the composer, a mask specifying an area of the heads-up display including head-locked pixels based on the first stream of data and the second stream of data; and transmitting the mask to a pixel driver of the heads-up display to configure the pixel driver to control the head-locked pixels in the area differently than world-locked pixels not in the area based on the mask. ### Claim 10 (depends on 9) The method according to claim 9, wherein the first stream of data and the second stream of data are received at the composer in parallel. ### Claim 11 (depends on 9) The method according to claim 9, wherein pixels not in the area correspond to the world-locked content. ### Claim 12 (depends on 9) The method according to claim 9, wherein controlling the head-locked pixels in the area differently than the world-locked pixels not in the area includes: updating the world-locked pixels not in the area according to frames at a first frame rate; and skipping updating the head-locked pixels in the area for some of the frames so that the head-locked pixels in the area are updated at a second frame rate that is less than the first frame rate. ### Claim 13 (depends on 9) The method according to claim 9, further comprising: generating a first layer based on a first attribute received with the first stream of data; generating a second layer based on a second attribute received with the second stream of data; and combining the first layer and the second layer to generate a frame. ### Claim 14 (depends on 9) The method according to claim 9, wherein controlling the head-locked pixels in the area differently than the world-locked pixels not in the area includes: driving the world-locked pixels not in the area at a first frame rate; and driving the head-locked pixels in the area at a second frame rate. ### Claim 15 (depends on 9) The method according to claim 9, wherein controlling the head-locked pixels in the area differently than the world-locked pixels not in the area includes: driving the world-locked pixels not in the area at a first resolution; and driving the head-locked pixels in the area at a second resolution. ### Claim 16 (depends on 9) The method according to claim 9, wherein controlling the head-locked pixels in the area differently than the world-locked pixels not in the area includes: driving the world-locked pixels not in the area at a first compression gain; and driving the head-locked pixels in the area at a second compression gain. ### Claim 17 An augmented reality device including: an inertial measurement unit configured to sense a movement of a user; a processor configured to: receive head-locked content and world-locked content; and warp the world-locked content to generate warped world-locked content; and a heads-up display including a composer configured to: receive a first stream of data corresponding to the warped world-locked content from the processor; receive a second stream of data corresponding to the head-locked content from the processor; generate a mask specifying an area on the heads-up display corresponding to the head-locked content; and transmit the mask to a pixel driver, the mask configuring the pixel driver to control pixels in the area differently than pixels not in the area. ### Claim 18 (depends on 17) The augmented reality device according to claim 17, wherein the head-locked content and the world-locked content are received at the processor from a communication link between the augmented reality device and a computing device. ### Claim 19 (depends on 17) The augmented reality device according to claim 17, wherein the processor is further configured to: warp the world-locked content based on the movement of the user.