# US 2025/0168320 A1 · Extended-reality rendering using hardware pixels-per-degree estimations, and systems and methods of use thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168320 A1
- Document ID: US20250168320A1
- Status: Published application
- Kind: A1
- Application number: 18/938,148
- Filed: 2024-11-05
- Published: 2025-05-22
- Earliest claimed: 2023-11-17
- Assignees: Meta Platforms Technologies, LLC
- Applicants: Meta Platforms Technologies, LLC
- Inventors: Rohit Rao Padebettu; Nghiep Chinh Luu; Irad Ratmansky; Steven Paul Lansel
- Web page: https://patentgrep.com/patent/US20250168320A1

## CPC

- H04N 13/279: the virtual viewpoint locations being selected by the viewers or determined by tracking
- H04N 13/366: using viewer tracking
- G02B 27/0172: {characterised by optical features}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- H04N 13/139: Format conversion, e.g. of frame-rate or size
- H04N 13/156: Mixing image signals
- H04N 13/398: Synchronisation thereof; Control thereof
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An XR device includes a display device, a lens, and programs. The programs are stored in memory and configured to be executed by processors. Moreover, the programs include instructions for determining an HPPD metric for the XR device based on characteristics of the display device and the lens. The programs also include instructions for receiving data regarding a size and a location of visual XR content from an XR application running on the XR device. Additionally, the programs include instructions for determining an RPPD metric for the visual XR content based on the data. Further, the programs include instructions for determining a recommended resolution for rendering the visual XR content based on the HPPD metric and the RPPD metric. Moreover, the programs include instructions for transmitting the recommended resolution to the XR application, where the XR application is configured to render the visual XR content using the recommended resolution.

## Claims

### Claim 1

An XR device, comprising:
a display device;
a lens; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by one or more processors, the one or more programs including instructions for:
determining a hardware pixels-per-degree (“HPPD”) metric for the XR device based on a characteristic of the display device and a characteristic of the lens;
receiving data regarding visual XR content from an XR application running on the XR device, the data comprising a size of the visual XR content and a location of the visual XR content;
determining a render pixels-per-degree (“RPPD”) metric for the visual XR content based on the data;
determining a scaling factor for rendering the visual XR content based on the HPPD metric and the RPPD metric;
determining a recommended resolution for the XR application based on the scaling factor; and
transmitting the recommended resolution to the XR application, wherein the XR application is configured to render the visual XR content using the recommended resolution.

### Claim 2 (depends on 1)

The XR device of claim 1, wherein the one or more programs further include instructions for:
receiving the rendered visual XR content from the XR application;
compositing the rendered visual XR content together with a foreground layer to form a composite view; and
displaying the composite view via the display device.

### Claim 3 (depends on 1)

The XR device of claim 1, wherein determining the HPPD metric comprises:
measuring (i) a first angle between a first pixel of the display device and an eye position of a user of the XR device and (ii) a second angle between a second pixel of the display device and the user eye position; and
determining the HPPD based on a difference between the first angle and the second angle.

### Claim 4 (depends on 1)

The XR device of claim 1, wherein:
the XR device comprises an HMD;
the one or more programs further include instructions for estimating a head position of a user of the XR device; and
determining the RPPD metric is further based on the user head position.

### Claim 5 (depends on 4)

The XR device of claim 4, wherein the head position comprises an old head position, and the one or more programs further include instructions for:
estimating a new head position of the user;
determining that a difference between the old head position and the new head position satisfies a movement threshold; and
responsive to determining that the difference satisfies the movement threshold:
redetermining the RPPD metric based on the new head position and the data regarding the visual XR content;
redetermining the scaling factor based on the HPPD metric and the redetermined RPPD metric;
redetermining the recommended resolution based on the redetermined scaling factor; and
transmitting the redetermined recommended resolution to the XR application, wherein the XR application is further configured to render the visual XR content using the redetermined recommended resolution.

### Claim 6 (depends on 1)

The XR device of claim 1, wherein the one or more programs further include instructions for:
receiving additional data that regards additional visual XR content from the XR application, the additional data comprising a size of the additional visual XR content and a location of the additional visual XR content;
redetermining the RPPD metric based on the additional data;
redetermining the scaling factor for rendering the additional visual XR content based on the HPPD metric and the redetermined RPPD metric;
redetermining the recommended resolution based on the redetermined scaling factor; and
transmitting the redetermined recommended resolution to the XR application, wherein the XR application is further configured to render the additional visual XR content using the redetermined recommended resolution.

### Claim 7 (depends on 6)

The XR device of either claim 6, wherein the one or more programs further include instructions for, prior to transmitting the redetermined recommended resolution to the XR application:
determining whether a difference between the recommended resolution and the redetermined recommended resolution satisfies a resolution change threshold;
responsive to determining that the difference satisfies the resolution change threshold, transmitting the redetermined recommended resolution to the XR application; and
responsive to determining that the difference does not satisfy the resolution change threshold, transmitting the recommended resolution to the XR application and forgoing transmitting the redetermined recommended resolution.

### Claim 8 (depends on 1)

The XR device of claim 1, wherein:
the one or more programs further include instructions for determining an available amount of the memory, a latency of the one or more processors, or a utilization metric of the one or more processors; and
determining the recommended resolution is further based on the available amount of the memory, the latency of the one or more processors, or the utilization metric of the one or more processors.

### Claim 9 (depends on 1)

The XR device of claim 1, wherein the XR application is further configured to:
define the size of the visual XR content and the location of the visual XR content;
transmit the data regarding the visual XR content to the XR device after defining the size and the location of the visual XR content;
receive the recommended resolution from the XR device;
set an initial resolution for the visual XR content based on the recommended resolution;
set up a swapchain based on the initial resolution;
render the visual XR content using the swapchain in addition to the recommended resolution; and
transmit the rendered visual XR content to the XR device.

### Claim 10 (depends on 9)

The XR device of claim 9, wherein the XR application is further configured to (i) receive a redetermined recommended resolution from the XR device and (ii) adjust a resolution of the swapchain based on the redetermined recommended resolution.

### Claim 11 (depends on 9)

The XR device of claim 9, wherein the XR application is further configured to (i) set up a viewport based on the initial resolution, (ii) receive a redetermined recommended resolution from the XR device, and (iii) adjust a size of the viewport based on the redetermined recommended resolution.

### Claim 12 (depends on 9)

The XR device of claim 9, wherein the XR application is further configured to (i) receive a redetermined recommended resolution from the XR device, (ii) determine that the redetermined recommended resolution satisfies a resolution threshold, and (iii) adjust a resolution of the swapchain responsive to determining that the redetermined recommended resolution exceeds the resolution threshold.

### Claim 13 (depends on 1)

The XR device of claim 1, wherein rendering the visual XR content using the recommended resolution substantially improves a quality of the rendered visual XR content as compared to rendering the visual XR content using a default resolution determined independently of the HPPD metric, the quality of the rendered visual XR content comprising a sharpness of the rendered visual XR content, a framerate of the rendered visual XR content, or an amount of aliasing present in the rendered visual XR content.

### Claim 14

A method of improving rendering of an XR device, the method comprising:
determining an HPPD metric for the XR device based on a characteristic of a display device of the XR device and a characteristic of a lens of the XR device;
receiving data regarding visual XR content from an XR application running on the XR device, the data comprising a size of the visual XR content and a location of the visual XR content;
determining an RPPD metric for the visual XR content based on the data;
determining a scaling factor for rendering the visual XR content based on the HPPD metric and the RPPD metric;
determining a recommended resolution for the XR application based on the scaling factor; and
transmitting the recommended resolution to the XR application, wherein the XR application is configured to render the visual XR content using the recommended resolution.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
receiving the rendered visual XR content from the XR application;
compositing the rendered visual XR content together with a foreground layer to form a composite view; and
displaying the composite view via the display device.

### Claim 16 (depends on 14)

The method of claim 14, wherein determining the HPPD metric comprises:
measuring (i) a first angle between a first pixel of the display device and an eye position of a user of the XR device and (ii) a second angle between a second pixel of the display device and the user eye position; and
determining the HPPD based on a difference between the first angle and the second angle.

### Claim 17 (depends on 14)

The method of claim 14, wherein:
the XR device comprises an HMD;
the one or more programs further include instructions for estimating a head position of a user of the XR device; and
determining the RPPD metric is further based on the user head position.

### Claim 18

A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of an XR device that includes a display device and a lens, cause the XR device to:
determine a hardware pixels-per-degree HPPD metric for the XR device based on a characteristic of the display device and a characteristic of the lens;
receive data regarding visual XR content from an XR application running on the XR device, the data comprising a size of the visual XR content and a location of the visual XR content;
determine a render pixels-per-degree RPPD metric for the visual XR content based on the data;
determine a scaling factor for rendering the visual XR content based on the HPPD metric and the RPPD metric;
determine a recommended resolution for the XR application based on the scaling factor; and
transmit the recommended resolution to the XR application, wherein the XR application is configured to render the visual XR content using the recommended resolution.

### Claim 19 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein the instructions that, when executed by the XR device, also cause the XR device to:
receive the rendered visual XR content from the XR application;
composite the rendered visual XR content together with a foreground layer to form a composite view; and
display the composite view via the display device.

### Claim 20 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein determining the HPPD metric comprises:
measuring (i) a first angle between a first pixel of the display device and an eye position of a user of the XR device and (ii) a second angle between a second pixel of the display device and the user eye position; and
determining the HPPD based on a difference between the first angle and the second angle.
