# US 2025/0157134 A1 · Adjusting Virtual View in a Mirrored Virtual World

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157134 A1
- Document ID: US20250157134A1
- Status: Published application
- Kind: A1
- Application number: 18/942,346
- Filed: 2024-11-08
- Published: 2025-05-15
- Earliest claimed: 2023-11-10
- Assignees: Niantic, Inc.
- Applicants: Niantic, Inc.
- Inventors: Ben Benfold
- Web page: https://patentgrep.com/patent/US20250157134A1

## CPC

- G06T 15/20: Perspective computation
- A63F 13/5378: for displaying an additional top view, e.g. radar screens or maps
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- G06T 7/75: {involving models}
- G06T 17/05: Geographic models
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2207/30244: Camera pose
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

A method, system, and computer-readable storage medium are disclosed for displaying virtual elements (e.g., AR content) in a physical environment by a client device using a virtual camera pose that is different from the pose of the physical camera used to capture images of the physical environment. The client device uses a three-dimensional (3D) map (e.g., a topographical mesh) of the physical environment to determine a pose (a position and orientation) of the camera of the client device. The 3D map can include geometry, colors, textures, or any other suitable information describing the physical environment.

## Claims

### Claim 1

A computer-implemented method of determining a virtual pose for view of content, the computer-implemented method comprising:
identifying a real-world environment of a client device;
obtaining a 3D map corresponding to the real-world environment;
obtaining a physical pose of a camera of the client device;
determining the virtual pose by applying an offset to the physical pose; and
causing display of a view generated from the 3D map using the virtual pose.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein obtaining the 3D map comprises generating the 3D map based on images captured by the camera of the client device.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein obtaining the physical pose of the camera comprises determining the physical pose of the camera by comparing an image captured by the camera of the client device to the 3D map.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the 3D map is a topographical mesh of the real-world environment.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the offset comprises at least one of a predetermined rotation or a predetermined translation.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the offset is determined by a calibration process that comprises:
directing a user to position the client device is a desired position;
collecting sensor data while the client device is in the desired position; and
calculating at least one of a rotation or translation of the offset that converts the physical pose while the client device is in the desired position to a desired virtual pose.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the desired virtual pose is equivalent to the camera being at eye level of the user pointing along an axis parallel to a ground plane.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the offset is a function of an angle of the physical pose relative to a ground plane.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, wherein the function is a function whose first derivative is continuous.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the view generated from the 3D map includes a virtual item.

### Claim 11

A non-transitory computer-readable medium comprising instructions for determining a virtual pose for view of content, the instructions, when executed by a computing device, causing the computing device to perform operations including:
identifying a real-world environment of a client device;
obtaining a 3D map corresponding to the real-world environment;
obtaining a physical pose of a camera of the client device;
determining the virtual pose by applying an offset to the physical pose; and
causing display of a view generated from the 3D map using the virtual pose.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein obtaining the 3D map comprises generating the 3D map based on images captured by the camera of the client device.

### Claim 13 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein obtaining the physical pose of the camera comprises determining the physical pose of the camera by comparing an image captured by the camera of the client device to the 3D map.

### Claim 14 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the 3D map is a topographical mesh of the real-world environment.

### Claim 15 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the offset comprises at least one of a predetermined rotation or a predetermined translation.

### Claim 16 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the offset is determined by a calibration process that comprises:
directing a user to position the client device is a desired position;
collecting sensor data while the client device is in the desired position; and
calculating at least one of a rotation or translation of the offset that converts the physical pose while the client device is in the desired position to a desired virtual pose.

### Claim 17 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the desired virtual pose is equivalent to the camera being at eye level of the user pointing along an axis parallel to a ground plane.

### Claim 18 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the offset is a function of an angle of the physical pose relative to a ground plane.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the function is a function whose first derivative is continuous.

### Claim 20 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the view generated from the 3D map includes a virtual item.
