# US 2026/0089308 A1 · Multi-perspective augmented reality experience

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0089308 A1
- Document ID: US20260089308A1
- Status: Published application
- Kind: A1
- Application number: 19/408,445
- Filed: 2025-12-04
- Published: 2026-03-26
- Earliest claimed: 2022-08-31
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Rajan Vaish; Sven Kratz; Andrés Monroy-Hernández; Brian Anthony Smith
- Web page: https://patentgrep.com/patent/US20260089308A1

## CPC

- H04N 13/368: for two or more viewers
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06T 15/20: Perspective computation
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- G06V 20/64: Three-dimensional [3D] objects
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/158: {Switching image signals}
- H04N 13/189: Recording image signals; Reproducing recorded image signals
- H04N 13/388: Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
- H04N 21/816: {involving special video data, e.g 3D video}
- G06T 2219/024: Multi-user, collaborative environment
- H04N 13/156: Mixing image signals
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/279: the virtual viewpoint locations being selected by the viewers or determined by tracking
- H04N 13/344: with head-mounted left-right displays
- H04N 21/4781: {Games}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present disclosure relates to methods and systems for providing a multi-perspective augmented reality experience. A volumetric video of a three-dimensional space is captured. The volumetric video of the three-dimensional space includes a volumetric representation of a first user within the three-dimensional space. The volumetric video is displayed by a display device worn by a second user, and the second user sees the volumetric representation of the first user within the three-dimensional space. Input indicative of an interaction (e.g., entering or leaving) of the second user with the volumetric representation of the first user is detected. Based on detecting the input indicative of the interaction, the display device switches to a display of a recorded perspective of the first user. Thus, by interacting with a volumetric representation of the first user in a volumetric video, the second user views the first user's perspective of the three-dimensional space.

## Claims

### Claim 1

A method comprising:
accessing a first volumetric video comprising a volumetric representation of a first user within a three-dimensional space;
accessing a second volumetric video comprising a perspective of the first user within the three-dimensional space;
causing a display device of a second user to present the first volumetric video to the second user;
detecting that the second user interacts with the volumetric representation of the first user presented in the first volumetric video; and
in response to detecting that the second user interacts with the volumetric representation of the first user presented in the first volumetric video,
causing the display device to switch to present the second volumetric video to the second user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first volumetric video comprises real-time captured content streamed to the display device.

### Claim 3 (depends on 1)

The method of claim 1, wherein detecting that the second user interacts with the volumetric representation of the first user presented in the first volumetric video further comprises:
determining a gaze of the second user is directed at the volumetric representation of the first user.

### Claim 4 (depends on 1)

The method of claim 1, wherein the second volumetric video comprises an audio signal comprising audio provided by the first user, wherein the causing presentation of the second volumetric video comprises causing presentation of the audio signal.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the three-dimensional space corresponds to a real-world location;
the display device is worn by the second user at the real-world location; and
the presentation of the first volumetric video comprises a presentation of the volumetric representation of the first user overlaid on the real-world location at a position in the real-world location corresponding to a position of the first user in the real-world location during capture of the first volumetric video or the second volumetric video.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the three-dimensional space corresponds to a first real-world location;
the display device is worn by the second user at a second real-world location; and
the presentation of the first volumetric video comprises a presentation of the volumetric representation of the first user at a position related to the second real-world location corresponding to a position of the first user in a real-world location during capture of the first volumetric video.

### Claim 7 (depends on 6)

The method of claim 6, wherein causing presentation of the first volumetric video by the display device comprises causing presentation of one or more AR content items overlaid on one or more elements of the real-world location.

### Claim 8 (depends on 1)

The method of claim 1, wherein:
the three-dimensional space corresponds to a real-world location;
the display device is worn by the second user at the real-world location; and
causing presentation of the first volumetric video by the display device comprises causing presentation of the volumetric representation of the first user overlaid on one or more elements of the real-world location.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the first volumetric video further comprises a volumetric representation of the second user; and
the second volumetric video at the perspective of the first user comprises the volumetric representation of the second user.

### Claim 10 (depends on 1)

The method of claim 1, wherein the three-dimensional space comprises the second user and the first volumetric video of the three-dimensional space comprises a volumetric representation of the second user within the three-dimensional space, the method further comprising:
accessing a third volumetric video of the three-dimensional space, the third volumetric video comprising a perspective of the second user within the three-dimensional space;
causing a display device of a first user to present the first volumetric video of the three-dimensional space comprising the volumetric representation of the second user to the first user;
detecting that the first user interacts with the volumetric representation of the second user presented in the first volumetric video; and
in response to detecting that the first user interacts with the volumetric representation of the second user,
causing the display device of the first user to switch to present the third volumetric video to the first user.

### Claim 11 (depends on 1)

The method of claim 1, wherein the three-dimensional space corresponds to a sporting event venue.

### Claim 12 (depends on 1)

The method of claim 1, wherein the three-dimensional space corresponds to a concert venue.

### Claim 13

A computing apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the apparatus to perform operations comprising:
accessing a first volumetric video comprising a volumetric representation of a first user within a three-dimensional space;
accessing a second volumetric video comprising a perspective of the first user within the three-dimensional space;
causing a display device of a second user to present the first volumetric video to the second user;
detecting that the second user interacts with the volumetric representation of the first user presented in the first volumetric video; and
in response to detecting that the second user interacts with the volumetric representation of the first user presented in the first volumetric video,
causing the display device to switch to present the second volumetric video to the second user.

### Claim 14 (depends on 13)

The computing apparatus of claim 13, wherein to detect that the second user interacts with the volumetric representation of the first user presented in the first volumetric video, the instructions further configure the apparatus to perform operations comprising:
determining a gaze of the second user is directed at the volumetric representation of the first user.

### Claim 15 (depends on 13)

The computing apparatus of claim 13, wherein:
the three-dimensional space corresponds to a real-world location;
the display device is worn by the second user at the real-world location; and
the presentation of the first volumetric video comprises a presentation of the volumetric representation of the first user overlaid on the real-world location at a position in the real-world location corresponding to a position of the first user in the real-world location during capture of the first volumetric video or the second volumetric video.

### Claim 16 (depends on 13)

The computing apparatus of claim 13, wherein:
the three-dimensional space corresponds to a first real-world location;
the display device is worn by the second user at a second real-world location; and
the presentation of the first volumetric video comprises a presentation of the volumetric representation of the first user at a position related to the second real-world location corresponding to a position of the first user in the real-world location during capture of the first volumetric video.

### Claim 17 (depends on 16)

The computing apparatus of claim 16, wherein to cause presentation of the first volumetric video by the display device, the instructions further configure the apparatus to perform operations comprising:
causing presentation of one or more AR content items overlaid on one or more elements of the real-world location.

### Claim 18 (depends on 13)

The computing apparatus of claim 13, wherein:
the three-dimensional space corresponds to a real-world location;
the display device is worn by the second user at the real-world location; and
cause presentation of the first volumetric video by the display device comprises causing presentation of the volumetric representation of the first user overlaid on one or more elements of the real-world location.

### Claim 19 (depends on 13)

The computing apparatus of claim 13, wherein:
the first volumetric video further comprises a volumetric representation of the second user; and
the second volumetric video comprises the volumetric representation of the second user.

### Claim 20

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
accessing a first volumetric video comprising a volumetric representation of a first user within a three-dimensional space;
accessing a second volumetric video comprising a perspective of the first user within the three-dimensional space;
causing a display device of a second user to present the first volumetric video to the second user;
detecting that the second user interacts with the volumetric representation of the first user presented in the first volumetric video; and
in response to detecting that the second user interacts with the volumetric representation of the first user presented in the first volumetric video,
causing the display device to switch to present the second volumetric video to the second user.
