# US 2026/0099197 A1 · Augmented reality (ar) content-sharing with ar-deprived audience

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099197 A1
- Document ID: US20260099197A1
- Status: Published application
- Kind: A1
- Application number: 19/406,826
- Filed: 2025-12-02
- Published: 2026-04-09
- Earliest claimed: 2024-10-04
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Georgios Evangelidis; Vsevolod Konjahhin; Laura Rosalia Luidolt; Simon Schreiberhuber; Dmytro Siryk; Ihor Tymchyshyn; Kai Zhou
- Web page: https://patentgrep.com/patent/US20260099197A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G02B 27/017: {Head mounted}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 7/579: from motion
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0141: {characterised by the informative content of the display}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T 2207/30201: Face
- G06T 2207/30204: Marker
- G06T 2207/30244: Camera pose
- G06T 2219/024: Multi-user, collaborative environment
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A head-worn device system equipped with cameras, display devices, and processors uses stored instructions to facilitate interactions between an augmented reality (AR) device and an external display system. When executed, these instructions establish a communications link between the AR device and the external display. The system identifies the pose of the external display and receives user inputs from the AR device user, relating to interactions with virtual objects in a real-world setting. It also identifies the positions of viewers watching the external display. Based on the external display's pose and the viewer locations, the system generates display data for the virtual object, ensuring it appears correctly on the external display. This display data is then transmitted to the external display system, completing the interaction loop and enhancing the viewing experience for the audience.

## Claims

### Claim 1

A system comprising:
at least one processor; and
at least one memory component storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
identifying a communications connection between an external display system and an Augmented Reality (AR) device, the external display system being external to the AR device;
identifying a resolution of an external display of the external display system;
receiving user input from a user of the AR device associated with an interaction of a virtual object located within a real-world environment;
generating display data of the virtual object for the external display based on the resolution of the external display and the user input; and
transmitting the display data to the external display causing display of a rendering of the virtual object on the external display to viewers of the external display.

### Claim 2 (depends on 1)

The system of claim 1, wherein the operations further comprise identifying a pose of the external display, wherein generating the display data is further based on the pose of the external display.

### Claim 3 (depends on 2)

The system of claim 2, wherein the identification of the pose of the external display is based on the communication connection identified between the external display and the AR device.

### Claim 4 (depends on 2)

The system of claim 2, wherein the operations further comprise:
identifying a spatial position of the display;
processing data from one or more internal sensors of the AR device to generate a spatial position and pose of the AR device; and
generating a relative spatial position of the display and the AR device based on the spatial position and pose of the AR device and the spatial position and the pose of the display, wherein generating display data of the virtual object is based on the relative spatial position of the display and the AR device.

### Claim 5 (depends on 4)

The system of claim 4, wherein the one or more internal sensors of the AR device include an accelerometer, a gyroscope, and a camera, wherein the AR device performs pose estimation using SLAM (Simultaneous Localization and Mapping) to estimate the device's pose by combining data from the accelerometer and gyroscope with visual data from the camera.

### Claim 6 (depends on 2)

The system of claim 2, wherein identifying the pose of the external display comprises:
capturing, by the AR device, an image from a camera of the AR device;
processing the image to identify one or more markers;
identifying one or more characteristics of the external display from the identified one or more markers; and
determining the pose of the external display.

### Claim 7 (depends on 1)

The system of claim 1, wherein the operations further comprise identifying a spatial configuration of the external display, wherein generating the display data is further based on the spatial configuration of the external display.

### Claim 8 (depends on 1)

The system of claim 1, wherein the operations further comprise identifying one or more locations of corresponding viewers of the external display within the real-world environment, wherein generating the display data is further based on the one or more locations of the corresponding viewers.

### Claim 9 (depends on 1)

The system of claim 1, wherein the operations further comprise:
processing an image of the external display captured by the AR device to identify an object displayed on the external display and the object's displayed dimensions;
accessing known dimensions of the object being displayed on the external 2D display; and
based on the known dimensions and the displayed dimension of the object, determining a pixel resolution of the external display, wherein generating the display data is based on the pixel resolution of the external display.

### Claim 10 (depends on 1)

The system of claim 1, wherein the user input is received from the user of the AR device is via a virtual AR controller, and wherein the operations further comprise causing display of the virtual AR controller to the user of the AR device via an AR display on the AR device without causing display of the virtual AR controller on the external display.

### Claim 11 (depends on 1)

The system of claim 1, wherein the operations further comprise:
continuously monitoring user interactions with virtual objects via the AR device; and
in response to a predetermined time period elapsing without direct user interaction of a first virtual object, changing the display of the first virtual object.

### Claim 12 (depends on 1)

The system of claim 1, wherein the operations further comprise receiving another user input from another user of another AR device associated with another interaction with the virtual object located within the real-world environment, wherein generating the display data is further based on the other user input from the other user of the other AR device.

### Claim 13 (depends on 1)

The system of claim 1, wherein the operations further comprise identifying a relative position of the viewers with the external display,
wherein identifying the one or more locations of the corresponding viewers and identifying the relative position of the viewers with the external display is based on images captured by a camera of the AR device.

### Claim 14 (depends on 1)

The system of claim 1, wherein the operations further comprise:
identifying a center view line for the external display, and
based on the one or more locations of the viewers, identify a relative position of individual viewers with respect to the center view line,
wherein generating the display data is based on the relative position of the individual viewers.

### Claim 15 (depends on 1)

The system of claim 1, wherein the operations further comprise:
based on the one or more locations of corresponding viewers, identifying a focal point for the plurality of viewers,
wherein generating the display data of the virtual object for the external display is based on the identified focal point for the plurality of viewers.

### Claim 16 (depends on 15)

The system of claim 15, wherein generating the display data of the virtual object comprises enlarging a portion of the virtual object based on the focal point for the plurality of viewers.

### Claim 17 (depends on 1)

The system of claim 1, wherein the operations further comprise:
a plurality of viewer groups based on the locations of the viewers, including a first group and a second group;
determining a first focal point for the first group; and
determining a second focal point for the second group;
wherein generating the display data of the virtual object comprises generating a first modified virtual object for the first focal group and generating a second modified virtual object for the second group, and causing the simultaneously display of the first modified virtual object and the second modified virtual object on the external display.

### Claim 18 (depends on 1)

The system of claim 1, wherein the operations further comprise:
performing feature extraction on the display data to identify reference points and associated appearance characteristics;
causing display of tags serving as reference points; and
performing, by the AR device, re-localization based on images captured from a camera of the AR device and reference points identified in the images.

### Claim 19

A method comprising:
identifying a communications connection between an external display system and an Augmented Reality (AR) device, the external display system being external to the AR device;
identifying a resolution of an external display of the external display system;
receiving user input from a user of the AR device associated with an interaction of a virtual object located within a real-world environment;
generating display data of the virtual object for the external display based on the resolution of the external display and the user input; and
transmitting the display data to the external display causing display of a rendering of the virtual object on the external display to viewers of the external display.

### Claim 20

A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
identifying a communications connection between an external display system and an Augmented Reality (AR) device, the external display system being external to the AR device;
identifying a resolution of an external display of the external display system;
receiving user input from a user of the AR device associated with an interaction of a virtual object located within a real-world environment;
generating display data of the virtual object for the external display based on the resolution of the external display and the user input; and
transmitting the display data to the external display causing display of a rendering of the virtual object on the external display to viewers of the external display.
