# US 2026/0065600 A1 · Three-dimensional chat thread visualization and interaction in augmented reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065600 A1
- Document ID: US20260065600A1
- Status: Published application
- Kind: A1
- Application number: 18/816,943
- Filed: 2024-08-27
- Published: 2026-03-05
- Earliest claimed: 2024-08-27
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Karen Stolzenberg; Mitchell Kuppersmith
- Web page: https://patentgrep.com/patent/US20260065600A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06Q 10/40: Business processes related to social networking or social networking services
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L 51/10: Multimedia information
- H04L 51/214: using selective forwarding
- H04L 51/222: using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A system and method for contextual three-dimensional messaging in augmented reality (AR) environments is disclosed. The system receives chat messages with specified real-world destinations and stores them associated with those locations. When a user wearing an AR device enters a destination location, the system detects their presence using techniques like GPS, Wi-Fi positioning, or computer vision. It then generates a 3D visual representation of the message and determines an appropriate spatial position within the physical environment based on environmental analysis and object detection. The 3D message is displayed at the determined position in the AR view. The system can analyze message content to identify topics and match them to detected real-world objects for contextual placement. Users can interact with displayed messages through gestures or voice commands to reply, forward, delete, or reposition messages. This enables immersive, location-aware messaging experiences that seamlessly blend digital content with the physical world.

## Claims

### Claim 1

A device for displaying a spatial friend feed in an augmented reality (AR) environment, the device comprising:
at least one camera;
at least one display;
at least one processor; and
at least one memory storage device storing instruction thereon, which, when executed by the at least one processor, cause the device to perform operations comprising:
receiving, by a chat application executing at an AR device, a chat message from a sender device, the chat message comprising message content and a specified real-world destination;
storing the chat message in association with the specified real-world destination;
detecting, by the AR device, that a user of the AR device has entered a physical location corresponding to the specified real-world destination;
in response to detecting that the user has entered the physical location:
generating a three-dimensional (3D) visual representation of the chat message;
determining a spatial position for the 3D visual representation within the physical location based on environmental data captured by at least one sensor of the AR device;
displaying, via a display of the AR device, the 3D visual representation of the chat message at the determined spatial position in the AR environment;
detecting a user interaction with the displayed 3D visual representation; and
initiating a communication action related to the chat message in response to the detected user interaction.

### Claim 2 (depends on 1)

The device of claim 1, wherein determining the spatial position for the 3D visual representation within the physical location comprises:
analyzing the message content to identify a topic or keyword;
detecting one or more objects within the physical location using computer vision techniques applied to image data captured by a camera of the AR device;
matching the identified topic or keyword to a detected object; and
positioning the 3D visual representation proximate to the matched object in the AR environment.

### Claim 3 (depends on 2)

The device of claim 2, wherein analyzing the message content to identify a topic or keyword comprises:
generating a prompt for a generative language model, the prompt including the message content and an instruction directing the model to output a predetermined number of potential topics related to the message content;
providing the generated prompt to the generative language model as input;
receiving, from the generative language model, an output comprising the predetermined number of potential topics; and
selecting at least one topic from the received output for use in matching to a detected object.

### Claim 4 (depends on 1)

The device of claim 1, wherein detecting that the user has entered the physical location corresponding to the specified real-world destination comprises at least one of:
determining a current geographic position of the AR device using a GPS component of the AR device; or
detecting a connection to a specific network;
identifying the specific network; and
determining that the specific network is associated with the specified real-world destination based on a mapping of networks to known locations.

### Claim 5 (depends on 1)

The device of claim 1, wherein detecting that the user has entered the physical location corresponding to the specified real-world destination comprises:
capturing, by a camera of the AR device, one or more images of the physical location;
analyzing the captured images using computer vision or object detection algorithms to identify objects within the physical location;
comparing the identified objects to a database that maps objects to known locations; and
determining that the identified objects match objects associated with the specified real-world destination in the database.

### Claim 6 (depends on 1)

The device of claim 1, wherein the operations further comprise:
determining a timestamp associated with the chat message;
calculating a depth value based on the timestamp, wherein more recent messages are assigned smaller depth values and older messages are assigned larger depth values;
positioning the 3D visual representation of the chat message within the AR environment at a depth corresponding to the calculated depth value, such that more recent messages appear closer to the user and older messages appear farther away.

### Claim 7 (depends on 1)

The device of claim 1, wherein the operations further comprise:
analyzing the environmental data to determine a current context or activity of the user;
identifying one or more chat threads related to the determined context or activity;
repositioning the 3D visual representations of the identified chat threads to be more prominently displayed within the AR environment; and
repositioning 3D visual representations of chat threads unrelated to the determined context or activity to be less prominently displayed within the AR environment.

### Claim 8 (depends on 1)

The device of claim 1, wherein the operations further comprise:
determining an age of the chat message based on its timestamp;
adjusting a visual property of the 3D visual representation based on the determined age, wherein the visual property comprises at least one of opacity, color saturation, or size; and
updating the display of the 3D visual representation to reflect the adjusted visual property, such that older messages are visually distinguished from newer messages in the AR environment.

### Claim 9 (depends on 1)

The device of claim 1, wherein initiating the communication action comprises:
detecting a gesture or voice command from the user interacting with the 3D visual representation;
interpreting the detected gesture or voice command to determine a corresponding communication action;
executing the determined communication action, wherein the communication action includes at least one of:
replying to the chat message,
forwarding the chat message,
deleting the chat message,
editing the chat message, or
changing the spatial position of the 3D visual representation within the AR environment; and
updating the display to reflect the executed communication action.

### Claim 10

A method for managing a chat thread in an augmented reality (AR) environment, the method comprising:
receiving, by a chat application executing at an AR device, a chat message from a sender device, the chat message comprising message content and a specified real-world destination;
storing the chat message in association with the specified real-world destination;
detecting, by the AR device, that a user of the AR device has entered a physical location corresponding to the specified real-world destination;
in response to detecting that the user has entered the physical location:
generating a three-dimensional (3D) visual representation of the chat message;
determining a spatial position for the 3D visual representation within the physical location based on environmental data captured by at least one sensor of the AR device;
displaying, via a display of the AR device, the 3D visual representation of the chat message at the determined spatial position in the AR environment;
detecting a user interaction with the displayed 3D visual representation; and
initiating a communication action related to the chat message in response to the detected user interaction.

### Claim 11 (depends on 10)

The method of claim 10, wherein determining the spatial position for the 3D visual representation within the physical location comprises:
analyzing the message content to identify a topic or keyword;
detecting one or more objects within the physical location using computer vision techniques applied to image data captured by a camera of the AR device;
matching the identified topic or keyword to a detected object; and
positioning the 3D visual representation proximate to the matched object in the AR environment.

### Claim 12 (depends on 11)

The method of claim 11, wherein analyzing the message content to identify a topic or keyword comprises:
generating a prompt for a generative language model, the prompt including the message content and an instruction directing the model to output a predetermined number of potential topics related to the message content;
providing the generated prompt to the generative language model as input;
receiving, from the generative language model, an output comprising the predetermined number of potential topics; and
selecting at least one topic from the received output for use in matching to a detected object.

### Claim 13 (depends on 10)

The method of claim 10, wherein detecting that the user has entered the physical location corresponding to the specified real-world destination comprises at least one of:
determining a current geographic position of the AR device using a GPS component of the AR device; or
detecting a connection to a specific network;
identifying the specific network; and
determining that the specific network is associated with the specified real-world destination based on a mapping of networks to known locations.

### Claim 14 (depends on 10)

The method of claim 10, wherein detecting that the user has entered the physical location corresponding to the specified real-world destination comprises:
capturing, by a camera of the AR device, one or more images of the physical location;
analyzing the captured images using computer vision or object detection algorithms to identify objects within the physical location;
comparing the identified objects to a database that maps objects to known locations; and
determining that the identified objects match objects associated with the specified real-world destination in the database.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
determining a timestamp associated with the chat message;
calculating a depth value based on the timestamp, wherein more recent messages are assigned smaller depth values and older messages are assigned larger depth values;
positioning the 3D visual representation of the chat message within the AR environment at a depth corresponding to the calculated depth value, such that more recent messages appear closer to the user and older messages appear farther away.

### Claim 16 (depends on 10)

The method of claim 10, wherein the method further comprises:
analyzing the environmental data to determine a current context or activity of the user;
identifying one or more chat threads related to the determined context or activity;
repositioning the 3D visual representations of the identified chat threads to be more prominently displayed within the AR environment; and
repositioning 3D visual representations of chat threads unrelated to the determined context or activity to be less prominently displayed within the AR environment.

### Claim 17 (depends on 10)

The method of claim 10, wherein the method further comprises:
determining an age of the chat message based on its timestamp;
adjusting a visual property of the 3D visual representation based on the determined age, wherein the visual property comprises at least one of opacity, color saturation, or size; and
updating the display of the 3D visual representation to reflect the adjusted visual property, such that older messages are visually distinguished from newer messages in the AR environment.

### Claim 18 (depends on 10)

The method of claim 10, wherein initiating the communication action comprises:
detecting a gesture or voice command from the user interacting with the 3D visual representation;
interpreting the detected gesture or voice command to determine a corresponding communication action;
executing the determined communication action, wherein the communication action includes at least one of:
replying to the chat message,
forwarding the chat message,
deleting the chat message,
editing the chat message, or
changing the spatial position of the 3D visual representation within the AR environment; and
updating the display to reflect the executed communication action.

### Claim 19

A device for displaying a spatial friend feed in an augmented reality (AR) environment, the device comprising:
means for receiving, by a chat application executing at an AR device, a chat message from a sender device, the chat message comprising message content and a specified real-world destination;
means for storing the chat message in association with the specified real-world destination;
means for detecting, by the AR device, that a user of the AR device has entered a physical location corresponding to the specified real-world destination;
in response to detecting that the user has entered the physical location:
means for generating a three-dimensional (3D) visual representation of the chat message;
means for determining a spatial position for the 3D visual representation within the physical location based on environmental data captured by at least one sensor of the AR device;
means for displaying, via a display of the AR device, the 3D visual representation of the chat message at the determined spatial position in the AR environment;
means for detecting a user interaction with the displayed 3D visual representation; and
means for initiating a communication action related to the chat message in response to the detected user interaction.

### Claim 20 (depends on 19)

The device of claim 19, wherein said means for determining the spatial position for the 3D visual representation within the physical location comprises:
means for analyzing the message content to identify a topic or keyword;
means for detecting one or more objects within the physical location using computer vision techniques applied to image data captured by a camera of the AR device;
means matching the identified topic or keyword to a detected object; and
means for positioning the 3D visual representation proximate to the matched object in the AR environment.
