# US 12,217,347 B2 · Interactive avatars in artificial reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,347 B2 - Document ID: US12217347B2 - Status: Granted - Kind: B2 - Application number: 18/517,544 - Filed: 2023-11-22 - Published: 2024-03-14 - Granted: 2025-02-04 - Earliest claimed: 2021-06-28 - Assignees: Meta Platforms Technologies, LLC - Applicants: Meta Platforms Technologies, LLC - Inventors: Campbell Orme; Matthew Adam Hanson; Daphne Liang; Matthew Roberts; Fangwei Lee; Bryant Jun-Yao Tang - Web page: https://patentgrep.com/patent/US12217347B2 ## CPC - G06T 13/40: of characters, e.g. humans, animals or virtual beings - A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes - A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity - A63F 13/25: Output arrangements for video game devices - A63F 13/35: Details of game servers - A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes - A63F 13/5255: according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character - A63F 13/53: involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game - A63F 13/795: for finding other players; for building a team; for providing a buddy list - G06T 11/00: Two-dimensional [2D] image generation - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - H04L 67/131: Protocols for games, networked simulations or virtual reality - A63F 2300/5553: user representation in the game field, e.g. avatar - G06T 2213/12: Rule based animation - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Aspects of the present disclosure are directed to creating interactive avatars that can be pinned as world-locked artificial reality content. Once pinned, an avatar can interact with the environment according to contextual queues and rules, without active control by the avatar owner. An interactive avatar system can configure the avatar with action rules, visual elements, and settings based on user selections. Once an avatar is configured and pinned to a location by an avatar owner, when other XR devices are at that location, a central system can provide the avatar (with its configurations) to the other XR device. This allows a user of that other XR device to discover and interact with the avatar according to the configurations established by the avatar owner. ## Claims ### Claim 1 A method for interacting with a pinned interactive avatar, pinned as world-locked artificial reality content, the method comprising: receiving, at an XR device, the pinned interactive avatar in response to A) an identification that the XR device is within a first threshold distance of a location at which the pinned interactive avatar was pinned or B) an indication from the XR device specifying an interaction for a location within a second threshold distance of the location at which the pinned interactive avatar was pinned, wherein the pinned interactive avatar is associated with one or more reactions that each include one or more triggers, with each trigger corresponding to one or more actions, wherein the one or more reactions control, at least in part, how the pinned interactive avatar acts, when viewed via the XR device; displaying, via the XR device, a version of the pinned interactive avatar; obtaining a context of the XR device; and matching the context with aspects of the one or more triggers to identify one or more activated triggers and, in response to identifying the one or more activated triggers, causing the version of the pinned interactive avatar to perform the one or more actions corresponding to each one of the one or more activated triggers. ### Claim 2 (depends on 1) The method of claim 1, wherein the pinned interactive avatar is associated with a notification provided to a user of the XR device, via a mobile device other than the XR device and in response to either A) the identification that the XR device is within the first threshold distance of the location at which the pinned interactive avatar was pinned or B) an identification that the mobile device is within the first threshold distance of the location at which the pinned interactive avatar was pinned. ### Claim 3 (depends on 1) The method of claim 1, wherein the receiving the pinned interactive avatar is in response to the indication from the XR device specifying the interaction for the location within the second threshold distance of the location at which the pinned interactive avatar was pinned; and the interaction for the location within the second threshold distance is based on a user selection in a map user interface. ### Claim 4 (depends on 1) The method of claim 1 further comprising causing a notification to be provided, to a remote system that originated the pinned interactive avatar, indicating that the pinned interactive avatar has been viewed. ### Claim 5 (depends on 4) The method of claim 4, wherein the notification indicates: what actions of the pinned interactive avatar have been triggered; and/or who has interacted with the pinned interactive avatar. ### Claim 6 (depends on 1) The method of claim 1, wherein the receiving the pinned interactive avatar is further response to a determination that a current time is within a specified time for the pinned interactive avatar to be viewed at the pinned location. ### Claim 7 (depends on 1) The method of claim 1, wherein the receiving the pinned interactive avatar is further response to a determination that a user of the XR device has a specified relationship, in an online platform, with an owner of the pinned interactive avatar. ### Claim 8 (depends on 1) The method of claim 1, wherein the pinned interactive avatar has a set of viewing permissions and the receiving the pinned interactive avatar is further in response to a determination that a current user of the XR device satisfies the viewing permissions. ### Claim 9 (depends on 1) The method of claim 1, wherein the displaying the version of the pinned interactive avatar includes one or more of: a text indication stating where the version of the pinned interactive avatar is, an indication of who an owner of the pinned interactive avatar is, a promotion virtual object associated with the pinned interactive avatar, an arrow or other directional indicator to the version of the pinned interactive avatar, or any combination thereof. ### Claim 10 (depends on 1) The method of claim 1, wherein the XR device is an augmented reality device through which a user of the XR device views the world with the version of the pinned interactive avatar as an overlay on a video feed of the real world or the XR device a mixed reality device with a pass-through display where the user of the XR device views the real world with the version of the pinned interactive avatar added as additional light projected to the user. ### Claim 11 (depends on 1) The method of claim 1, wherein the matching of the context of the XR device to the one or more activated triggers includes a determination that a user of the XR device has a specified relationship, on an online platform, with an owner of the pinned interactive avatar. ### Claim 12 (depends on 1) The method of claim 1, wherein the matching of the context of the XR device to the one or more activated triggers includes one or more of: determining that current weather data matches a trigger condition; determining that traffic data matches a trigger condition; or determining that a social media posting, associated with a geographical location, matches a trigger condition. ### Claim 13 (depends on 1) The method of claim 1, wherein the matching of the context of the XR device to the one or more activated triggers includes matching a determined emotion indicator for a user of the XR device with a trigger condition. ### Claim 14 A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for interacting with a pinned interactive avatar, pinned as world-locked artificial reality content, the process comprising: receiving, at an XR device, the pinned interactive avatar in response to A) an identification that the XR device is within a first threshold distance of a location at which the pinned interactive avatar was pinned or B) an indication from the XR device specifying an interaction for a location within a second threshold distance of the location at which the pinned interactive avatar was pinned, wherein the pinned interactive avatar is associated with one or more reactions that each include one or more triggers, with each trigger corresponding to one or more actions, wherein the one or more reactions control, at least in part, how the pinned interactive avatar acts, when viewed via the XR device; displaying, via the XR device, a version of the pinned interactive avatar; and identifying one or more activated triggers and, in response to identifying the one or more activated triggers, causing the version of the pinned interactive avatar to perform the one or more actions corresponding to each one of the one or more activated triggers. ### Claim 15 (depends on 14) The computer-readable medium of claim 14, wherein the process further comprises obtaining a context of the XR device; and wherein the identifying the one or more activated triggers comprises matching the context with aspects of the one or more triggers. ### Claim 16 (depends on 14) The computer-readable medium of claim 14, wherein an image, captured of a user of the XR device at the location where the pinned interactive avatar is pinned, is automatically modified to include a representation of the version of the pinned interactive avatar with the user of the XR device. ### Claim 17 (depends on 14) The computer-readable medium of claim 14, wherein the performed one or more actions, associated with the one or more activated triggers, include interacting with a user of the XR device and/or conferring a data object to the XR device. ### Claim 18 (depends on 14) The computer-readable medium of claim 14, wherein the XR device is a first XR device, the version of the pinned interactive avatar is a first version of the pinned interactive avatar, and the one or more actions performed by the first version of the pinned interactive avatar are one or more first actions; wherein a second XR device has received the pinned interactive avatar and displayed a second version of the pinned interactive avatar; and wherein the one or more first actions performed by the first interactive avatar are different from one or more second actions performed by the second version of the interactive avatar. ### Claim 19 A computing system for interacting with a pinned interactive avatar, pinned as world-locked artificial reality content, the computing system comprising: one or more processors; and one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising: receiving, at an XR device, the pinned interactive avatar in response to A) an identification that the XR device is within a first threshold distance of a location at which the pinned interactive avatar was pinned or B) an indication from the XR device specifying an interaction for a location within a second threshold distance of the location at which the pinned interactive avatar was pinned, wherein the pinned interactive avatar is associated with one or more reactions that each include one or more triggers, with each trigger corresponding to one or more actions, wherein the one or more reactions control, at least in part, how the pinned interactive avatar acts, when viewed via the XR device; displaying, via the XR device, a version of the pinned interactive avatar; and identifying one or more activated triggers and, in response to identifying the one or more activated triggers, causing the version of the pinned interactive avatar to perform the one or more actions corresponding to each of the one or more activated triggers. ### Claim 20 (depends on 19) The computing system of claim 19, wherein the process further comprises obtaining a context of the XR device; and wherein the identifying the one or more activated triggers comprises matching the context with aspects of the one or more triggers.